Ets Jan2005

Unsupervised Word Sense Discrimination By Clustering Similar Contexts Ted Pedersen University of Minnesota, Duluth http:// www.d.umn.edu/~tpederse Research Supported by National Science Foundation Faculty Early Career Development Award (#0092784)

Univ. of Minnesota, Duluth ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Alumni ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

At UMD… ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Overall Research Objectives ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Making Free Software Mostly Perl, All CopyLeft ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Unsupervised Word Sense Discrimination By Clustering Similar Contexts With Considerable Assistance From Anagha Kulkarni (M.S. 2006) Amruta Purandare (M.S. 2004)

Overview shells exploded in a US diplomatic complex in Liberia shell scripts are user interactive artillery guns were used to fire highly explosive shells the biggest shop on the shore for serious shell collectors shell script is a series of commands written into a file that Unix executes she sells sea shells by the sea shore sherry enjoys walking along the beach and collecting shells firework shells exploded onto usually dark screens in a variety of colors shells automate system administrative tasks we specialize in low priced corals, starfish and shells we help people in identifying wonderful sea shells along the coastlines shop at the biggest shell store by the shore shell script is much like the ms dos batch file

sherry enjoys walking along the beach and collecting shells we specialize in low priced corals, starfish and shells we help people in identifying wonderful sea shells along the coastlines shop at the biggest shell store by the shore she sells sea shells by the sea shore the biggest shop on the shore for serious shell collectors shell script is much like the ms dos batch file shell script is a series of commands written into a file that Unix executes shell scripts are user interactive shells automate system administrative tasks shells exploded in a US diplomatic complex in Liberia firework shells exploded onto usually dark screens in a variety of colors artillery guns were used to fire highly explosive shells

Unsupervised discrimination? ,[object Object],[object Object],[object Object],[object Object],[object Object]

Our goal? ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Our Approach ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Methodology ,[object Object],[object Object],[object Object],[object Object],[object Object]

Feature Selection ,[object Object],[object Object],[object Object]

What Data ? ,[object Object],[object Object],[object Object],[object Object],[object Object]

Local Training ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Surface Lexical Features ,[object Object],[object Object],[object Object]

Bigrams ,[object Object],the <>sea on <> the sea<>shore shells<> on sea<>shells she <>sells sells<>sea Rejected Selected

Bigrams in Window ,[object Object],[object Object],[object Object],shells<>shore sea<>sea shells<>sea sells<>shells window5 Window4 Window3

Co-occurrences ,[object Object],[object Object],[object Object],[object Object]

Feature Matching ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

1 st Order Context Vectors ,[object Object],[object Object],2 0 commands 1 0 1 1 0 0 C2 0 1 0 0 2 2 C1 unix firework execute system shore sea

2 nd Order Context Vectors ,[object Object],0 6272.85 2.9133 62.6084 20.032 1176.84 51.021 O2 context 0 18818.55 0 0 0 205.5469 134.5102 Store 0 0 0 136.0441 29.576 0 0 Shore 0 0 8.7399 51.7812 30.520 3324.98 18.5533 Sea Artillery Sales Bombs Sandy North- West Water Sells

2 nd Order Context Vectors Context sea shore store

Measuring Similarities ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Limitations 0 52.27 0 0.92 0 4.21 0 28.72 0 3.24 0 1.28 0 2.53 Weapon Missile Shoot Fire Destroy Murder Kill 17.77 0 14.6 46.2 22.1 0 34.2 19.23 2.36 0 72.7 0 1.28 2.56 Execute Command Bomb Pipe Fire CD Burn

Latent Semantic Analysis ,[object Object],[object Object],[object Object],[object Object]

Clustering ,[object Object],[object Object],[object Object],[object Object]

Evaluation (before mapping) c1 c2 c4 c3 2 1 15 2 C4 6 1 1 2 C3 1 7 1 1 C2 2 3 0 10 C1

Evaluation (after mapping) Accuracy=38/55=0.69 20 15 2 1 2 C4 17 1 1 0 55 11 12 15 10 6 1 2 C3 10 1 7 1 C2 15 2 3 10 C1

Majority Sense Classifier Maj. =17/55=0.31

Data ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Experiment 1: Features and Measures ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Experiment 1: Results POS wise 29 NOUNS 28verbs 15 adjs No of words of a POS for which experiment obtained accuracy more than Majority 8 7 3 5 7 6 MAT COS SOC UNI BI MAT COS MAT COS 0 1 0 0 1 1 9 13 5 5 6 11 SOC UNI BI SOC UNI BI

Experiment 1: Results Feature wise SOC BI UNI 32 18 38 1 1 6 11 7 6 MAT COS N ADJ V MAT COS MAT COS 0 1 9 13 8 7 0 0 5 5 3 5 N ADJ V N ADJ V

Experiment 1: Results Measure wise COS MAT 49 39 0 5 5 1 1 13 11 7 6 BI UNI SOC N ADJ V BI UNI SOC 0 5 3 0 1 9 6 8 7 N ADJ V

Experiment 1: Conclusions ,[object Object],[object Object],[object Object]

Experiment 2: 2 nd Order Contexts and RBR ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Schütze (2 nd Order Contexts) Pedersen & Bruce (1 st Order Contexts)

Experiment 2: Sval2 Results Bi-grams Vs Co-occurrences Bi-gram = COC 0 2 1 Bi-gram < COC 1 1 4 Bi-gram > COC 3 3 9 Bi-gram = COC 0 1 1 Bi-gram < COC 2 4 6 Bi-gram > COC 2 1 7 V A N PB1 Vs PB3 SC1 Vs SC3

Experiment 2: Sval2 Results RB Vs UPGMA RB = UPGMA 1 0 4 RB < UPGMA 0 5 2 RB > UPGMA 3 1 8 RB = UPGMA 1 2 1 RB < UPGMA 2 0 4 RB > UPGMA 1 4 9 V A N PB1 Vs PB2 SC1 Vs SC2

Experiment 2: Sval2 Results Comparing with MAJ 5 2 0 3 PB3 > MAJ 6 1 1 4 PB1 > MAJ 9 2 1 6 SC2 > MAJ 9 0 2 7 PB2 > MAJ 10 2 2 6 SC1 > MAJ 12 1 3 8 SC3 > MAJ Total V A N

Experiment 2: Results Line, Hard, Serve (TOP 3) PB2 PB1 PB3 Serve.v SC2 PB1 PB3 Hard.a PB2 PB3 PB1 Line.n 3 rd 2 nd 1 st

Experiment 2: Conclusions 2 nd order, RB Smaller Data (like SENSEVAL-2) 1 st order, UPGMA Large, Homogeneous (like Line, Hard, Serve) Recommendation Nature of Data

Ongoing Work ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

What’s this really all about? ,[object Object]

Mangled Web Search Results ,[object Object],[object Object],[object Object],[object Object],[object Object]

Software ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

CS 8761 – Fall 2004 ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Each system had to have … ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Each system had to have… ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Class web page, with links… ,[object Object]

Ets Jan2005

Recommended

Recommended

More Related Content

Viewers also liked

Viewers also liked (10)

Similar to Ets Jan2005

Similar to Ets Jan2005 (20)

More from University of Minnesota, Duluth

More from University of Minnesota, Duluth (20)

Recently uploaded

Recently uploaded (20)

Ets Jan2005