1. evolu tion lex ica lear ning wo rd NL P mo del  no de net wo rk syn tax POSPOS @ com plex sem anti ed ge ba ng la  PAPA D zul u Social Computing for Linguistics & Linguistics for Social Computing Monojit Choudhury Microsoft Research India monojitc@microsoft.com

2. evoluti on lexi ca learn ing wo rd NL P mo del  no de net wo rk syn tax POSPOS @ com plex sema nti ed ge ba ngl a  PAPA D zul u 2 Language is shaped by social interaction patterns; emails, blogs, sms, queries – CMC’s Linguistics for SoC SoC for Linguistics SoC platforms for linguistic experiments; SoC Models for linguistic theories

3. evoluti on lexi ca learn ing wo rd NL P mo del  no de net wo rk syn tax POSPOS @ com plex sema nti ed ge ba ngl a  PAPA D zul u 3 Language is shaped by social interaction patterns; emails, blogs, sms, queries – CMC’s Linguistics for SoC SoC for Linguistics SoC platforms for linguistic experiments; SoC Models for linguistic theories Web Search Queries as an Emerging Language

4. evoluti on lexi ca learn ing wo rd NL P mo del  no de net wo rk syn tax POSPOS @ com plex sema nti ed ge ba ngl a  PAPA D zul u 4 Language is shaped by social interaction patterns; emails, blogs, sms, queries – CMC’s Linguistics for SoC SoC for Linguistics SoC platforms for linguistic experiments; SoC Models for linguistic theories Mean length of queries  Web Search Queries as an Emerging Language

5. evoluti on lexi ca learn ing wo rd NL P mo del  no de net wo rk syn tax POSPOS @ com plex sema nti ed ge ba ngl a  PAPA D zul u 5 Language is shaped by social interaction patterns; emails, blogs, sms, queries – CMC’s Linguistics for SoC SoC for Linguistics SoC platforms for linguistic experiments; SoC Models for linguistic theories Mean length of queries  Web Search Queries as an Emerging Language

6. evoluti on lexi ca learn ing wo rd NL P mo del  no de net wo rk syn tax POSPOS @ com plex sema nti ed ge ba ngl a  PAPA D zul u 6 Language is shaped by social interaction patterns; emails, blogs, sms, queries – CMC’s Linguistics for SoC SoC for Linguistics SoC platforms for linguistic experiments; SoC Models for linguistic theories Web Search Queries as an Emerging Language Unsupervised segmentation Distributional Patterns Taxonomy of Function units Word co-occurrence Network Queries are difficult to interpret User Behavior Studies Basic units Search expertise  language acquisition

7. evoluti on lexi ca learn ing wo rd NL P mo del  no de net wo rk syn tax POSPOS @ com plex sema nti ed ge ba ngl a  PAPA D zul u 7 SoC for Linguistics SoC platforms for linguistic experiments; SoC Models for linguistic theories Web Search Queries as an Emerging Language Web Search Queries are an evolving Protolanguage Collaborators: Rishiraj Saha Roy & Niloy Ganguly (IIT Kharagpur), Srivatsan Laxman & Kalika Bali (MSR India)

8. evoluti on lexi ca learn ing wo rd NL P mo del  no de net wo rk syn tax POSPOS @ com plex sema nti ed ge ba ngl a  PAPA D zul u 8 Language is shaped by social interaction patterns; emails, blogs, sms, queries – CMC’s Linguistics for SoC SoC for Linguistics SoC platforms for linguistic experiments; SoC Models for linguistic theories Use of Indian languages on online social media Code mixing Transliteration Spelling Change Indian English Collaborators: Kalika Bali & Nimmi Rangaswamy (MSR India)

9. evoluti on lexi ca learn ing wo rd NL P mo del  no de net wo rk syn tax POSPOS @ com plex sema nti ed ge ba ngl a  PAPA D zul u 9 Language is shaped by social interaction patterns; emails, blogs, sms, queries – CMC’s Linguistics for SoC SoC for Linguistics SoC platforms for linguistic experiments; SoC Models for linguistic theories Sociolinguistic Experiments OSN Games with a Purpose CodeGambler is an OSN Game to study the population-level emergence of categorization of a continuous space (colors) into discrete category terms (color names) Collaborators: Animesh Mukherjee (IIT Kgp), Vittorio Loreto, (University of Rome)

10. evoluti on lexi ca learn ing wo rd NL P mo del  no de net wo rk syn tax POSPOS @ com plex sema nti ed ge ba ngl a  PAPA D zul u 10 Language is shaped by social interaction patterns; emails, blogs, sms, queries – CMC’s Linguistics for SoC SoC for Linguistics SoC platforms for linguistic experiments; SoC Models for linguistic theories Sociolinguistic Experiments Crowdsourcing for data Flat segmentation (queries and sentences) Nested segmentation

11. evoluti on lexi ca learn ing wo rd NL P mo del  no de net wo rk syn tax POSPOS @ com plex sema nti ed ge ba ngl a  PAPA D zul u 11 Language is shaped by social interaction patterns; emails, blogs, sms, queries – CMC’s Linguistics for SoC SoC for Linguistics SoC platforms for linguistic experiments; SoC Models for linguistic theories SoC inspired Linguistic Theory Word Co-occurrence Network Small world word lang uage in hum an trea t as is cancan evol ving neig hbori ng disti nct inte ract ing we b sent enc es suc h stru ctur e a com plex netw ork Two-regime power law degree distribution Kernel-Periphery structure Low rank Collaborators: Animesh, Niloy (IIT Kgp), Chris Biemann (University of Darmstadt), Ravi Kannan (MSR India)

12. evoluti on lexi ca learn ing wo rd NL P mo del  no de net wo rk syn tax POSPOS @ com plex sema nti ed ge ba ngl a  PAPA D zul u 12 Language is shaped by social interaction patterns; emails, blogs, sms, queries – CMC’s Linguistics for SoC SoC inspired Linguistic Theory Word Co-occurrence Network Collaborators: Animesh, Niloy (IIT Kgp), Chris Biemann (University of Darmstadt), Ravi Kannan (MSR India) WCN of Bollywood Lyrics is a very small world with a tiny kernel. Learn 1000 Hindi words and you will understand every Bollywood song!

13. evoluti on lexi ca learn ing wo rd NL P mo del  no de net wo rk syn tax POSPOS @ com plex sema nti ed ge ba ngl a  PAPA D zul u 13 Language is shaped by social interaction patterns; emails, blogs, sms, queries – CMC’s Linguistics for SoC SoC inspired Linguistic Theory Word Co-occurrence Network Collaborators: Animesh, Niloy (IIT Kgp), Chris Biemann (University of Darmstadt), Ravi Kannan (MSR India) WCN of Web search queries is not (yet) small world! It has a tiny kernel but very large periphery

14. Thank You! http://research.microsoft.com/people/monojitc/ 14 evolu tion lex ica lear ning wo rd NL P mo del  no de net wo rk syn tax POSPOS @ com plex sem anti ed ge ba ng la  PAPA D zul u