NTC 2014 Social Data Analysis Bhupesh Chawda

Suggestions This presentation provides links to data sets as well as tools and resources for working on Social Data Analysis Projects. We would recommend you browse through the data sets in this presentation and see if any of them interests you. Your creativity is to think of a problem you think could get solved by analyzing or utilizing these data sets. Since these datasets give you current and recent information, you could apply them for real-time applications which could be used by a large population. We don't want you to be over ambitious. However, we want you to be as innovative and as effective as possible. Feel free to reach out to us in case of any queries.

Deliverables You can either submit a standalone mobile application or a standalone web application or a combination of both. You should accompany your submission with clear set of instructions so that we can run your application at our end. To stress this point, we again note that we should be able to install and run your system at our end without any glitches. This means that you should test your application in different environments and make it general enough before you make the final submission. However, you can clearly specify under which environments your application works, for instance, Android v4.2, Linux/Windows etc. You application should work seamlessly with open source data sets and open source APIs, for instance, if your application is supposed to load data from a data source, the loading should happen automatically without any manual efforts.

Social Data Analysis Data Sets Twitter Streaming API – This API can be used to fetch tweets from Twitter. This is a realtime API and delivers tweets as soon as they are tweeted. – The API accepts keywords as parameters and fetches tweets as and when tweets matching these keywords appear on their server. – Please refer for any help on Twitter Streaming APIshttps://dev.twitter.com/docs/api/streaming Facebook Graph API – This API enables you to fetch public data from Facebook.com. – Since people are privacy aware on Facebook, you might not be able to fetch everything that is being posted. However, a large part of the data which is public is available through the graph API provided by Facebook. – Please refer the following for additional help:

Tools and Resources Data source libraries Twitter4j – Third party Java API to fetch tweets from Twitter APIs RestFb – Third party Java API to fetch Facebook posts and Comments through the Facebook Graph API – Tools and Packages NLP toolkits from Apache: Stanford NLP toolkit: Specialized NLP packages for Twitter text: JSON Java libraries: Analyze JSON data on Map reduce: JAQL -

Example Applications 1. You can choose to do any kind of analysis using the social data from Twitter and Facebook. You can even include other social sources as long as they are free and provide an open API. 2. Since most of the data that you will fetch from these sources is real time in nature, you can choose to do some real-time analysis and create an android app using your creativity. 3. Apart from real-time analysis, offline analysis of this data is also possible. Note: Whatever analysis you do, the resulting application should be creative and interesting. It should be of some use and value to people.

Example Applications contd. An example application that demonstrates the use of social media is given below: Android Social App for the visually impaired A blind user can configure a set of topics into the app using his voice. The app then takes the data as an input and starts fetching social data from Twitter/Facebook. This data is used to identify events on the fly. Once an event is identified which is relevant to the user like, for example, a fire in the vicinity, the user is informed about it. Similarly, it can be an event of interest to the user, like a music performance. PS. This is just a sample app. However, a lot of pieces and effort are needed to build something like this which works satisfactorily in a scalable manner. Try to be creative and build something interesting and useful in a moderate amount of effort.