Big Data Analysis / Analytics Balasubramanian V Developer University Informatics Centre Bharathidasan University

What’s this? The phenomenon came about in recent years Due to the sheer amount of machine data being generated today Leaving a digital trace! Computerizing!

Why we need to know about Bigdata? We are generating lot of data Science, Technology, Internet…. Email Social Networks – Status, Comment, Tweet Bank Transactions, Debit/Credit Cards Mobile Phones, Smart Phones Customer Data, Bills, Invoices Medical Case History…

Digital Traces Smartphones and tablets outsold desktop and laptop computers. There are more Smartphones in the U.S. in 2020 than people! The phone in your pocket has more programmable memory, more storage and more capability than several large IBM computers and better than some supercomputers of 1980’s.

Data… Data – Past, Present, Future Analysis - Why did something happen?  Analytics - What is likely to happen? Yesterday’s data is smaller than today’s data and Today’s data is going to be smaller than tomorrow’s data In 2005, Two Crore Rows in a Database is considered to be big data. Now…

Exponential Growth of Data

Chessboard

Data Growth => KB MB GB TB PB EB ZB YB 1==> 1 2. 2==> 3 3. 4==> 7 4. 8==> 15 …. 56. 36028797018963970==> 72057594037927940 57. 72057594037927940==> 144115188075855900 58. 144115188075855900==> 288230376151711700 59. 288230376151711700==> 576460752303423500 60. 576460752303423500==> 1152921504606847000 61. 1152921504606847000==> 2305843009213694000 62. 2305843009213694000==> 4611686018427388000 63. 4611686018427388000==> 9223372036854776000 64. 9223372036854776000==> 18446744073709550000

From the dawn of civilization until 2003, humankind generated five exabytes of data. Now we produce five exabytes every two days…and the pace is accelerating. Eric Schmidt, Executive Chairman, Google © 2014 Advanced Performance Institute, BWMC Ltd. All rights reserved.

Data… KB,MB,GB,TB,PB,EB,ZB,YB Leaving Traces Google knows me more than anyone! Case Study: Hospitals / Pharmacy Vs. Restaurants Megamart, Femina, Wallmart, Spencer – Loyalty Cards Flipkart Market Basket Analysis CIBIL – Credit Information Bureau India Ltd. Smartphone – location services and apps.

Who is collecting what? Credit Card Companies What data are they getting? Airline ticket Restaurant check Grocery Bill Hotel Bill

The ‘Datafication’ of our World; Turning Big Data into Value: The datafication of our world gives us unprecedented amounts of data in terms of Volume, Velocity, Variety and Veracity. The latest technology such as cloud computing and distributed systems together with the latest software and analysis approaches allow us to leverage all types of data to add value. Value Volume Analysis The ‘Datafication’ of our World; Activities Conversations Words Voice Social Media Browser logs Photos Videos Sensors Etc. Analysing Big Data: Text analytics Sentiment analysis Face recognition Voice analytics Movement analytics Etc. Velocity Variety Veracity © 2014 Advanced Performance Institute, BWMC Ltd. All rights reserved.

Generating Data Facebook – Recommendations – Social Graph Amazon – Recommendations Movie Reviews – JABONG, ZOVI… 25PB Data everyday in Facebook and Twitter

Giving Free Information Getting benefits Discounts are for the Data

Not All Data is called ‘Big Data’ Value of the Data Credit Card Usage – Sudden Change in behavior Income Tax Department Tracking our transactions (AADHAR)

Pros and Cons Business Insight Smartness Privacy ? USA’s – NSA London Riots Like, Share, Tweet, Comment,… Using Cell Phone from 15 Years to 25 Years – Job – Appointments – Visa Denial

How Can You Avoid Big Data? Pay cash for everything! Never go online! Don’t use a telephone! Never leave your house!

Thanx! balav@bdu.ac.in