Introduction to Big Data Basics of Big Data by Warren Sifre

Warren Sifre Presenter… Data Analytics Solution Architect DMI Email: wsifre@dminc.com Twitter: @WAS_SQL LinkedIn: www.linkedin.com/in/wsifre

Who is Warren??? Data Professional for over 20 years… OCR/Spartan/Savage Racer and American Ninja Warrior in Training!!! Interests in SQL Server, MongoDB, Hadoop, PowerShell, and Information Security (Hacking) Indy BI PASS User Group Founder and Chapter Leader / Indy Power BI User Group Chapter Leader Frequent Presenter for PASS SQL Saturday, Local and Virtual User Groups, and other non- PASS related Conferences / User Groups. MSCE: Data Platforms/Business Intelligence, Hortonworks HCA, Teradata 14 CTP and many more…

Agenda What is Big Data? Why Big Data is a Big Deal? Sources of Big Data What Technology is related to Big Data? How is Big Data Leveraged by Organizations?

What is Big Data? Big Data is a classification of your organization’s data when it exceeds the traditional data management infrastructure. When data meets (at a minimum) one of the three V’s, but ideally 2 or more.

What are the Three Vs? Variety Extremely Large Data 10s of TBs to ZBs Volume Variety Velocity Extremely Large Data 10s of TBs to ZBs Data Changes Shape Dynamic Schema Extremely High # of Data Sources Extremely high # of data records generated per second Extremely high # of user requests per second

What is the Big Deal with Big Data? Big Data will most likely be the last time the mindset behind data will undergo such transformation or paradigm shift. Big Data is the culmination of technological connectedness that stems from the human need for knowing, sharing, and feedback loops. Big Data allows for Advanced Analytics to be the cornerstone of the most ground breaking innovations in the 21st century.

`

Research & Development GPS / Location Services Sources of Big data… Machines / Devices Research & Development GPS / Location Services Web Applications Social Networks

Technology behind Leveraging Big Data Machine Learning Cloud Architecture No SQL Hadoop Spark Mongo DB CosmosDB Microsoft Azure Amazon AWS IBM Cloud Google Cloud Data Science Predictive Models Advanced Analytics

How are others using big data? Rolls Royce is now selling Engine Mileage instead of Engines. Wind Mill farms are levering IoT to determine whether Wind Mills should be active or not. Transportation industry is performing predictive maintenance on vehicle as a way to eliminate unscheduled downtime.

Warren Sifre Thank You!!! Data Analytics Solution Architect DMI Email: wsifre@dminc.com Twitter: @WAS_SQL LinkedIn: www.linkedin.com/in/wsifre