Big Data Dr. Mazin Al-Hakeem (Nov 2016), “Big Data: Reality and Challenges”, LFU – Erbil.

Slides:



Advertisements
Similar presentations
R and HDInsight in Microsoft Azure
Advertisements

Deloitte Consulting LLP June 22-25, 2014 IIS 50 th Annual Seminar, London 2014 Big Data in Insurance International Insurance Society.
Big Data and Predictive Analytics in Health Care Presented by: Mehadi Sayed President and CEO, Clinisys EMR Inc.
Hadoop in the Wild CMSC 491 Hadoop-Based Distributed Computing Spring 2015 Adam Shook.
Big Data Workflows N AME : A SHOK P ADMARAJU C OURSE : T OPICS ON S OFTWARE E NGINEERING I NSTRUCTOR : D R. S ERGIU D ASCALU.
Big Data & Hadoop By Mr.Nataraj smallest unit is bit 1 byte=8 bits 1 KB (Kilo Byte)= 1024 bytes =1024*8 bits 1MB (Mega Byte)=1024 KB=(1024)^2 * 8 bits.
ETM Hadoop. ETM IDC estimate put the size of the “digital universe” at zettabytes in forecasting a tenfold growth by 2011 to.
25 Need-to-Know Facts. Fact 1 Every 2 days we create as much information as we did from the beginning of time until 2003 [Source]Source © 2014 Bernard.
Summary of “New Ways to Exploit Raw Data May Bring Surge of Innovation, a Study Says” Steve Lohr, New York Times, May 13th, 2011 Presented by: Zhe Jiang.
Big Data.
Big Data A big step towards innovation, competition and productivity.
This presentation was scheduled to be delivered by Brian Mitchell, Lead Architect, Microsoft Big Data COE Follow him Contact him.
Distributed and Parallel Processing Technology Chapter1. Meet Hadoop Sun Jo 1.
HDInsight on Azure and Map-Reduce Richard Conway Windows Azure MVP Elastacloud Limited.
Facebook (stylized facebook) is a Social Networking System and website launched in February 2004, operated and privately owned by Facebook, Inc. As.
Big Data. What is Big Data? Big Data Analytics: 11 Case Histories and Success Stories
Hadoop Basics -Venkat Cherukupalli. What is Hadoop? Open Source Distributed processing Large data sets across clusters Commodity, shared-nothing servers.
SEMINAR ON Guided by: Prof. D.V.Chaudhari Seminar by: Namrata Sakhare Roll No: 65 B.E.Comp.
What is Big Data? Bid Data extremely large data sets that may be analyzed computationally to reveal patterns, trends, and associations, especially.
O’Reilly – Hadoop: The Definitive Guide Ch.1 Meet Hadoop May 28 th, 2010 Taewhi Lee.
Dr. Michael D. Featherstone Summer 2013 Introduction to e-Commerce Web Analytics.
MIS – 3030 Business Technologies Social Media & Conversation Big Data.
Ethics of Big Data Eduardo Felipe Zecca da Cruz. What is Big Data? Stamford, Conn.-based IT research firm Gartner Inc. defines "big data" as "high-volume,
The exponential growth of data –Challenges for Google,Yahoo,Amazon & Microsoft in web search and indexing The volume of data being made publicly available.
+ Hbase: Hadoop Database B. Ramamurthy. + Motivation-0 Think about the goal of a typical application today and the data characteristics Application trend:
Introduction to Hbase. Agenda  What is Hbase  About RDBMS  Overview of Hbase  Why Hbase instead of RDBMS  Architecture of Hbase  Hbase interface.
+ Big Data IST210 Class Lecture. + Big Data Summary by EMC Corporation ( More videos that.
Innovation Work Circle: Big Data Presented By: Innovation Work Circle Group.
Big Data – Big Opportunity Mohammad Khansari ITRC President Jan 2015 ITRC, Tehran, Iran.
Breaking points of traditional approach What if you could handle big data?
BACS 287 Big Data & NoSQL 2016 by Jones & Bartlett Learning LLC.
IoT Meets Big Data Standardization Considerations
Big Data Analytics with Excel Peter Myers Bitwise Solutions.
Big Data Javad Azimi May First of All… Sorry about the language  Feel free to ask any question Please share similar experiences.
B IG D ATA A NALYTICS A Presentation by Meg Monsen, Michael Leonard, and Eric Zeng.
This is a free Course Available on Hadoop-Skills.com.
BIG DATA. Big Data: A definition Big data is a collection of data sets so large and complex that it becomes difficult to process using on-hand database.
Hadoop in the Wild CMSC 491 Hadoop-Based Distributed Computing Spring 2016 Adam Shook.
Big Data-An Analysis. Big Data: A definition Big data is a collection of data sets so large and complex that it becomes difficult.
Data Analytics (CS40003) Introduction to Data Lecture #1
Data Analytics 1 - THE HISTORY AND CONCEPTS OF DATA ANALYTICS
Big Data Analysis / Analytics
SAS users meeting in Halifax
Supporting the human decision maker IBM Research and big data at the edge Dr. Jürg von Känel Associate Director IBM Research Australia.
Sushant Ahuja, Cassio Cristovao, Sameep Mohta
Understanding Big Data
Data Mining, Data Science, Big Data
An Open Source Project Commonly Used for Processing Big Data Sets
Where do we need it ? Why do we need it ? What is Data Analytics ?
BIG Data 25 Need-to-Know Facts.
BIG DATA IN ENGINEERING APPLICATIONS
Big-Data Fundamentals
Hadoop.
Department of Information Systems
Ministry of Higher Education
How Big is your Data? What’s Big Data All About then? Tony Porritt
Tools for Processing Big Data Jinan Al Aridhee and Christian Bach
Big Data.
Big Data Young Lee BUS 550.
TIM TAYLOR AND JOSH NEEDHAM
Big Data 5 exabytes (1018 bytes) of data were created by human until Today this amount of information is created in two days. In 2012, digital world.
T H I N C Transformation Technology New Capabilities
Collecting, processing & understanding lots of information
Zoie Barrett and Brian Lam
Big Data: Four Vs Salhuldin Alqarghuli.
Big Data Analysis in Digital Marketing
The three v’s of big data
Big DATA.
Copyright © JanBask Training. All rights reserved Get Started with Hadoop Hive HiveQL Languages.
Big Data.
Presentation transcript:

Big Data Dr. Mazin Al-Hakeem (Nov 2016), “Big Data: Reality and Challenges”, LFU – Erbil

Big Data 30 Mints What is the problem ? BD’s Definition BD Concepts (3V’s – 4V’s) BD Technologies 30 Mints BD Applications BD Analysis Process (2 Cases) BD’s Privacy Issue

Data Big is a term for data sets that are so large or complex that traditional data processing applications are inadequate to deal with them. Challenges include analysis, capture, search, share, storage, transfer, visualization, querying, updating and information privacy.

just 2 days every 10 minutes Since the dawn of time and up until 2003 has produced (5 billion gigabytes) of data. just 2 days However, in 2011, 5 billion gigabytes of data was produced in every 10 minutes and in 2013, 5 billion gigabytes of data are produced In addition to that, 90% of the present data was produced in the last 2 years only. Eric Schmidt, Google's CEO twitter.com/ericschmidt

?

8 Zettabyte / Day Thousand Billion Billion 3.27 Billion Users 2015

8 Zettabyte / Day

8 Zettabyte / Day

NYSE 1 Terabytes / Trade Process Facebook 50 Billion Photo / Day LinkedIn 1 Billion Suggestion / Month

Information Growth GDP Big Turning Point

2012 Doug Cutting twitter.com/cutting Big Data

3 V’s Velocity Volume Variety Speed Access and Analyze S/ UnS / SemiS Terabytes Collect from Diverse Sources Storage Variety

4 V’s IBM > 1 Trillion $ / Year

2011 for distributed storage and processing of very large data sets. It consists of computer clusters built from hardware.

- MapReduce - Hbase - Hive - Zookeeper :

The areas of health care, manufacturing management, traffic management, and many other fields.

Market Behavior

Market Behavior Business Wits The question is, is this good or bad? What is about the privacy? I don't know, I really don't know Business Wits

Big Data Market Behavior Business Wits BDA - Top 10 Jobs

Data Big Q & A