NIST BIG DATA WG Reference Architecture Subgroup Draft Co-chairs: Orit Levin (Microsoft) James Ketner (AT&T) Don Krapohl (Augmented Intelligence) August.

Slides:

Advertisements

Similar presentations

Distributed Data Processing

Advertisements

NIST Big Data Public Working Group Technology Roadmap Subgroup Presentation September 30, 2013 Carl Buffington (Vistronix) David Boyd (Data Tactic) Dan.

NIST BIG DATA WG Reference Architecture Subgroup Intermediate Report Co-chairs: Orit Levin (Microsoft) James Ketner (AT&T) Don Krapohl (Augmented Intelligence)

Internet of Things and Platforms for Connected Smart Objects European Commission DG CONNECT Brussels. 23 rd October 2013.

Presentation at WebEx Meeting June 15,  Context  Challenge  Anticipated Outcomes  Framework  Timeline & Guidance  Comment and Questions.

NIST Big Data Public Working Group Security and Privacy Subgroup Presentation September 30, 2013 Arnab Roy, Fujitsu Akhil Manchanda, GE Nancy Landreville,

NIST Big Data Public Working Group Big Data PWG Overview Presentation September 30, 2013 Wo Chang, NIST Robert Marcus, ET-Strategies Chaitanya Baru, UC.

Big Data and Predictive Analytics in Health Care Presented by: Mehadi Sayed President and CEO, Clinisys EMR Inc.

CloudSocial Mobility Big data Social connections, mobility, cloud delivery and pervasive information are converging in a powerful way. This convergence.

Reference Architecture Subgroup NIST Big Data Public Working Group Reference Architecture Subgroup September 30, 2013 Co-chairs: Orit LevinMicrosoft James.

MS DB Proposal Scott Canaan B. Thomas Golisano College of Computing & Information Sciences.

Copyright 2010 John Wiley & Sons, Inc.

1 3 rd SG13 Regional Workshop for Africa on “ITU-T Standardization Challenges for Developing Countries Working for a Connected Africa” (Livingstone, Zambia,

Hadoop tutorials. Todays agenda Hadoop Introduction and Architecture Hadoop Distributed File System MapReduce Spark 2.

NIST Big Data Public Working Group Reference Architecture Subgroup September 30, 2013 Co-chairs: Orit LevinMicrosoft James KetnerAT&T Don KrapohlAugmented.

NIST BIG DATA WG Reference Architecture Subgroup Meeting Agenda Co-chairs: Orit Levin (Microsoft) James Ketner (AT&T) Don Krapohl (Augmented Intelligence)

8/15/2013NIST Big Data WG / Ref Arch Subgroup1 NIST Big Data Program Alignment: Roadmap & Reference Architecture Version 1.3 Roadmap Subgroup NIST Big.

David Besemer, CTO On Demand Data Integration with Data Virtualization.

RDA Data Foundation and Terminology (DFT) IG: Introduction Prepared for RDA Plenary San Diego, March 9, 2015 Gary Berg-Cross, Raphael Ritz, Co-Chairs DFT.

NIST Information Technology Laboratory Cloud Computing Program NIST Cloud Computing Program Current Activities Robert Bohn OASIS – International Cloud.

SOA Landscape Recommendations By >. Who we are  Team Members  Company History  Current & Past Client Projects  Note: have fun here. Make up your history.

Ch 4. The Evolution of Analytic Scalability

Analytics Map Reduce Query Insight Hive Pig Hadoop SQL Map Reduce Business Intelligence Predictive Operational Interactive Visualization Exploratory.

SC32 WG2 Metadata Standards Tutorial Metadata Registries and Big Data WG2 N1945 June 9, 2014 Beijing, China.

RDA Data Foundation and Terminology (DFT) IG: Introduction Prepared for RDA Plenary San Diego, March 9, 2015 Gary Berg-Cross, Raphael Ritz, Co-Chairs DFT.

K E Y : SW Service Use Big Data Information Flow SW Tools and Algorithms Transfer Application Provider Visualization Access Analytics Curation Collection.

RJB Technical Consulting Microsoft Office SharePoint Server 2007 Governance Russ Basiura RJB Technical Consulting.

NIST BIG DATA WG Reference Architecture Subgroup Draft Co-chairs: Orit Levin (Microsoft) James Ketner (AT&T) Don Krapohl (Augmented Intelligence) August.

Department of Information Engineering The Chinese University of Hong Kong A Framework for Monitoring and Measuring a Large-Scale Distributed System in.

Cloud Use Cases, Required Standards, and Roadmaps Excerpts From Cloud Computing Use Cases White Paper

Privacy Communication Privacy Confidentiality Access Policies Systems Crypto Enforced Computing on Encrypted Data Searching and Reporting Fully Homomorphic.

NIST Big Data Public Working Group Security and Privacy Subgroup Presentation September 30, 2013 Arnab Roy, Fujitsu Akhil Manchanda, GE Nancy Landreville,

Data Warehouse. Group 5 Kacie Johnson Summer Bird Washington Farver Jonathan Wright Mike Muchane.

NIST BIG DATA WG Reference Architecture Subgroup Agenda for the Subgroup Call Co-chairs: Orit Levin (Microsoft) James Ketner (AT&T) Don Krapohl (Augmented.

NIST BIG DATA WG Reference Architecture Subgroup Intermediate Report Co-chairs: Orit Levin (Microsoft) James Ketner (AT&T) Don Krapohl (Augmented Intelligence)

INTRODUCTION TO DBS Database: a collection of data describing the activities of one or more related organizations DBMS: software designed to assist in.

K E Y : SW Service Use Big Data Information Flow SW Tools and Algorithms Transfer Transformation Provider Visualization Access Analytics Curation Collection.

8/20/2013NIST Big Data WG / Roadmap Subgroup1 Architecture Storage Architecture Processing Architecture Resource Managers Architecture Infrastructure Architecture.

Computing Sciences Directorate, L B N L 1 CHEP 2003 Standards For Storage Resource Management BOF Co-Chair: Arie Shoshani * Co-Chair: Peter Kunszt ** *

TGDC Meeting, July 2010 Report of the UOCAVA Working Group John Wack National Institute of Standards and Technology DRAFT.

Enterprise Solutions Chapter 10 – Enterprise Content Management.

© Cloud Security Alliance, 2015 Wilco van Ginkel, Co-Chair BDWG.

IoT Meets Big Data Standardization Considerations

Extracting value from grey literature Processes and technologies for aggregating and analysing the hidden Big Data treasure of the organisations.

Data Resource Management Agenda What types of data are stored by organizations? How are different types of data stored? What are the potential problems.

Group Name: oneM2M WG1 Requirements Source: Phil Hawkes, Rapporteur “Benefits of oneM2M technology” TR,

K E Y : DATA SW Service Use Big Data Information Flow SW Tools and Algorithms Transfer Hardware (Storage, Networking, etc.) Big Data Framework Scalable.

Role Activity Sub-role Functional Components Control Data Software.

Big Data RA Topics 1 Industries Data Characteristics “V”s Curation Processing Changes E, T, L Scalable Infrastructure Management Security Data Sources.

Group Name: oneM2M WG1 Requirements Source: Phil Hawkes, Rapporteur “Benefits of oneM2M technology” TR,

Jeju, 13 – 16 May 2013Standards for Shared ICT Andrew White Principal Consultant Nokia Siemens Networks ATIS’ Cloud Services Activity Document No: GSC17-PLEN-64.

Big Data Yuan Xue CS 292 Special topics on.

University of Wyoming Financial Reporting Initiative Update April 2016.

Copyright © 2016 Pearson Education, Inc. Modern Database Management 12 th Edition Jeff Hoffer, Ramesh Venkataraman, Heikki Topi CHAPTER 11: BIG DATA AND.

Thought Leaders in Data Science and Analytics - Big Data Analytics Ram Akella Cell Skype ID: ramakella1 621C SDH.

Defining ONAP APIs With BSS/OSS

Big Data Enterprise Patterns

Big Data Management – Fall 2016

BIG DATA IN ENGINEERING APPLICATIONS

ATIS’ Cloud Services Activity

Data Warehouse.

big data at ericsson research

Operationalize your data lake Accelerate business insight

Platforms for Connected Smart Objects

Ch 4. The Evolution of Analytic Scalability

Data Warehousing Data Mining Privacy

CS 239 – Big Data Systems Fall 2018

Presentation transcript:

NIST BIG DATA WG Reference Architecture Subgroup Draft Co-chairs: Orit Levin (Microsoft) James Ketner (AT&T) Don Krapohl (Augmented Intelligence) August 15, 2013

Agenda for August 15, 2013 Delivery #2: Common RA Draft Review and discuss the latest Ref Arch contributions Review and Discuss the proposed Outline Appoint volunteers Delivery #1: White Paper describing different RA approaches Discuss the way forward Appoint volunteers 8/15/2013NIST Big Data WG / Ref Arch Subgroup2

Reference Architecture Objectives Addresses a broad range of stakeholders (e.g., data owners, industries, academia, policy makers) Wide scope: Encompasses the whole data life cycle or in the ecosystem Can be applied to different use cases (including various verticals) Represents different system architectures (e.g., an enterprise data warehouse, distributed cloud-based system using multiple service providers) Focus Potentially with initial focus on the Big Data analytics and tools Assists in identifying security and privacy issues Agnostic to any specific technologies 8/15/2013NIST Big Data WG / Ref Arch Subgroup3

Draft Agreement / Rough Consensus Transformation includes Processing functions Analytic functions Visualization functions Data Infrastructure includes Data stores In-memory DBs Analytic DBs Sources Transformation Usage Data Infrastructure Security Management Cloud Computing Network 8/15/2013NIST Big Data WG / Ref Arch Subgroup4

Input for Discussion on the BD RA Next Level of Details The ideas presented on the next slides are based on various input documents to NIST BD subgroups Nothing has been finalized Additional input is solicited 8/15/2013NIST Big Data WG / Ref Arch Subgroup5

Proposal I: Highlighting the Different DB Approaches Security Management Cloud Computing Network Sources Transformation Usage Data Infrastructure Collection Export Curation Pre-analytics Visualization Data Manager Storage (disk, memory, etc.) File System Specialized Abstractions Data Mining Analytics Buffer Manager Map Reduce Relational DB NoSQL DB Aggregation Integration Transfer Search Statistics RT Analytics VOLUME VARIETY VELOCITY Streaming Interactive An. Batch Analytics 8/15/2013NIST Big Data WG / Ref Arch Subgroup6

Proposal II: Based on Submitted Requirements 8/15/2013NIST Big Data WG / Ref Arch Subgroup7

Backup Slides 8/15/2013NIST Big Data WG / Ref Arch Subgroup8