1. NIST BIG DATA WG Reference Architecture Subgroup Draft Co-chairs: Orit Levin (Microsoft) James Ketner (AT&T) Don Krapohl (Augmented Intelligence) August 15, 2013

2. Agenda for August 15, 2013 Delivery #2: Common RA Draft Review and discuss the latest Ref Arch contributions Review and Discuss the proposed Outline Appoint volunteers Delivery #1: White Paper describing different RA approaches Discuss the way forward Appoint volunteers 8/15/2013NIST Big Data WG / Ref Arch Subgroup2

3. Reference Architecture Objectives Addresses a broad range of stakeholders (e.g., data owners, industries, academia, policy makers) Wide scope: Encompasses the whole data life cycle or in the ecosystem Can be applied to different use cases (including various verticals) Represents different system architectures (e.g., an enterprise data warehouse, distributed cloud-based system using multiple service providers) Focus Potentially with initial focus on the Big Data analytics and tools Assists in identifying security and privacy issues Agnostic to any specific technologies 8/15/2013NIST Big Data WG / Ref Arch Subgroup3

4. Draft Agreement / Rough Consensus Transformation includes Processing functions Analytic functions Visualization functions Data Infrastructure includes Data stores In-memory DBs Analytic DBs Sources Transformation Usage Data Infrastructure Security Management Cloud Computing Network 8/15/2013NIST Big Data WG / Ref Arch Subgroup4

5. Input for Discussion on the BD RA Next Level of Details The ideas presented on the next slides are based on various input documents to NIST BD subgroups Nothing has been finalized Additional input is solicited 8/15/2013NIST Big Data WG / Ref Arch Subgroup5

6. Proposal I: Highlighting the Different DB Approaches Security Management Cloud Computing Network Sources Transformation Usage Data Infrastructure Collection Export Curation Pre-analytics Visualization Data Manager Storage (disk, memory, etc.) File System Specialized Abstractions Data Mining Analytics Buffer Manager Map Reduce Relational DB NoSQL DB Aggregation Integration Transfer Search Statistics RT Analytics VOLUME VARIETY VELOCITY Streaming Interactive An. Batch Analytics 8/15/2013NIST Big Data WG / Ref Arch Subgroup6

7. Proposal II: Based on Submitted Requirements 8/15/2013NIST Big Data WG / Ref Arch Subgroup7

8. Backup Slides 8/15/2013NIST Big Data WG / Ref Arch Subgroup8