1. NIST BIG DATA WG Reference Architecture Subgroup Draft Co-chairs: Orit Levin (Microsoft) James Ketner (AT&T) Don Krapohl (Augmented Intelligence) August 8, 2013

2. From the previous subgroups call: Next Steps and AIs Deliverable I: Write the White Paper draft showing one or more (e.g., Data Flow and Stack approaches) using the same or similar terminology AI: Chairs will start the draft of the document incorporating the submissions to the Ref Arch subgroup. Is it still relevant? AI: Close cooperation between “Ref Arch” and “Def&Tax” sub-groups to produce the Output: taxonomy for the RA diagrams with definitions for major entities/blocks; Input: M-0057. Partially Done. Deliverable II: A draft of a single RA requires more discussion and inputs based on the work of all sub-groups AI: Chairs will start the draft of the document incorporating the findings of the Ref Arch subgroup. To be discussed today. AI: Review the latest contributions to the Ref Arch and incorporate their findings (See email from Yuri Demchenko / University of Amsterdam) Done. AI: Close cooperation with the “Use Cases” and “Security” sub-groups to identify the areas of focus for “zooming” into their architecture Still TBD 2 NIST Big Data WG / Ref Arch Sub-group8/8/2013

3. Reference Architecture Objectives No change Addresses a broad range of stakeholders (e.g., data owners, industries, academia, policy makers) Wide scope: Encompasses the whole data life cycle or in the ecosystem Can be applied to different use cases (including various verticals) Represents different system architectures (e.g., an enterprise data warehouse, distributed cloud-based system using multiple service providers) Focus Potentially with initial focus on the Big Data analytics and tools Assists in identifying security and privacy issues Agnostic to any specific technologies 3 8/8/2013NIST Big Data WG / Ref Arch Sub-group

4. Draft Agreement / Rough Consensus No change Transformation includes Processing functions Analytic functions Visualization functions Data Infrastructure includes Data stores In-memory DBs Analytic DBs NIST Big Data WG / Ref Arch Sub-group4 Sources Transformation Usage Data Infrastructure Security Management Cloud Computing Network 8/8/2013

5. RA: Possible Next Level Of Details for Discussion The ideas are based on various input documents to NIST BD subgroups; nothing has been finalized; additional input is solicited NIST Big Data WG / Ref Arch Sub-group5 Security Management Cloud Computing Network 8/8/2013 Sources Transformation Usage Data Infrastructure Collection Export Curation Pre-analytics Visualization Data Manager Storage (disk, memory, etc.)File SystemSpecialized Abstractions Data Mining Analytics Buffer Manager Map Reduce Relational DB NoSQL DB Aggregation Integration Transfer Search Statistics RT Analytics VOLUME VARIETY VELOCITY Streaming Interactive An. Batch Analytics

6. Next Steps and AIs Deliverable I: Write the White Paper draft showing one or more (e.g., Data Flow and Stack approaches) using the same or similar terminology AI: Chairs will start the draft of the document incorporating the submissions to the Ref Arch subgroup. Is it still relevant? AI: Close cooperation between “Ref Arch” and “Def&Tax” sub-groups to produce the Output: taxonomy for the RA diagrams with definitions for major entities/blocks; Input: M-0057. Continue. Deliverable II: A draft of a single RA requires more discussion and inputs based on the work of all sub-groups AI: Chairs will start the draft of the document incorporating the findings of the Ref Arch subgroup. To be discussed today. AI: Close cooperation with the “Use Cases” and “Security” sub-groups to identify the areas of focus for “zooming” into their architecture Remaining Action Item 6 NIST Big Data WG / Ref Arch Sub-group8/8/2013

7. Backup Slides 7 NIST Big Data WG / Ref Arch Sub-group8/8/2013