1. Big Data Open Source Software and Projects ABDS in Summary II: Layer 5 I590 Data Science Curriculum August 15 2014 Geoffrey Fox gcf@indiana.edu http://www.infomall.org School of Informatics and Computing Digital Science Center Indiana University Bloomington

2. HPC-ABDS Layers 1)Message Protocols 2)Distributed Coordination: 3)Security & Privacy: 4)Monitoring: 5)IaaS Management from HPC to hypervisors: 6)DevOps: 7)Interoperability: 8)File systems: 9)Cluster Resource Management: 10)Data Transport: 11)SQL / NoSQL / File management: 12)In-memory databases&caches / Object-relational mapping / Extraction Tools 13)Inter process communication Collectives, point-to-point, publish-subscribe 14)Basic Programming model and runtime, SPMD, Streaming, MapReduce, MPI: 15)High level Programming: 16)Application and Analytics: 17)Workflow-Orchestration: Here are 17 functionalities. Technologies are presented in this order 4 Cross cutting at top 13 in order of layered diagram starting at bottom

3. Google Cloud DNS & Amazon Route 53 Google Cloud DNS – Authoritative DNS server available as a service in Google Cloud – The service is efficient, fault-tolerant and available globally – This service can be used by the user hosted services in Google Cloud or from third party applications – https://developers.google.com/cloud-dns/what-is-cloud-dns https://developers.google.com/cloud-dns/what-is-cloud-dns Amazon Route 53 – Authoritative DNS server available as a service in Amazon AWS – Provides a fault-tolerant, very fast DNS service. – Same as Google Cloud DNS this service can be used by the hosted services in Amazon Cloud or from third party applications – The service is available in all continents except Africa – http://aws.amazon.com/route53/ http://aws.amazon.com/route53/