1 Earthquake Polar and Sensor Grids Community Grids Laboratory November 20 2008 Geoffrey Fox Community Grids Laboratory, School of informatics Indiana.

Slides:



Advertisements
Similar presentations
Architecture and Measured Characteristics of a Cloud Based Internet of Things May 22, 2012 The 2012 International Conference.
Advertisements

A CSEL presentation based on I. Foster, Z. Yong, I. Raicu, and S. Lu, "Cloud Computing and Grid Computing 360-Degree Compared," in Grid Computing Environments.
Reusable Components for Grid Computing Portals Marlon Pierce Community Grids Lab Indiana University.
INTRODUCTION TO CLOUD COMPUTING CS 595 LECTURE 6 2/13/2015.
Clouds from FutureGrid’s Perspective April Geoffrey Fox Director, Digital Science Center, Pervasive.
1 Web 2.0 and Grids March Geoffrey Fox Computer Science, Informatics, Physics Pervasive Technology Laboratories Indiana University Bloomington IN.
1 Overview of Cyberinfrastructure and the Breadth of Its Application Geoffrey Fox Computer Science, Informatics, Physics Chair Informatics Department Director.
Building Science Gateways Marlon Pierce Community Grids Laboratory Indiana University.
Public cloud definition Public cloud is a cloud in which Cloud infrastructure is available to the general public. Public cloud define cloud computing.
Indiana University QuakeSim Activities Marlon Pierce, Geoffrey Fox, Xiaoming Gao, Jun Ji, Chao Sun.
1 Clouds and Sensor Grids CTS2009 Conference May Alex Ho Anabas Inc. Geoffrey Fox Computer Science, Informatics, Physics Chair Informatics Department.
Student Visits August Geoffrey Fox
AN INTRODUCTION TO CLOUD COMPUTING Web, as a Platform…
1 Multicore and Cloud Futures CCGSC September Geoffrey Fox Community Grids Laboratory, School of informatics Indiana University
M.A.Doman Model for enabling the delivery of computing as a SERVICE.
Cloud computing Tahani aljehani.
INTRODUCTION TO CLOUD COMPUTING Cs 595 Lecture 5 2/11/2015.
SALSASALSASALSASALSA Digital Science Center June 25, 2010, IIT Geoffrey Fox Judy Qiu School.
Tools for e-Research Mat Wyatt. 2 e-Research Sensor nets data compute… Models/ software/ workflows colleagues instruments.
For more notes and topics visit:
A Brief Overview by Aditya Dutt March 18 th ’ Aditya Inc.
Big Data and Clouds: Challenges and Opportunities NIST January Geoffrey Fox
1 1 Hybrid Cloud Solutions (Private with Public Burst) Accelerate and Orchestrate Enterprise Applications.
Cloud computing is the use of computing resources (hardware and software) that are delivered as a service over the Internet. Cloud is the metaphor for.
SALSASALSASALSASALSA AOGS, Singapore, August 11-14, 2009 Geoffrey Fox 1,2 and Marlon Pierce 1
GIS and Cloud Computing. Flickr  Upload and manage your photos online  Share your photos with your family and friends  Post your photos everywhere.
Cloud Computing. What is Cloud Computing? Cloud computing is a model for enabling convenient, on-demand network access to a shared pool of configurable.
Geographic Information Systems Cloud GIS. ► The use of computing resources (hardware and software) that are delivered as a service over the Internet ►
PolarGrid Geoffrey Fox (PI) Indiana University Associate Dean for Graduate Studies and Research, School of Informatics and Computing, Indiana University.
Software Architecture
Cloud Architecture for Earthquake Science 7 th ACES International Workshop 6th October 2010 Grand Park Otaru Otaru Japan Geoffrey Fox
M.A.Doman Short video intro Model for enabling the delivery of computing as a SERVICE.
OpenQuake Infomall ACES Meeting Maui May Geoffrey Fox
IU QuakeSim/E-DECIDER Effort. QuakeSim Accomplishments (1) Deployed, improved many QuakeSim gadgets for standalone integration into QuakeSim.org – Disloc,
Grids and Portals for VLAB Marlon Pierce Community Grids Lab Indiana University.
FutureGrid Connection to Comet Testbed and On Ramp as a Service Geoffrey Fox Indiana University Infra structure.
SBIR Final Meeting Collaboration Sensor Grid and Grids of Grids Information Management Anabas July 8, 2008.
GEM Portal and SERVOGrid for Earthquake Science PTLIU Laboratory for Community Grids Geoffrey Fox, Marlon Pierce Computer Science, Informatics, Physics.
Building Effective CyberGIS: FutureGrid Marlon Pierce, Geoffrey Fox Indiana University.
SBIR Final Meeting Collaboration Sensor Grid and Grids of Grids Information Management Anabas July 8, 2008.
Grid Architecture William E. Johnston Lawrence Berkeley National Lab and NASA Ames Research Center (These slides are available at grid.lbl.gov/~wej/Grids)
SALSASALSASALSASALSA FutureGrid Venus-C June Geoffrey Fox
QuakeSim Project: Portals and Web Services for Geo-Sciences Marlon Pierce Indiana University
1 CReSIS Lawrence Kansas February Geoffrey Fox (PI) Computer Science, Informatics, Physics Chair Informatics Department Director Digital Science.
QuakeSim Project: Portals and Web Services for Geophysics Marlon Pierce Indiana University
ISERVOGrid Architecture Working Group Brisbane Australia June Geoffrey Fox Community Grids Lab Indiana University
QuakeSim Project: Portals and Web Services for Geo-Sciences Marlon Pierce Indiana University
Integrating Geographical Information Systems and Grid Applications Marlon Pierce Contributions: Ahmet Sayar,
November Geoffrey Fox Community Grids Lab Indiana University Net-Centric Sensor Grids.
QuakeSim Project: Portals and Web Services for Geo-Sciences Marlon Pierce Indiana University
Recipes for Success with Big Data using FutureGrid Cloudmesh SDSC Exhibit Booth New Orleans Convention Center November Geoffrey Fox, Gregor von.
SALSASALSASALSASALSA Digital Science Center February 12, 2010, Bloomington Geoffrey Fox Judy Qiu
Building Science Gateways Marlon Pierce Community Grids Laboratory Indiana University.
Big Data to Knowledge Panel SKG 2014 Institute of Computing Technology, Chinese Academy of Sciences, Beijing, China August Geoffrey Fox
Partnerships in Innovation: Serving a Networked Nation Grid Technologies: Foundations for Preservation Environments Portals for managing user interactions.
Windows Azure poDRw_Xi3Aw.
Directions in eScience Interoperability and Science Clouds June Interoperability in Action – Standards Implementation.
KAASHIV INFOTECH – A SOFTWARE CUM RESEARCH COMPANY IN ELECTRONICS, ELECTRICAL, CIVIL AND MECHANICAL AREAS
AMSA TO 4 Advanced Technology for Sensor Clouds 09 May 2012 Anabas Inc. Indiana University.
Unit 3 Virtualization.
Volunteer Computing for Science Gateways
Recap: introduction to e-science
Chapter 9 An Introduction and Overview of Cloud Computing
Brandon Hixon Jonathan Moore
Cyberinfrastructure and PolarGrid
Federated Hierarchical Filter Grids
PolarGrid and FutureGrid
Technology Futures and Lots of Sensor Grids
CReSIS Cyberinfrastructure
Technology Futures and Lots of Sensor Grids
Presentation transcript:

1 Earthquake Polar and Sensor Grids Community Grids Laboratory November Geoffrey Fox Community Grids Laboratory, School of informatics Indiana University

Portlets + Client Stubs DB Service JDBC DB Job Sub/Mon And File Services Operating and Queuing Systems WSDL Visualization Or Map Service DB, etc WSDL Host 1 (QT or GRWS) Host 2 (Comp Grid)Host 3 (GIS) SOAP/HTTP HTTP(S) WSDL

Daily RDAHMM Updates Daily analysis and event classification of GPS data from REASoN’s GRWS.

Integrating QuakeSim and UAVSAR July 29, 2008 M 5.4 Chino Hills Earthquake Used QuakeSim to model expected surface displacements from the event Passed on KML file to UAVSAR program/project Overlaid displacements with UAVSAR image Will continue to merge projects using the Los Angeles ShakeOut in mid–November as a testbed

QuakeSpace QuakeSim built using Web 2.0 and Cloud Technology Applications, Sensors, Data Repositories as Services Computing via Clouds Portals as Gadgets Metadata by tagging Data sharing as in YouTube Alerts by RSS Virtual Organizations via Social Networking Workflow by Mashups Performance by multicore Interfaces via iPhone, Android etc. 5

Enterprise ApproachWeb 2.0 Approach JSR 168 PortletsGadgets, Widgets Server-side integration and processing AJAX, client-side integration and processing, JavaScript SOAPRSS, Atom, JSON WSDLREST (GET, PUT, DELETE, POST) Portlet ContainersOpen Social Containers (Orkut, LinkedIn, Shindig); Facebook; StartPages User Centric GatewaysSocial Networking Portals Workflow managers (Taverna, Kepler, etc) Mash-ups Grid computing: Globus, condor, etcCloud computing: Amazon WS Suite, Xen Virtualization

Web 2.0 and Clouds Grids are less popular but most of what we did is reusable Clouds are designed heterogeneous (for functionality) scalable distributed systems whereas Grids integrate a priori heterogeneous (for politics) systems Clouds should be easier to use, cheaper, faster and scale to larger sizes than Grids Grids assume you can’t design system but rather must accept results of N independent supercomputer funding calls SaaS: Software as a Service IaaS: Infrastructure as a Service or HaaS: Hardware as a Service PaaS: Platform as a Service delivers SaaS on IaaS 7

8 Database SS SS S SS S Portal Sensor or Data Interchange Service Another Grid Raw Data  Data  Information  Knowledge  Wisdom  Decisions S S Another Service S Another Grid S SS Inter-Service Messages Storage Cloud Compute Cloud S S S S Filter Cloud Discovery Cloud Filter Service fs Filter Service fs Filter Service fs Filter Cloud Filter Service fs Information and Cyberinfrastructure Traditional Grid with exposed services

Core (eScience) Cloud Architecture PAAS Build VO Build Portal Gadgets Open Social Ringside Build Cloud Application Ruby on Rails Django(GAI) Move Service (from PC or internet to Cloud) Security Model VOMS “UNIX” Shib OpenID Deploy VM Workflow MapReduce Taverna BPEL F# DSS Windows Workflow DRYAD Sho Matlab Mathematica Scripted Math Libraries R, SCALAPACK High level Parallel “HPF”, PGAS, OpenMP Classic Compute File Database on a cloud EC2, S3, SimpleDB CloudDB Bigtable GFS (Hadoop) ? Lustre GPFS (low level ||) MPI CCR Linux Clusters ? Windows Cluster VM VM VM VM VM VM VM IAAS IAAS = Infrastructure As A Service PAAS = Platform As A Service

Deploying eScience Cloud Portal Archives Petaflop INTERNET Other clouds Virtual World Mobile Client PC Other nifty user interface Cloud extending Client ”simple compute” Modestly Parallel Portal Services Web 2.0 Data access analysis Specialized Machines Grape Road Runner FPGA, GPU … Satellites, Sensors, LHC, Microarray, Cell Phones Legacy Systems e.g. current TeraGrid Capacity Clouds (smallish clusters) Display “walls”

Sensors as a Service Similar architecture for a Web/Net/Grid of Mobile Phones Video cams Surveillance devices Smart Cities/Homes Environmental/Polar/Earthquake sensors Military sensors Similar System support for QuakeSim PolarGrid Command and Control Emergency Response Distance Education

12 PolarGrid (collaboration ECSU and Indiana) has remote and TeraGrid components

13 Polar Grid goes to Greenland Field 8 core server and ruggedized laptops with USB Storage Base camp 8-64 cores and 32 GB storage Power: Solar, Hotel Room, Generator Leaving IU for Greenland

14 PolarGrid (collaboration ECSU and Indiana) has remote and TeraGrid components PolarGrid August looking at bed 2500metres deep; real time analysis removes noise Retreat of Jakobshavn Glacier

15 Environmental Monitoring Sensor Grid at Clemson

16 Heterogeneous Sensor Grids Note sensors are any time dependent source of information and a fixed source of information is just a broken sensor SAR Satellites Environmental Monitors Nokia N800 pocket computers RFID tags and readers GPS Sensors Lego Robots including, accelerometer, gyroscope, compass, ultrasonic, temperature sensors RSS Feeds Wii remote sensor Audio/video: web-cams Presentation of teacher in distance education Text chats of students

17 Components of the Sensor Grid Lego Robot GPS Nokia N800 RFID Tag RFID Reader Laptop for PowerPoint 2 Robots used Wii remote

18 ANABAS

QuakeSim Grid of Grids with RDAHMM Filter (Compute) Grid