High Performance Cyberinfrastructure Required for Data Intensive Scientific Research Invited Presentation National Science Foundation Advisory Committee.

Slides:

Advertisements

Similar presentations

-Grids and the OptIPuter Software Architecture Andrew A. Chien Director, Center for Networked Systems SAIC Chair Professor, Computer Science and Engineering.

Advertisements

OptIPuter Goal: Removing Bandwidth Barriers to e-Science ATLAS Sloan Digital Sky Survey LHC ALMA.

A New Global Research Platform – Dedicated 10Gbps Lightpaths Panel Symposium on How Will the U.S. Elections Change US-China Cooperation? Tsinghua University.

Three Disruptive Leadership Opportunities for Washington State to Live in the Future Keynote Talk Washington Innovation Summit: New Decade, New Partnerships,

Calit2 " Talk Nortel Visiting Team December 12, 2005 Dr. Larry Smarr Director, California Institute for Telecommunications and Information.

The Emerging Global Collaboratory for Microbial Metagenomics Researchers Invited Talk Delivered From Monash University MURPA Lecture Melbourne,

Calit2: Experiments in Living in the Virtual/Physical World Pat Ledden Memorial Luncheon Faculty Luncheon Seminar UC San Diego Faculty Club February 24,

Calit2: a SoCal UC Infrastructure for Innovation Welcoming Talk Visit to Calit2 by The Trusteeship April 24, 2010 Dr. Larry Smarr Director, California.

Advancing the Metagenomics Revolution Invited Talk Symposium #1816, Managing the Exaflood: Enhancing the Value of Networked Data for Science and Society.

Coupling Australias Researchers to the Global Innovation Economy Fourth Lecture in the Australian American Leadership Dialogue Scholar Tour Swinburne University.

Health Sciences Driving UCSD Research Cyberinfrastructure Invited Talk UCSD Health Sciences Faculty Council UC San Diego April 3, 2012 Dr. Larry Smarr.

High Performance Cyberinfrastructure Enabling Data-Driven Science Supporting Stem Cell Research Invited Presentation Sanford Consortium for Regenerative.

The Missing Link: Dedicated End-to-End 10Gbps Optical Lightpaths for Clusters, Grids, and Clouds Invited Keynote Presentation 11 th IEEE/ACM International.

“End-to-end Optical Fiber Cyberinfrastructure for Data-Intensive Research: Implications for Your Campus” Featured Speaker EDUCAUSE 2010 Anaheim Convention.

"Cyberinfrastructure for Environmental Observations" Invited Talk to Symposium on Science and Technology in GEOSS: The Role of Universities Hosted by

Sequencing Genomics: The New Big Data Driver IntermezzoTalk SURFnet7, Part of GigaPort3 Utrecht, Netherlands December 7, 2011 Dr. Larry Smarr Director,

A Campus-Scale High Performance Cyberinfrastructure is Required for Data-Intensive Research Seminar Presentation Princeton Institute for Computational.

Calit2: Past, Present, and Future University Librarians Advisory Board Luncheon Seminar UC San Diego Library January 4, 2012 Dr. Larry Smarr Director,

High Performance Cyberinfrastructure Enabling Data-Driven Science in the Biomedical Sciences Joint Presentation UCSD School of Medicine Research Council.

Creating High Performance Lambda Collaboratories" ONR Briefing ACCESS DC Arlington, VA March 25, 2005 Dr. Larry Smarr Director, California Institute for.

The Strongly Coupled LambdaCloud Tour TTI-Vanguard February 20, 2009 Dr. Larry Smarr Director, California Institute for Telecommunications.

Uses of the OptIPortal Presentation to the Minority Serving Institutions Cyberinfrastructure Empowerment Coalition June 10, 2010 Dr. Larry.

Calit2-Living in the Future " Keynote Sharecase 2006 University of California, San Diego March 29, 2006 Dr. Larry Smarr Director, California Institute.

Supercomputers and Supernetworks are Transforming Research Invited Talk Computing Research that Changed the World: Reflections and Perspectives Washington,

Bringing Mexico Into the Global LambdaGrid Dr. Larry Smarr Director, California Institute for Telecommunications and Information Technology Harry E. Gruber.

The OptIPlanet Collaboratory -- a Global CineGrid Testbed Invited Presentation CineGrid International Workshop 2008 December 8, 2008 Dr. Larry.

Introduction to the UCSD Division of Calit2" Calit2 Tour NextMed / MMVR20 UC San Diego February 20, 2013 Dr. Larry Smarr Director, California.

Creating a Community Cyberinfrastructure for Advanced Marine Microbial Ecology Research and Analysis (a.k.a. CAMERA) Invited Talk Honoring David Kingsbury.

High Performance Cyberinfrastructure Enables Data-Driven Science in the Globally Networked World Keynote Presentation Sequencing Data Storage and Management.

Cyberinfrastructure for Advanced Marine Microbial Ecology Research and Analysis (CAMERA) Invited Talk CONNECT Board Meeting La Jolla, CA April 26, 2006.

Overview of Photonics Research at Calit2: Scaling from Nanometers to the Earth UCSD-NICT Joint Symposium on Innovative Lightwave, Millimeter-Wave and THz.

High Performance Cyberinfrastructure Discovery Tools for Data Intensive Research Larry Smarr Prof. Computer Science and Engineering Director, Calit2 (UC.

Building a Global Collaboration System for Data-Intensive Discovery Distinguished Lecture Hawaii International Conference on System Sciences (HICSS-44)

Why Optical Networks Are Emerging as the 21 st Century Driver Scientific American, January 2001.

"The OptIPuter: an IP Over Lambda Testbed" Invited Talk NREN Workshop VII: Optical Network Testbeds (ONT) NASA Ames Research Center Mountain View, CA August.

The OptIPuter and Its Applications Invited Talk IEEE/LEOS Summer 2009 Topicals Meeting on Future Global Networks July 27, 2009 Dr. Larry Smarr Director,

Scaling-Up the BIRN Building on the BIRN Workshop National Institutes of Health Bethesda, MD March 22, 2004 Dr. Larry Smarr Director, California Institute.

AHM Overview OptIPuter Overview Third All Hands Meeting OptIPuter Project San Diego Supercomputer Center University of California, San Diego January 26,

Project StarGate An End-to-End 10Gbps HPC to User Cyberinfrastructure ANL * Calit2 * LBNL * NICS * ORNL * SDSC Report to the Dept. of Energy Advanced Scientific.

1 Cyberinfrastructure Framework for 21st Century Science & Engineering (CIF21) NSF-wide Cyberinfrastructure Vision People, Sustainability, Innovation,

A High-Performance Campus-Scale Cyberinfrastructure: The Technical, Political, and Economic Presentation by Larry Smarr to the NSF Campus Bridging Workshop.

HIPerSpace The Highly Interactive Parallelized Display Space.

“High Performance Cyberinfrastructure Enables Data-Driven Science in the Globally Networked World” Invited Speaker Grand Challenges in Data-Intensive Discovery.

“How LambdaGrids are Transforming Science" Keynote iGrid2005 La Jolla, CA September 29, 2005 Dr. Larry Smarr Director, California Institute.

Science and Cyberinfrastructure in the Data-Dominated Era Symposium #1610, How Computational Science Is Tackling the Grand Challenges Facing Science and.

Building a Community Cyberinfrastructure to Support Marine Microbial Ecology Metagenomics Center for Earth Observations and Applications Advisory Committee.

Source: Jim Dolgonas, CENIC CENIC is Removing the Inter-Campus Barriers in California ~ $14M Invested in Upgrade Now Campuses Need to Upgrade.

“An Integrated Science Cyberinfrastructure for Data-Intensive Research” Panel CISCO Executive Symposium San Diego, CA June 9, 2015 Dr. Larry Smarr Director,

Developing a North American Global LambdaGrid Dr. Larry Smarr Director, California Institute for Telecommunications and Information Technology Harry E.

Cal-(IT) 2 : A Public-Private Partnership in Southern California U.S. Business Council for Sustainable Development Year-End Meeting December 11, 2003 Institute.

Introduction to Calit2 Visit by NASA Ames February 29, 2008 Dr. Larry Smarr Director, California Institute for Telecommunications and Information Technology.

Innovative Research Alliances Invited Talk IUCRP Fellows Seminar UCSD La Jolla, CA July 10, 2006 Dr. Larry Smarr Director, California Institute for Telecommunications.

Using Photonics to Prototype the Research Campus Infrastructure of the Future: The UCSD Quartzite Project Philip Papadopoulos Larry Smarr Joseph Ford Shaya.

Building a Community Cyberinfrastructure to Support Marine Microbial Ecology Metagenomics Invited Talk Metagenomics 2006 UCSD La Jolla, CA October.

A High-Performance Campus-Scale Cyberinfrastructure For Effectively Bridging End-User Laboratories to Data-Intensive Sources Presentation by Larry Smarr.

Project GreenLight Overview Thomas DeFanti Full Research Scientist and Distinguished Professor Emeritus California Institute for Telecommunications and.

Ocean Sciences Cyberinfrastructure Futures Dr. Larry Smarr Director, California Institute for Telecommunications and Information Technologies Harry E.

The OptIPuter Project Tom DeFanti, Jason Leigh, Maxine Brown, Tom Moher, Oliver Yu, Bob Grossman, Luc Renambot Electronic Visualization Laboratory, Department.

“ Collaborations Between Calit2, SIO, and the Venter Institute—a Beginning " Talk to the UCSD Representative Assembly La Jolla, CA November 29, 2005 Dr.

“The UCSD Big Data Freeway System” Invited Short Talk Workshop on “Enriching Human Life and Society” UC San Diego February 6, 2014 Dr. Larry Smarr Director,

“ OptIPuter Year Five: From Research to Adoption " OptIPuter All Hands Meeting La Jolla, CA January 22, 2007 Dr. Larry Smarr Director, California.

Southern California Infrastructure Philip Papadopoulos Greg Hidley.

“Genomics: The CAMERA Project" Invited Talk 5 th Annual ON*VECTOR International Photonics Workshop UCSD February 28, 2006 Dr. Larry Smarr Director,

University of Illinois at Chicago Lambda Grids and The OptIPuter Tom DeFanti.

High Performance Cyberinfrastructure Discovery Tools for Data Intensive Research Larry Smarr Prof. Computer Science and Engineering Director, Calit2 (UC.

“OptIPuter: From the End User Lab to Global Digital Assets" Panel UC Research Cyberinfrastructure Meeting October 10, 2005 Dr. Larry Smarr.

“ Building an Information Infrastructure to Support Microbial Metagenomic Sciences " Presentation to the NBCR Research Advisory Committee UCSD La Jolla,

Lennart Johnsson Professor CSC Director, PDC

Project StarGate An End-to-End 10Gbps HPC to User Cyberinfrastructure ANL * Calit2 * LBNL * NICS * ORNL * SDSC Report to the Dept. of Energy Advanced.

The OptIPortal, a Scalable Visualization, Storage, and Computing Termination Device for High Bandwidth Campus Bridging Presentation by Larry Smarr to.

Presentation transcript:

High Performance Cyberinfrastructure Required for Data Intensive Scientific Research Invited Presentation National Science Foundation Advisory Committee on Cyberinfrastructure Arlington, VA June 8, 2011 Dr. Larry Smarr Director, California Institute for Telecommunications and Information Technology Harry E. Gruber Professor, Dept. of Computer Science and Engineering Jacobs School of Engineering, UCSD Follow me on Twitter: lsmarr 1

Large Data Challenge: Average Throughput to End User on Shared Internet is Mbps Transferring 1 TB: --50 Mbps = 2 Days --10 Gbps = 15 Minutes Tested January 2011

WAN Solution-Dedicated 10Gbps Lightpaths: Ties Together State & Regional Optical Networks Internet2 WaveCo Circuit Network Is Now Available

Visualization courtesy of Bob Patterson, NCSA. Created in Reykjavik, Iceland 2003 The Global Lambda Integrated Facility-- Creating a Planetary-Scale High Bandwidth Collaboratory Research Innovation Labs Linked by 10G Dedicated Lambdas

The OptIPuter Project: Creating High Resolution Portals Over Dedicated Optical Channels to Global Science Data Picture Source: Mark Ellisman, David Lee, Jason Leigh Calit2 (UCSD, UCI), SDSC, and UIC LeadsLarry Smarr PI Univ. Partners: NCSA, USC, SDSU, NW, TA&M, UvA, SARA, KISTI, AIST Industry: IBM, Sun, Telcordia, Chiaro, Calient, Glimmerglass, Lucent Scalable Adaptive Graphics Environment (SAGE) OptIPortal

OptIPuter Software Architecture--a Service-Oriented Architecture Integrating Lambdas Into the Grid GTPXCPUDT LambdaStream CEPRBUDP DVC Configuration Distributed Virtual Computer (DVC) API DVC Runtime Library Globus XIO GRAM GSI Distributed Applications/ Web Services Telescience Vol-a-Tile SAGEJuxtaView Visualization Data Services LambdaRAM DVC Services DVC Core Services DVC Job Scheduling DVC Communication Resource Identify/Acquire Namespace Management Security Management High Speed Communication Storage Services IP Lambdas Discovery and Control PIN/PDC RobuStore

OptIPortals Scale to 1/3 Billion Pixels Enabling Viewing of Very Large Images or Many Simultaneous Images Spitzer Space Telescope (Infrared) Source: Falko Kuester, NASA Earth Satellite Images Bushfires October 2007 San Diego

MITs Ed DeLong and Darwin Project Team Using OptIPortal to Analyze 10km Ocean Microbial Simulation Cross-Disciplinary Research at MIT, Connecting Systems Biology, Microbial Ecology, Global Biogeochemical Cycles and Climate

AESOP Display built by Calit2 for KAUST-- King Abdullah University of Science & Technology 40-Tile 46 Diagonal Narrow-Bezel AESOP Display at KAUST Running CGLX

Sharp Corp. Has Built an Immersive Room With Nearly Seamless LCDs LCDs for the 5D Miracle Tour at the Hui Ten Bosch Theme Park in Nagasaki Opened April 29, 2011

The Latest OptIPuter Innovation: Quickly Deployable Nearly Seamless OptIPortables 45 minute setup, 15 minute tear-down with two people (possible with one) Shipping Case Image From the Calit2 KAUST Lab

3D Stereo Head Tracked OptIPortal: NexCAVE Source: Tom DeFanti, Array of JVC HDTV 3D LCD Screens KAUST NexCAVE = 22.5MPixels

High Definition Video Connected OptIPortals: Virtual Working Spaces for Data Intensive Research Source: Falko Kuester, Kai Doerr Calit2; Michael Sims, Larry Edwards, Estelle Dodson NASA 10Gbps Link to NASA Ames Lunar Science Institute, Mountain View, CA NASA Supports Two Virtual Institutes LifeSize HD 2010

OptIPuter Persistent Infrastructure Enables Calit2 and U Washington CAMERA Collaboratory Ginger Armbrusts Diatoms: Micrographs, Chromosomes, Genetic Assembly Photo Credit: Alan Decker Feb. 29, 2008 iHDTV: 1500 Mbits/sec Calit2 to UW Research Channel Over NLR

NICS ORNL NSF TeraGrid Kraken Cray XT5 8,256 Compute Nodes 99,072 Compute Cores 129 TB RAM simulation Argonne NL DOE Eureka 100 Dual Quad Core Xeon Servers 200 NVIDIA Quadro FX GPUs in 50 Quadro Plex S4 1U enclosures 3.2 TB RAM rendering SDSC Calit2/SDSC OptIPortal (2560 x 1600 pixel) LCD panels 10 NVIDIA Quadro FX 4600 graphics cards > 80 megapixels 10 Gb/s network throughout visualization ESnet 10 Gb/s fiber optic network *ANL * Calit2 * LBNL * NICS * ORNL * SDSC Using Supernetworks to Couple End Users OptIPortal to Remote Supercomputers and Visualization Servers Source: Mike Norman, Rick Wagner, SDSC Real-Time Interactive Volume Rendering Streamed from ANL to SDSC

OOI CI Physical Network Implementation Source: John Orcutt, Matthew Arrott, SIO/Calit2 OOI CI is Built on NLR/I2 Optical Infrastructure

Next Great Planetary Instrument: The Square Kilometer Array Requires Dedicated Fiber Transfers Of 1 TByte Images World-wide Will Be Needed Every Minute! Currently Competing Between Australia and S. Africa

Campus Bridging: UCSD is Creating a Campus-Scale High Performance CI for Data-Intensive Research Focus on Data-Intensive Cyberinfrastructure research.ucsd.edu/documents/rcidt/RCIDTReportFinal2009.pdf No Data Bottlenecks --Design for Gigabit/s Data Flows April 2009 Report of the UCSD Research Cyberinfrastructure Design Team

Source: Jim Dolgonas, CENIC Campus Preparations Needed to Accept CENIC CalREN Handoff to Campus

Current UCSD Prototype Optical Core: Bridging End-Users to CENIC L1, L2, L3 Services Source: Phil Papadopoulos, SDSC/Calit2 (Quartzite PI, OptIPuter co-PI) Quartzite Network MRI #CNS ; OptIPuter #ANI Lucent Glimmerglass Force10 Enpoints: >= 60 endpoints at 10 GigE >= 32 Packet switched >= 32 Switched wavelengths >= 300 Connected endpoints Approximately 0.5 TBit/s Arrive at the Optical Center of Campus. Switching is a Hybrid of: Packet, Lambda, Circuit -- OOO and Packet Switches

Calit2 Sunlight Optical Exchange Contains Quartzite Maxine Brown, EVL, UIC OptIPuter Project Manager

The GreenLight Project: Instrumenting the Energy Cost of Data-Intensive Science Focus on 5 Data-Intensive Communities: –Metagenomics –Ocean Observing –Microscopy –Bioinformatics –Digital Media Measure, Monitor, & Web Publish Real-Time Sensor Outputs –Via Service-oriented Architectures –Allow Researchers Anywhere To Study Computing Energy Cost –Connected with 10Gbps Lambdas to End Users and SDSC Developing Middleware that Automates Optimal Choice of Compute/RAM Power Strategies for Desired Greenness Data Center for UCSD School of Medicine Illumina Next Gen Sequencer Storage & Processing Source: Tom DeFanti, Calit2; GreenLight PI

UCSD Campus Investment in Fiber Enables Consolidation of Energy Efficient Computing & Storage Source: Philip Papadopoulos, SDSC, UCSD OptIPortal Tiled Display Wall Campus Lab Cluster Digital Data Collections N x 10Gb/s Triton – Petascale Data Analysis Gordon – HPD System Cluster Condo WAN 10Gb: CENIC, NLR, I2 Scientific Instruments DataOasis (Central) Storage GreenLight Data Center

SDSC Data Oasis – 3 Different Types of Storage HPC Storage (Lustre-Based PFS) Purpose: Transient Storage to Support HPC, HPD, and Visualization Access Mechanisms: Lustre Parallel File System Client Project (Traditional File Server) Storage Purpose: Typical Project / User Storage Needs Access Mechanisms: NFS/CIFS Network Drives Cloud Storage Purpose: Long-Term Storage of Data that will be Infrequently Accessed Access Mechanisms: S3 interfaces, DropBox-esq web interface, CommVault Coupled with 10G Lambda to Amazon Over CENIC

Rapid Evolution of 10GbE Port Prices Makes Campus-Scale 10Gbps CI Affordable $80K/port Chiaro (60 Max) $ 5K Force 10 (40 max) $ 500 Arista 48 ports ~$1000 (300+ Max) $ 400 Arista 48 ports Port Pricing is Falling Density is Rising – Dramatically Cost of 10GbE Approaching Cluster HPC Interconnects Source: Philip Papadopoulos, SDSC/Calit2

Arista Enables SDSCs Massive Parallel 10G Switched Data Analysis Resource 2 12 OptIPuter 32 Co-Lo UCSD RCI CENIC/ NLR Trestles 100 TF 8 Dash 128 Gordon Oasis Procurement (RFP) Phase0: > 8GB/s Sustained Today Phase I: > 50 GB/sec for Lustre (May 2011) :Phase II: >100 GB/s (Feb 2012) Source: Philip Papadopoulos, SDSC/Calit2 Triton 32 Radical Change Enabled by Arista G Switch G Capable 8 Existing Commodity Storage 1/3 PB 2000 TB > 50 GB/s 10Gbps

OptIPlanet Collaboratory: Enabled by 10Gbps End-to-End Lightpaths National LambdaRail Campus Optical Switch Data Repositories & Clusters HPC HD/4k Video Repositories End User OptIPortal 10G Lightpaths HD/4k Live Video Local or Remote Instruments

You Can Download This Presentation at lsmarr.calit2.net