Presentation is loading. Please wait.

Presentation is loading. Please wait.

The OptIPuter Project: From the Grid to the LambdaGrid

Published byMeagan Norton Modified over 6 years ago

Similar presentations

Presentation on theme: "The OptIPuter Project: From the Grid to the LambdaGrid"— Presentation transcript:

1 The OptIPuter Project: From the Grid to the LambdaGrid
Invited Talk IEEE Orange County Computer Society Irvine, CA October 24, 2005 Dr. Larry Smarr Director, California Institute for Telecommunications and Information Technologies Harry E. Gruber Professor, Dept. of Computer Science and Engineering Jacobs School of Engineering, UCSD

2 Abstract While the Internet and the World Wide Web have become ubiquitous, their shared nature severely limits the bandwidth available to an individual user. However, during the last few years, a radical restructuring of optical networks supporting e-Science projects is beginning to occur around the world. Amazingly, scientists are now able to acquire the technological capability for private, high bandwidth light pipes (termed "lambdas") which create deterministic network connections coming right into their laboratories. These dedicated connections have a number of significant advantages over shared internet connections, including high bandwidth (10Gbps+), controlled performance (no jitter), lower cost per unit bandwidth, and security. By connecting scalable Linux clusters with these lambdas, one essentially creates supercomputers on the scale of a nation or even the planet Earth. One of the largest research projects on LambdaGrids is the NSF-funded OptIPuter ( which uses large medical and earth sciences imaging as application drivers. The OptIPuter has two regional cores, one in Southern California and one in Chicago, which has now been extended to Amsterdam. One aim of the OptIPuter project is to make interactive visualization of remote gigabyte data objects as easy as the Web makes manipulating megabyte-size data objects today. Providing access to individual user laboratories on our university campuses will require new planning for dedicated optical networks as part of the campus fiber build out.

3 The Grid Links People with Distributed Resources

4 Industry is Adopting Grid Technology

5 Major Challenge for Grid Enabled Science: Bandwidth Barriers Between User and Remote Resources
NIH’s Biomedical Informatics Research Network Average File Transfer ~10-50 Mbps Over Internet2 Backbone Part of the UCSD CRBS Center for Research on Biological Structure National Partnership for Advanced Computational Infrastructure

6 Solution: Individual 1 or 10Gbps Lightpaths -- “Lambdas on Demand”
(WDM) “Lambdas” Source: Steve Wallach, Chiaro Networks

7 National Lambda Rail (NLR) and TeraGrid Provides Cyberinfrastructure Backbone for U.S. Researchers
NSF’s TeraGrid Has 4 x 10Gb Lambda Backbone Seattle International Collaborators Portland Boise UC-TeraGrid UIC/NW-Starlight Ogden/ Salt Lake City Cleveland Chicago New York City San Francisco Denver Pittsburgh Washington, DC Kansas City Raleigh Albuquerque Tulsa Los Angeles Atlanta San Diego Phoenix Dallas Baton Rouge Las Cruces / El Paso Links Two Dozen State and Regional Optical Networks Jacksonville Pensacola DOE, NSF, & NASA Using NLR San Antonio Houston NLR 4 x 10Gb Lambdas Initially Capable of 40 x 10Gb wavelengths at Buildout

8 The Global Lambda Integrated Facility (GLIF) Creates MetaComputers on the Scale of Planet Earth
Many Countries are Interconnecting Optical Research Networks to form a Global SuperNetwork Created in Reykjavik, Iceland 2003 Created in Reykjavik, Iceland 2003

9 T H E G L O B A L L A M B D A I N T E G R A T E D F A C I L I T Y
The Networking Double Header of the Century Is Driven by LambdaGrid Applications Maxine Brown, Tom DeFanti, Co-Organizers i Grid 2oo5 T H E G L O B A L L A M B D A I N T E G R A T E D F A C I L I T Y September 26-30, 2005 University of California, San Diego California Institute for Telecommunications and Information Technology

10 Canadian-U.S. Collaboration
Lambdas Enable First Remote Interactive High Definition Video Exploration of Deep Sea Vents Canadian-U.S. Collaboration Source John Delaney & Deborah Kelley, UWash

11 The OptIPuter Project: Sun’s Slogan Realized…
Really “When the Network is as fast as the computer’s internal links, the machine disintegrates across the Net into a set of special purpose appliances” -Gilder Technology Report June 2000

12 The OptIPuter -- From the Grid to the LambdaGrid: High Resolution Portals to Global Science Data
300 MPixel Image! Source: Mark Ellisman, David Lee, Jason Leigh Green: Purkinje Cells Red: Glial Cells Light Blue: Nuclear DNA Calit2 (UCSD, UCI) and UIC Lead Campuses—Larry Smarr PI Partners: SDSC, USC, SDSU, NW, TA&M, UvA, SARA, KISTI, AIST

13 Scalable Displays Allow Both Global Content and Fine Detail
Source: Mark Ellisman, David Lee, Jason Leigh 30 MPixel SunScreen Display Driven by a 20-node Sun Opteron Visualization Cluster

14 Allows for Interactive Zooming from Cerebellum to Individual Neurons
Source: Mark Ellisman, David Lee, Jason Leigh

15 Calit2 Is Applying OptIPuter Technologies to Post-Hurricane Recovery
Working with NASA, USGS, NOAA, NIEHS, EPA, SDSU, SDSC, Duke, …

16 Calit2 @ UCI Has the Largest Tiled Display Wall
Apple Tiled Display Wall Driven by 25 Dual-Processor G5s 50 Apple 30” Cinema Displays 200 Million Pixels of Viewing Real Estate! HDTV Digital Cameras Digital Cinema Data—One Foot Resolution USGS Images of La Jolla, CA Source: Falko Kuester, NSF Infrastructure Grant

17 The Great Wall of TV…

18 OptIPuter Research Enables Massive Data Mining
Developing New Data Mining Algorithms for Massive Scientific Data Sets, Using Optiputer for High-Speed Remote Data Streaming, & Multi-Tile Display Walls for Visualization Source: Padhraic Smyth, UCI

19 Visualization of Brain Image Data
Data Streaming in Over OptIPuter Links from Remote Sites Research Challenge: How to Effectively Combine: Computational Power, Pixel Real-estate, Human Visual Capabilities To Develop New Paradigms for Exploratory Data Analysis Brain Imaging (Schizophrenia) Kuester in Collaboration with the UCI Brain Imaging Center (BIC) and BIRN Source: Padhraic Smyth, Falko Kuester, UCI

20 Variations of the Earth Surface Temperature Over One Thousand Years—THE Challenge of the 21st Century Source: Charlie Zender, UCI

21 Applying OptIPuter Technologies to Support Global Change Research
UCI Earth System Science Modeling Facility (ESMF) NSF’s CISE Science and Engineering Informatics Program Funded ESMF and Calit2 to Improve Distributed Data Reduction & Analysis Calit2 and UCI is Adding ESMF to the OptIPuter Testbed Link to HiPerWall The Resulting Scientific Data LambdaGrid Toolkit will Support the Next Intergovernmental Panel on Climate Change (IPCC) Assessment Report Source: Charlie Zender, UCI

22 HIPerWall & The Grid Allows High Performance Linkages to National Digital Assets

23 UCI is Adding Real Time Control to the Calit2 OptIPuter Testbed
Application Development Experiments Requires Institutional Collaboration An Experiment for Remote Access and Control within the UCI Campus A Step Toward Preparation of an Experiment for Remote Access and Control of Electron Microscopes at UCSD-NCMIR CalREN-HPR Chiaro Enstara UCSD Microscope (NCMIR) 10 Gb 1 Gb x2 CalREN-XD UC Irvine Campus Backbone SPDS Cluster HIPerWall Storage & Rendering UCI DREAM Lab Source: Steve Jenks, Kane Kim, Falko Kuester UCI

24 Lays Technical Basis for Global Digital Cinema
First Trans-Pacific Super High Definition Telepresence Meeting in New Calit2 Digital Cinema Auditorium Lays Technical Basis for Global Digital Cinema Sony NTT SGI Keio University President Anzai UCSD Chancellor Fox

25 SAGE Developed Under Jason Leigh, EVL Source: David Lee, NCMIR, UCSD
OptIPuter Scalable Adaptive Graphics Environment (SAGE) Allows Integration of HD Streams SAGE Developed Under Jason Leigh, EVL HD Video from BIRN Trailer Macro View of Montage Data Micro View of Montage Data Live Streaming Video of the RTS-2000 Microscope HD Video from the RTS Microscope Room LambdaCam Used to Capture the Tiled Display on a Web Browser Source: David Lee, NCMIR, UCSD

26 Extending Telepresence with Remote Interactive Analysis of Data Over NLR
August 8, 2005 25 Miles Venter Institute SIO/UCSD OptIPuter Visualized Data NASA Goddard HDTV Over Lambda

27 Learning to Live on Lambdas
Two New Calit2 Buildings Will Provide a Persistent Collaboration “Living Laboratory” Bioengineering Over 1000 Researchers in Two Buildings Linked via Dedicated Optical Networks International Conferences and Testbeds New Laboratory Facilities Virtual Reality, Digital Cinema, HDTV Nanotech, BioMEMS, Chips, Radio, Photonics, Grid, Data, Applications UC Irvine UC San Diego Learning to Live on Lambdas

28 The OptIPuter Enabled Collaboratory: Remote Researchers Jointly Exploring Complex Data
UCI OptIPuter will Connect Falko Kuester’s 200M-Pixel Wall and the 30M-Pixel Display at UCSD Ellisman’s BIRN Laboratories With Shared Fast Deep Storage “SunScreen” Run by Sun Opteron Cluster UCSD

Download ppt "The OptIPuter Project: From the Grid to the LambdaGrid"

Similar presentations

-Grids and the OptIPuter Software Architecture Andrew A. Chien Director, Center for Networked Systems SAIC Chair Professor, Computer Science and Engineering.

-Grids and the OptIPuter Software Architecture Andrew A. Chien Director, Center for Networked Systems SAIC Chair Professor, Computer Science and Engineering.
OptIPuter Goal: Removing Bandwidth Barriers to e-Science ATLAS Sloan Digital Sky Survey LHC ALMA.

OptIPuter Goal: Removing Bandwidth Barriers to e-Science ATLAS Sloan Digital Sky Survey LHC ALMA.
Calit2 The First Five Years Invited Talk UC Regents San Francisco, CA July 19, 2006 Dr. Larry Smarr Director, California Institute for Telecommunications.

Calit2 The First Five Years Invited Talk UC Regents San Francisco, CA July 19, 2006 Dr. Larry Smarr Director, California Institute for Telecommunications.
Calit2 Talk Nortel Visiting Team December 12, 2005 Dr. Larry Smarr Director, California Institute for Telecommunications and Information.

Calit2 " Talk Nortel Visiting Team December 12, 2005 Dr. Larry Smarr Director, California Institute for Telecommunications and Information.
The Coming Revolution in Environmental Awareness

The Coming Revolution in Environmental Awareness
Cyberinfrastructure for Environmental Observations Invited Talk to Symposium on Science and Technology in GEOSS: The Role of Universities Hosted by

"Cyberinfrastructure for Environmental Observations" Invited Talk to Symposium on Science and Technology in GEOSS: The Role of Universities Hosted by
Creating High Performance Lambda Collaboratories ONR Briefing ACCESS DC Arlington, VA March 25, 2005 Dr. Larry Smarr Director, California Institute for.

Creating High Performance Lambda Collaboratories" ONR Briefing ACCESS DC Arlington, VA March 25, 2005 Dr. Larry Smarr Director, California Institute for.
Calit2-Living in the Future Keynote Sharecase 2006 University of California, San Diego March 29, 2006 Dr. Larry Smarr Director, California Institute.

Calit2-Living in the Future " Keynote Sharecase 2006 University of California, San Diego March 29, 2006 Dr. Larry Smarr Director, California Institute.
Bringing Mexico Into the Global LambdaGrid Dr. Larry Smarr Director, California Institute for Telecommunications and Information Technology Harry E. Gruber.

Bringing Mexico Into the Global LambdaGrid Dr. Larry Smarr Director, California Institute for Telecommunications and Information Technology Harry E. Gruber.
High Resolution Multimedia in a Ultra Bandwidth World After Dinner Talk IEEE ISM2005 Irvine, CA December 13, 2005 Dr. Larry Smarr Director, California.

High Resolution Multimedia in a Ultra Bandwidth World After Dinner Talk IEEE ISM2005 Irvine, CA December 13, 2005 Dr. Larry Smarr Director, California.
How Fiber Optics are Transforming our World Invited Talk Telluride Tech Festival Telluride, CO August 13, 2005 Dr. Larry Smarr Director, California Institute.

How Fiber Optics are Transforming our World" Invited Talk Telluride Tech Festival Telluride, CO August 13, 2005 Dr. Larry Smarr Director, California Institute.
A Pioneer Speaks – A History & Future of Telepresence Invited Talk Telepresence World San Diego University June 4, 2007 Dr. Larry Smarr Director, California.

A Pioneer Speaks – A History & Future of Telepresence Invited Talk Telepresence World San Diego University June 4, 2007 Dr. Larry Smarr Director, California.
1 The Importance of Large-Scale Computer Science Research Efforts Talk at Public Seminar on Large-Scale NSF Research Efforts for the Future Computer Museum.

1 The Importance of Large-Scale Computer Science Research Efforts Talk at Public Seminar on Large-Scale NSF Research Efforts for the Future Computer Museum.
Why Optical Networks Are Emerging as the 21 st Century Driver Scientific American, January 2001.

Why Optical Networks Are Emerging as the 21 st Century Driver Scientific American, January 2001.
The OptIPuter: an IP Over Lambda Testbed Invited Talk NREN Workshop VII: Optical Network Testbeds (ONT) NASA Ames Research Center Mountain View, CA August.

"The OptIPuter: an IP Over Lambda Testbed" Invited Talk NREN Workshop VII: Optical Network Testbeds (ONT) NASA Ames Research Center Mountain View, CA August.
The First Year of Cal-(IT) 2 Report to The University of California Regents UCSF San Francisco, CA March 13, 2002 Dr. Larry Smarr Director, California.

The First Year of Cal-(IT) 2 Report to The University of California Regents UCSF San Francisco, CA March 13, 2002 Dr. Larry Smarr Director, California.
Scaling-Up the BIRN Building on the BIRN Workshop National Institutes of Health Bethesda, MD March 22, 2004 Dr. Larry Smarr Director, California Institute.

Scaling-Up the BIRN Building on the BIRN Workshop National Institutes of Health Bethesda, MD March 22, 2004 Dr. Larry Smarr Director, California Institute.
AHM Overview OptIPuter Overview Third All Hands Meeting OptIPuter Project San Diego Supercomputer Center University of California, San Diego January 26,

AHM Overview OptIPuter Overview Third All Hands Meeting OptIPuter Project San Diego Supercomputer Center University of California, San Diego January 26,
Genomics at the Speed of Light: Understanding the Living Ocean The Gordon and Betty Moore Foundation 2nd Annual Marine Microbiology Investigator Symposium.

Genomics at the Speed of Light: Understanding the Living Ocean The Gordon and Betty Moore Foundation 2nd Annual Marine Microbiology Investigator Symposium.
Microbial Metagenomics and Human Health Invited Talk Health Sciences Advisory Board School of Medicine University of California, San Diego May 8, 2006.

Microbial Metagenomics and Human Health Invited Talk Health Sciences Advisory Board School of Medicine University of California, San Diego May 8, 2006.

Similar presentations

Ads by Google