Using Photonics to Prototype the Research Campus Infrastructure of the Future: The UCSD Quartzite Project Philip Papadopoulos Larry Smarr Joseph Ford Shaya.

Slides:

Advertisements

Similar presentations

Calit2 " Talk Nortel Visiting Team December 12, 2005 Dr. Larry Smarr Director, California Institute for Telecommunications and Information.

Advertisements

Health Sciences Driving UCSD Research Cyberinfrastructure Invited Talk UCSD Health Sciences Faculty Council UC San Diego April 3, 2012 Dr. Larry Smarr.

High Performance Cyberinfrastructure Enabling Data-Driven Science Supporting Stem Cell Research Invited Presentation Sanford Consortium for Regenerative.

Sequencing Genomics: The New Big Data Driver IntermezzoTalk SURFnet7, Part of GigaPort3 Utrecht, Netherlands December 7, 2011 Dr. Larry Smarr Director,

High Performance Cyberinfrastructure Enabling Data-Driven Science in the Biomedical Sciences Joint Presentation UCSD School of Medicine Research Council.

The Strongly Coupled LambdaCloud Tour TTI-Vanguard February 20, 2009 Dr. Larry Smarr Director, California Institute for Telecommunications.

Calit2-Living in the Future " Keynote Sharecase 2006 University of California, San Diego March 29, 2006 Dr. Larry Smarr Director, California Institute.

Calit2s Program in Nano-science, Nano-engineering, and Nano-medicine Invited Talk Review of Nano-cancer project April 11, 2006 Dr. Larry Smarr Director,

High Performance Cyberinfrastructure Enables Data-Driven Science in the Globally Networked World Keynote Presentation Sequencing Data Storage and Management.

Overview of Photonics Research at Calit2: Scaling from Nanometers to the Earth UCSD-NICT Joint Symposium on Innovative Lightwave, Millimeter-Wave and THz.

High Performance Cyberinfrastructure Discovery Tools for Data Intensive Research Larry Smarr Prof. Computer Science and Engineering Director, Calit2 (UC.

Why Optical Networks Are Emerging as the 21 st Century Driver Scientific American, January 2001.

“A California-Wide Cyberinfrastructure for Data-Intensive Research” Invited Presentation CENIC Annual Retreat Santa Rosa, CA July 22, 2014 Dr. Larry Smarr.

PRISM: High-Capacity Networks that Augment Campus’ General Utility Production Infrastructure Philip Papadopoulos, PhD. Calit2 and SDSC.

Joint Techs Workshop, 12 Feb 2007, Minneapolis1 Retrofitting the CalREN Optical Network for Hybrid Services ken lindahl Chair, CENIC High Performance Research.

A High-Performance Campus-Scale Cyberinfrastructure: The Technical, Political, and Economic Presentation by Larry Smarr to the NSF Campus Bridging Workshop.

Genomics at the Speed of Light: Understanding the Living Ocean The Gordon and Betty Moore Foundation 2nd Annual Marine Microbiology Investigator Symposium.

Cyber UC San Diego Elazar C. Harel May 14, 2008.

Cyberinfrastructure for Advanced Marine Microbial Ecology Research and Analysis (CAMERA) Invited Keynote Annual Meeting CENIC 2006 Oakland, CA March 13,

Project GreenLight Measuring the Energy Cost of Applications, Algorithms, and Architectures CENIC Awards Presentation Long Beach, CA March 10, 2009 Larry.

RIT Campus Data Network. General Network Statistics Over 23,000 wired outlets Over 14,500 active switched ethernet ports > 250 network closets > 1,000.

“High Performance Cyberinfrastructure Enables Data-Driven Science in the Globally Networked World” Invited Speaker Grand Challenges in Data-Intensive Discovery.

Restructuring Campus CI -- UCSD-A LambdaCampus Research CI and the Quest for Zero Carbon ICT Invited Presentation to the Campus Cyberinfrastructure.

The Corporation for Education Network Initiatives in California CENIC Valley View Ave. La Mirada, CA 90638(714)

University of California Applications and Thought-Starters C L A S S R O O M IN-BETWEEN SPACES HOUSING & DINING LIBRARY OFFICES MEDICAL CENTERS CLICK TO.

“ OptIPuter Tech Transfer to the Broader e-Science and HPC Communities " OptIPuter All Hands Meeting La Jolla, CA December 20, 2006 Dr. Larry.

Cal-(IT) 2 : A Public-Private Partnership in Southern California Tech Coast Angels Invited Talk November 11, 2003 Faculty Club, UC San Diego Dr. Larry.

The OptIPlanet Collaboratory Invited Presentation September 16, 2008 Dr. Larry Smarr Director, California Institute for Telecommunications.

A PRAGMA-OptIPlanet Collaboratory Partnership Keynote Pacific Rim Applications and Grid Middleware Assembly (PRAGMA) 14 Taichung, Taiwan March 11, 2008.

SoCal Infrastructure OptIPuter Southern California Network Infrastructure Philip Papadopoulos OptIPuter Co-PI University of California, San Diego Program.

Calit2 Projects in Cyberinfrastructure Welcome Talk to the Minority-Serving Institutions Cyberinfrastructure Institute June 28, 2006 Dr. Larry.

Physical Buildout of the OptIPuter at UCSD. What Speeds and Feeds Have Been Deployed Over the Last 10 Years Scientific American, January 2001 Number of.

OptIPuter Physical Testbed at UCSD, Extensions Beyond the Campus Border Philip Papadopoulos and Cast of Real Workers: Greg Hidley Aaron Chin Sean O’Connell.

The OptIPlanet Collaboratory Supporting Researchers Worldwide Talk Australian American Leadership Dialogue January 15, 2008 Dr. Larry Smarr.

The Emergence of the Digitally Connected World Invited Talk California Clean Energy Roundtable Calit2 University of California, San Diego April 10, 2008.

Why Optical Networks Will Become the 21 st Century Driver Scientific American, January 2001 Number of Years Performance per Dollar Spent Data Storage.

Source: Jim Dolgonas, CENIC CENIC is Removing the Inter-Campus Barriers in California ~ $14M Invested in Upgrade Now Campuses Need to Upgrade.

“An Integrated Science Cyberinfrastructure for Data-Intensive Research” Panel CISCO Executive Symposium San Diego, CA June 9, 2015 Dr. Larry Smarr Director,

“Creating a High Performance Cyberinfrastructure to Support Analysis of Illumina Metagenomic Data” DNA Day Department of Computer Science and Engineering.

Developing a North American Global LambdaGrid Dr. Larry Smarr Director, California Institute for Telecommunications and Information Technology Harry E.

“ High Performance Collaboration – The Jump to Light Speed " Talk to A Visiting Team from Intel June 25, 2006 Dr. Larry Smarr Director, California.

Cal-(IT) 2 : A Public-Private Partnership in Southern California U.S. Business Council for Sustainable Development Year-End Meeting December 11, 2003 Institute.

Chiaro’s Enstara™ Summary Scalable Capacity –6 Tb/S Initial Capacity –GigE  OC-192 Interfaces –“Soft” Forwarding Plane With Network Processors For Maximum.

Introduction to Calit2 Visit by NASA Ames February 29, 2008 Dr. Larry Smarr Director, California Institute for Telecommunications and Information Technology.

Chicago/National/International OptIPuter Infrastructure Tom DeFanti OptIPuter Co-PI Distinguished Professor of Computer Science Director, Electronic Visualization.

Innovative Research Alliances Invited Talk IUCRP Fellows Seminar UCSD La Jolla, CA July 10, 2006 Dr. Larry Smarr Director, California Institute for Telecommunications.

A Wide Range of Scientific Disciplines Will Require a Common Infrastructure Example--Two e-Science Grand Challenges –NSF’s EarthScope—US Array –NIH’s Biomedical.

Copyright 2004 National LambdaRail, Inc N ational L ambda R ail Update 9/28/2004 Debbie Montano Director, Development & Operations

SoCal Infrastructure OptIPuter Southern California Network Infrastructure Philip Papadopoulos OptIPuter Co-PI University of California, San Diego Program.

A High-Performance Campus-Scale Cyberinfrastructure For Effectively Bridging End-User Laboratories to Data-Intensive Sources Presentation by Larry Smarr.

“Cal-(IT)2 Projects with Sun Microsystems” Invited Talk at the Sun Microsystems Booth Supercomputing 2004 Pittsburgh, PA November 9, 2004 Dr. Larry Smarr.

“ Calit2-Living in the Future " Briefing The Future in Review (FiRe) 2006 Conference University of California, San Diego May 15, 2006 Dr. Larry Smarr Director,

Project GreenLight Overview Thomas DeFanti Full Research Scientist and Distinguished Professor Emeritus California Institute for Telecommunications and.

1 How High Performance Ethernet Plays in RONs, GigaPOPs & Grids Internet2 Member Meeting Sept 20,

Larry Smarr Professor, Computer Science, UCSD Director, Calit2 “Calit2-a Persistent UCSD/UCI Framework for Collaboration"

The OptIPuter Project Tom DeFanti, Jason Leigh, Maxine Brown, Tom Moher, Oliver Yu, Bob Grossman, Luc Renambot Electronic Visualization Laboratory, Department.

OptIPuter Networks Overview of Initial Stages to Include OptIPuter Nodes OptIPuter Networks OptIPuter Expansion OPtIPuter All Hands Meeting February 6-7.

The PRPv1 Architecture Model Panel Presentation Building the Pacific Research Platform Qualcomm Institute, Calit2 UC San Diego October 16, 2015.

“The Pacific Research Platform: a Science-Driven Big-Data Freeway System.” Big Data for Information and Communications Technologies Panel Presentation.

“ Ultra-Broadband and Peta-Scale Collaboration Opportunities Between UC and Canada Summary Talk Canada - California Strategic Innovation Partnership Summit.

“The UCSD Big Data Freeway System” Invited Short Talk Workshop on “Enriching Human Life and Society” UC San Diego February 6, 2014 Dr. Larry Smarr Director,

“ OptIPuter Year Five: From Research to Adoption " OptIPuter All Hands Meeting La Jolla, CA January 22, 2007 Dr. Larry Smarr Director, California.

UCSD’s Distributed Science DMZ

TransLight Tom DeFanti 50 years ago, 56Kb USA to Netherlands cost US$4.00/minute Now, OC-192 (10Gb) costs US$2.00/minute* That’s 400,000 times cheaper.

Southern California Infrastructure Philip Papadopoulos Greg Hidley.

“Genomics: The CAMERA Project" Invited Talk 5 th Annual ON*VECTOR International Photonics Workshop UCSD February 28, 2006 Dr. Larry Smarr Director,

High Performance Cyberinfrastructure Discovery Tools for Data Intensive Research Larry Smarr Prof. Computer Science and Engineering Director, Calit2 (UC.

“OptIPuter: From the End User Lab to Global Digital Assets" Panel UC Research Cyberinfrastructure Meeting October 10, 2005 Dr. Larry Smarr.

“ Building an Information Infrastructure to Support Microbial Metagenomic Sciences " Presentation to the NBCR Research Advisory Committee UCSD La Jolla,

Optical SIG, SD Telecom Council

Presentation transcript:

Using Photonics to Prototype the Research Campus Infrastructure of the Future: The UCSD Quartzite Project Philip Papadopoulos Larry Smarr Joseph Ford Shaya Fainman Brian Dunne University of California, San Diego

Interconnecting Regional Optical Networks Is Driving Campus Optical Infrastructure Deployment CENIC

CENIC Switched Ethernet Network HPRng-L2 Design Source: Jim Dolgonas, CENIC

CENIC Switched Optical Network HPRng-L1 design Source: Jim Dolgonas, CENIC

Campus Preparations Needed to Accept CENIC CalREN Handoff to Campus

Current UCSD Experimental Optical Core: Ready to Couple to CENIC L1, L2, L3 Services Source: Phil Papadopoulos, SDSC/Calit2 (Quartzite PI, OptIPuter co-PI) Funded by NSF MRI Grant Lucent Glimmerglass Force10 OptIPuter Border Router CENIC L1, L2 Services Cisco 6509 Goals by 2008: >= 50 endpoints at 10 GigE >= 32 Packet switched >= 32 Switched wavelengths >= 300 Connected endpoints Approximately 0.5 TBit/s Arrive at the “Optical” Center of Campus Switching will be a Hybrid Combination of: Packet, Lambda, Circuit -- OOO and Packet Switches Already in Place

Calit2 Sunlight Optical Exchange Contains Quartzite 10:45 am Feb. 21, 2008

Block Layout of Quartzite/OptIPuter Network Quartzite ~30 10 Gbps Lightpaths 16 More to Come Glimmerglass OOO Switch Application Specific Embedded Switches

Calit2 Microbial Metagenomics Cluster Production System 512 Processors ~5 Teraflops ~ 200 Terabytes Storage 1GbE and 10GbE Switched / Routed Core ~200TB Sun X4500 Storage 10GbE

Straightforward Use Case Quartzite Connected Computational Science Needed to Run a Large Number of Pre-computed BLAST Sequence Alignments for JCVI Fragment Recruitment Viewer (FRV) CAMERA Development and Batch Clusters Oversubscribed Had Spare Capacity in SDSC Cluster Connected to Quartzite Reconfigure Private Side of Network to “Attach” Nodes in SDSC Rockstar Cluster to CAMERA Ikelite Cluster for Batch Processing –Direct Network Connection to CAMERA X4500 Thumper Storage –No Changes to Application Software or Paths –Rockstar Nodes Reconfigured to Support FRV Needs Rockstar (SDSC) Nodes Integrated as Part of Ikelite (Calit2) Batch System –~2000 CPU-Days Dedicated Computing over Previous 14 Days –O(2TB) of Output –Running Right Now Source:Phil Papadopoulos, SDSC/Calit2 (Quartzite PI, OptIPuter co-PI)

Green Modular Datacenters Optically Connected UCSD Installing Two Sun Microsystems Boxes UCSD Structural Engineering Dept. Conducted Tests May 2007

Initial Deployment of UCSD DWDM Reconfigurable Lambda Mesh 16 Connected Pairs at 10GbE Source:Phil Papadopoulos, SDSC/Calit2 (Quartzite PI, OptIPuter co-PI)

N x 10 Gbit 10 Gigabit L2/L3 Switch Eco-Friendly Storage and Compute Microarray Your Lab Here Wide-Area 10G Cenic/HPR NLR Cavewave Cinegrid … Quartzite – Influencing Next-Generation UCSD Network On-Demand Physical Connections “Network in a box “ > 200 Connections DWDM or Gray Optics Active Data Replication Source:Phil Papadopoulos, SDSC/Calit2

UCSD Planned Optical Networked Biomedical Researchers and Instruments Cellular & Molecular Medicine West National Center for Microscopy & Imaging Biomedical Research Center for Molecular Genetics Pharmaceutical Sciences Building Cellular & Molecular Medicine East CryoElectron Microscopy Facility Radiology Imaging Lab Bioengineering San Diego Supercomputer Center Connects at 10 Gbps : –Microarrays –Genome Sequencers –Mass Spectrometry –Light and Electron Microscopes –Whole Body Imagers –Computing –Storage

Creating a UC Cyberinfrastructure of Campus OptIPuter “On-Ramps” to NLR, I2, and TeraGrid Resources UC San Francisco UC San Diego UC Riverside UC Irvine UC Davis UC Berkeley UC Santa Cruz UC Santa Barbara UC Los Angeles UC Merced OptIPuter + CalREN-XD + TeraGrid = “OptiGrid” Source: Fran Berman, SDSC, Larry Smarr, Calit2 Creating a Critical Mass of End Users on a Secure LambdaGrid

Summary Quartzite Deployment is Nearly Complete More Than ½ Terabit/s (Unidirectional) Aggregate Bandwidth Twenty 10Gbit DWDM-Connected Pairs (40 Optics) (400 Gbit/S) 4x4x8lambda WSS Has Already Influenced CAMERA Project Design Has Already Influenced Next-Generation Campus Research Cyber-infrastructure Room for Expansion Within the Core