“Cal-(IT)2 Projects with Sun Microsystems” Invited Talk at the Sun Microsystems Booth Supercomputing 2004 Pittsburgh, PA November 9, 2004 Dr. Larry Smarr.

Slides:

Advertisements

Similar presentations

-Grids and the OptIPuter Software Architecture Andrew A. Chien Director, Center for Networked Systems SAIC Chair Professor, Computer Science and Engineering.

Advertisements

OptIPuter Goal: Removing Bandwidth Barriers to e-Science ATLAS Sloan Digital Sky Survey LHC ALMA.

Calit2 " Talk Nortel Visiting Team December 12, 2005 Dr. Larry Smarr Director, California Institute for Telecommunications and Information.

Creating High Performance Lambda Collaboratories" ONR Briefing ACCESS DC Arlington, VA March 25, 2005 Dr. Larry Smarr Director, California Institute for.

Calit2-Living in the Future " Keynote Sharecase 2006 University of California, San Diego March 29, 2006 Dr. Larry Smarr Director, California Institute.

Bringing Mexico Into the Global LambdaGrid Dr. Larry Smarr Director, California Institute for Telecommunications and Information Technology Harry E. Gruber.

High Resolution Multimedia in a Ultra Bandwidth World After Dinner Talk IEEE ISM2005 Irvine, CA December 13, 2005 Dr. Larry Smarr Director, California.

Why Optical Networks Are Emerging as the 21 st Century Driver Scientific American, January 2001.

The Drive Toward Dedicated IP Lightpipes for e-Science Applications OSAs 6th Annual Photonics & Telecommunications Executive Forum Panel on "Back to the.

"The OptIPuter: an IP Over Lambda Testbed" Invited Talk NREN Workshop VII: Optical Network Testbeds (ONT) NASA Ames Research Center Mountain View, CA August.

The First Year of Cal-(IT) 2 Report to The University of California Regents UCSF San Francisco, CA March 13, 2002 Dr. Larry Smarr Director, California.

Scaling-Up the BIRN Building on the BIRN Workshop National Institutes of Health Bethesda, MD March 22, 2004 Dr. Larry Smarr Director, California Institute.

AHM Overview OptIPuter Overview Third All Hands Meeting OptIPuter Project San Diego Supercomputer Center University of California, San Diego January 26,

“Building US/Mexico Collaborations Using Optical Networks” Opening Workshop Welcome Big Data Big Network 2 Calit2’s Qualcomm Institute February 10, 2014.

Electronic Visualization Laboratory, University of Illinois at Chicago Collaborative Visualization Architecture in Scalable Adaptive Graphics Environment.

Calit2 – Increasing Interaction Between Industry and University Researchers Swedish American Entrepreneurial Days University of California,

Electronic visualization laboratory, university of illinois at chicago Status and Plans for EVL Software Components Jason Leigh, Luc Renambot Venkat Vishwanath,

Distributed Virtual Computer (DVC): Simplifying the Development of High-Performance Grid Applications Nut Taesombut and Andrew A. Chien Department of Computer.

“How LambdaGrids are Transforming Science" Keynote iGrid2005 La Jolla, CA September 29, 2005 Dr. Larry Smarr Director, California Institute.

The OptIPuter Project: From the Grid to the LambdaGrid Invited Talk IEEE Orange County Computer Society Irvine, CA October 24, 2005 Dr. Larry Smarr Director,

Cal-(IT) 2 : A Public-Private Partnership in Southern California Tech Coast Angels Invited Talk November 11, 2003 Faculty Club, UC San Diego Dr. Larry.

SoCal Infrastructure OptIPuter Southern California Network Infrastructure Philip Papadopoulos OptIPuter Co-PI University of California, San Diego Program.

The OptIPlanet Collaboratory Supporting Researchers Worldwide Talk Australian American Leadership Dialogue January 15, 2008 Dr. Larry Smarr.

“ High Performance Collaboration – The Jump to Light Speed " Invited Talk National Center for Supercomputing Applications University of Illinois, Urbana-Champaign.

Why Optical Networks Will Become the 21 st Century Driver Scientific American, January 2001 Number of Years Performance per Dollar Spent Data Storage.

“ NCSA and Telepresence Collaboration ” Remote Telepresence Talk to The 2006 NCSA Private Sector Program Annual Meeting In Honor of John Stevenson’s Retirement.

“Calit2: A UC Experiment for Living in the Future" Talk to UCSD Near You La Jolla, CA April 11, 2006 Dr. Larry Smarr Director, California Institute.

Developing a North American Global LambdaGrid Dr. Larry Smarr Director, California Institute for Telecommunications and Information Technology Harry E.

1 Emergence of the Planetary Computing in Support of Global Science Initiatives Invited Talk The “Jack Ealy” Workshop July 19, 2004 Institute of the Americas,

Cal-(IT) 2 : A Public-Private Partnership in Southern California U.S. Business Council for Sustainable Development Year-End Meeting December 11, 2003 Institute.

Chiaro’s Enstara™ Summary Scalable Capacity –6 Tb/S Initial Capacity –GigE  OC-192 Interfaces –“Soft” Forwarding Plane With Network Processors For Maximum.

Introduction to Calit2 Visit by NASA Ames February 29, 2008 Dr. Larry Smarr Director, California Institute for Telecommunications and Information Technology.

Chicago/National/International OptIPuter Infrastructure Tom DeFanti OptIPuter Co-PI Distinguished Professor of Computer Science Director, Electronic Visualization.

Innovative Research Alliances Invited Talk IUCRP Fellows Seminar UCSD La Jolla, CA July 10, 2006 Dr. Larry Smarr Director, California Institute for Telecommunications.

“Metagenomics Over Lambdas: Update on the CAMERA Project" Invited Talk 6 th Annual ON*VECTOR International Photonics Workshop UCSD February 27,

A Wide Range of Scientific Disciplines Will Require a Common Infrastructure Example--Two e-Science Grand Challenges –NSF’s EarthScope—US Array –NIH’s Biomedical.

" Using OptIPuter Innovations to Enable LambdaGrid Applications " Keynote JGN II Symposium HDTV Over Fiber From Seattle to Osaka January 18, 2005 Dr. Larry.

“Cyberinfrastructure for Ocean Cabled Observatories" Invited Talk NEPTUNE Regional Cabled Ocean Observatory Workshop Seattle, WA November 15, 2005 Dr.

Update on Calit2 Briefing to External Relations Staff UC San Diego La Jolla, CA November 8, 2005 Dr. Larry Smarr Director, California Institute for Telecommunications.

Using Photonics to Prototype the Research Campus Infrastructure of the Future: The UCSD Quartzite Project Philip Papadopoulos Larry Smarr Joseph Ford Shaya.

SoCal Infrastructure OptIPuter Southern California Network Infrastructure Philip Papadopoulos OptIPuter Co-PI University of California, San Diego Program.

Cal-(IT) 2 : A Public-Private Partnership in Southern California UCSD CONNECT Leadership Council Invited Talk September 17, 2003 ResMed Facilities, Poway,

A High-Performance Campus-Scale Cyberinfrastructure For Effectively Bridging End-User Laboratories to Data-Intensive Sources Presentation by Larry Smarr.

“ Calit2-Living in the Future " Briefing The Future in Review (FiRe) 2006 Conference University of California, San Diego May 15, 2006 Dr. Larry Smarr Director,

Larry Smarr Professor, Computer Science, UCSD Director, Calit2 “Calit2-a Persistent UCSD/UCI Framework for Collaboration"

TOPS “Technology for Optical Pixel Streaming” Paul Wielinga Division Manager High Performance Networking SARA Computing and Networking Services

The Interaction of UCSD Industrial Partners, the Jacobs School of Engineering, and Cal-(IT) 2 Dr. Larry Smarr Director, California Institute for Telecommunications.

"The Academic and R&D Sectors’ Current and Future Broadband and Fiber Access Needs For US Global Competitiveness" Invited Access Grid Talk MSCMC FORUM.

Ocean Sciences Cyberinfrastructure Futures Dr. Larry Smarr Director, California Institute for Telecommunications and Information Technologies Harry E.

The OptIPuter Project Tom DeFanti, Jason Leigh, Maxine Brown, Tom Moher, Oliver Yu, Bob Grossman, Luc Renambot Electronic Visualization Laboratory, Department.

OptIPuter Networks Overview of Initial Stages to Include OptIPuter Nodes OptIPuter Networks OptIPuter Expansion OPtIPuter All Hands Meeting February 6-7.

“ Collaborations Between Calit2, SIO, and the Venter Institute—a Beginning " Talk to the UCSD Representative Assembly La Jolla, CA November 29, 2005 Dr.

“ Ultra-Broadband and Peta-Scale Collaboration Opportunities Between UC and Canada Summary Talk Canada - California Strategic Innovation Partnership Summit.

“The UCSD Big Data Freeway System” Invited Short Talk Workshop on “Enriching Human Life and Society” UC San Diego February 6, 2014 Dr. Larry Smarr Director,

“ OptIPuter Year Five: From Research to Adoption " OptIPuter All Hands Meeting La Jolla, CA January 22, 2007 Dr. Larry Smarr Director, California.

SCHOOL OF INFORMATION UNIVERSITY OF MICHIGAN Experiences using Uncompressed High Definition Video Erik Hofer School of Information.

RobuSTore: Performance Isolation for Distributed Storage and Parallel Disk Arrays Justin Burke, Huaxia Xia, and Andrew A. Chien Department of Computer.

Southern California Infrastructure Philip Papadopoulos Greg Hidley.

“Genomics: The CAMERA Project" Invited Talk 5 th Annual ON*VECTOR International Photonics Workshop UCSD February 28, 2006 Dr. Larry Smarr Director,

University of Illinois at Chicago Lambda Grids and The OptIPuter Tom DeFanti.

Integrate access to advanced computational resources and high-level services (resource scheduling, automated data management) to accelerate and improve.

High Performance Cyberinfrastructure Discovery Tools for Data Intensive Research Larry Smarr Prof. Computer Science and Engineering Director, Calit2 (UC.

“OptIPuter: From the End User Lab to Global Digital Assets" Panel UC Research Cyberinfrastructure Meeting October 10, 2005 Dr. Larry Smarr.

“ Building an Information Infrastructure to Support Microbial Metagenomic Sciences " Presentation to the NBCR Research Advisory Committee UCSD La Jolla,

Lennart Johnsson Professor CSC Director, PDC

The OptIPuter Project: From the Grid to the LambdaGrid

TOPS “Technology for Optical Pixel Streaming”

Optical SIG, SD Telecom Council

The OptIPortal, a Scalable Visualization, Storage, and Computing Termination Device for High Bandwidth Campus Bridging Presentation by Larry Smarr to.

TOPS “Technology for Optical Pixel Streaming”

Presentation transcript:

“Cal-(IT)2 Projects with Sun Microsystems” Invited Talk at the Sun Microsystems Booth Supercomputing 2004 Pittsburgh, PA November 9, 2004 Dr. Larry Smarr Director, California Institute for Telecommunications and Information Technology Harry E. Gruber Professor, Dept. of Computer Science and Engineering Jacobs School of Engineering, UCSD

Cal-(IT) 2 --An Integrated Approach the Future of the Internet UC San Diego & UC Irvine Faculty Working in Multidisciplinary Teams With Students, Industry, and the Community Extending the Internet Throughout the Physical World

Two New Cal-(IT) 2 Buildings Will Become Global Collaboration Laboratories Will Create New Laboratory Facilities: –Virtual Reality and Virtual Team Rooms –UCSD Opening in 2005 with the First 8Mpixel Digital Cinema Projector in US –= 4 x HDTV International Will be Hosted Bioengineering UC San Diego UC Irvine State of California Provided $100M Capital Cal-(IT) Building Is Connected To Outside With 140 Optical Fibers

Innovation Driven by Cal-(IT) 2 Industrial Partners Teaming with Academic Research and Education Funding Faculty Research Projects Supporting Graduate/Undergraduate Fellows Providing Access to Living Labs Equipment Joining on Federal Grants Co-Sponsoring Workshops/Conferences Hosting Seminars or Lectures Endowing Chaired Professorships $85 Million from Industrial Partners in Matching Funds

Sun Microsystems Has Participated In and Co-Hosted Many Cal-(IT) 2 Events Sun’s Emil Sarpa and Jeff Nagle at Calit2 All-Hands Meeting April 2004 Sun’s Steve Scharf Presenting at UCI Lunch-n-Learn Seminar July 2004 Sun Co-Hosted with Cal-(IT)2 the GEON All Hands Meeting Gala Dinner August 2004

Imagining a Fiber Optic Infrastructure Supporting Interactive Visualization--SIGGRAPH 1989 “Using satellite technology…demo of What It might be like to have high-speed fiber-optic links between advanced computers in two different geographic locations.” ―Al Gore, Senator Chair, US Senate Subcommittee on Science, Technology and Space “What we really have to do is eliminate distance between individuals who want to interact with other people and with other computers.” ―Larry Smarr, Director National Center for Supercomputing Applications, UIUC ATT & Sun Source: Maxine Brown Illinois Boston

Optical WAN Research Bandwidth Has Grown Three Times Faster than Supercomputer Speed! Megabit/s Gigabit/s Terabit/s Source: Timothy Lance, President, NYSERNet Full NLR 1 GFLOP Cray2 60 TFLOP Altix Bandwidth of NYSERNet Research Network Backbones T Gb

The OptIPuter Project – Removing Bandwidth as an Obstacle In Data Intensive Sciences NSF Large Information Technology Research Proposal –Cal-(IT) 2 and UIC Lead Campuses—Larry Smarr PI –USC, SDSU, NW, Texas A&M, Univ. Amsterdam Partnering Campuses Industrial Partners –IBM, Sun, Telcordia, Chiaro, Calient, Glimmerglass, Big Bandwidth $13.5 Million Over Five Years Optical IP Streams From Lab Clusters to Large Data Objects NIH Biomedical Informatics NSF EarthScope and ORION siovizcenter.ucsd.edu/library/gallery/shoot1/index.shtml Research Network

What is the OptIPuter? Optical networking, Internet Protocol, Computer Storage, Processing and Visualization Technologies –Dedicated Light-pipe (One or More 1-10 Gbps WAN Lambdas) –Links Linux Cluster End Points With 1-10 Gbps per Node –Does NOT Require TCP Transport Layer Protocol –Exploring Both Intelligent Routers and Passive Switches Applications Drivers: –Interactive Collaborative Visualization of Large Remote Data Objects –Earth and Ocean Sciences –Biomedical Imaging The OptIPuter Exploits a New World in Which the Central Architectural Element is Optical Networking, NOT Computers -– The Network REALLY is the Computer! See Nov 2003 Communications of the ACM for Articles on OptIPuter Technologies

Creating a Model for a Campus LambdaGrid at UCSD

Added Sun OptIPuter End Nodes for Compute, Storage and Visualization 51-Nodes Dual Opteron 242-Based Purchase –Building Three OptIPuter 17-Node Clusters –Dual GigE, 4 GB memory, 36GB SCSI Raid –Located in Engineering, SDSC and NCMIR 21-Node Opteron-Based Visualization Server Purchased –Dual Opteron 246s, 2GB RAM, 36GB disk, Quadro300G graphics –Driving a 4x5 20 inch UXGA LCD Display Wall (+1 Display) –40 Megapixel Display –New OptIPuter Supported Node For Brain Imaging Visualization –Nearly 7/24 Usage as Compute Cluster When Not Used For Visualization 6-Terabyte storage purchased –3TB Added To Above Storage Cluster –3TB StorEdge Server –Supporting OptIPuter Storage Research 128-Node Intel-Based Storage Cluster Donated by Sun Early 2004 –Located at SDSC –OptIPuter and Other Research Support Activities

OptIPuter End Nodes Are Smart Bit Buckets i.e. Scalable Standards-Based Linux Clusters with Rocks & Globus From Piles of Parts to Running Cluster in Under 2 Hours Computational Chemistry & Brain Image Segmentation Ran Included the NSF Middleware (NMI) R3 Release of Software Complete SW Install and HW Build Building RockStar at SC2003 Source: Phil Papadopoulos, SDSC Rocks is the 2004 Most Important Software Innovation HPCwire Reader's Choice and Editor’s Choice Awards

OptIPuter JuxtaView Software for Viewing High Resolution Images on Tiled Displays 30 Million Pixel Display Driven By a 20-node Sun Opteron Visualization Cluster Source: Mark Ellisman, David Lee, Jason Leigh This Cerebellum Image is a Montage of 43,200 Smaller Images Green: The Purkinje Cells Red: GFAP in the Glial Cells Blue: DNA in Cell Nuclei NCMIR Lab UCSD

The OptIPuter Will be Used to Enhance Collaboration OptIPuter Will Connect Falko Kuester’s Cal-(IT) Smart Classroom and The 30M-Pixel Display At UCSD Ellisman’s BIRN Laboratories “Sunscreen” Run by Sun Opteron Cluster

OptIPuter Middleware Architecture for Distributed Virtual Computers Layer 4: XCP Node Operating Systems -configuration, Net Management Grid and Web Middleware – (Globus/OGSA/WebServices/J2EE) Physical Resources DVC #1 OptIPuter Applications DVC #2DVC #3 Layer 5: SABUL, RBUDP, Fast, GTP Real-Time Objects Security Models Data Services: DWTP Higher Level Grid Services Visualization DVC/ Middleware High-Speed Transport Optical Signaling/Mgmt Source: Andrew Chien, UCSD OptIPuter Software Systems Architect From Grids to LambdaGrids

EVL 10GE OptIPuter CAVEWAVE Will Help Launch the National LambdaRail Next Step: Coupling NASA Centers to NSF OptIPuter Source: Tom DeFanti, OptIPuter co-PI

Sun Sponsored Research Projects Storage Related Projects Driven By Sun Partnership –Supports Storage Development Research Staff –Integrate Storage Cluster Functionality Into Rocks Configuration Package –Expand Research on Parallel and Distributed File System Configurations –Integrate Dynamic Storage Allocation Into OptIPuter Middleware Dedicated Storage Development Position Under Recruitment Discussions with Sun Concerning the Value of an Open-Source Solaris

Cal-(IT) Sun Sponsored Research Projects Three Projects Driven By Sun Partnership Demonstration Project of Playing a Game On Multiple Platforms, –e.g., Cellular Phone, PC, PDA (Heterogeneous Gaming Initiative) From Play Mechanics That Evolved From This Project: –Concurrently Developing Glyph Authoring System for Heterogeneous Gaming Developing a Sun Center of Excellence for Networking Gaming & Graphics Pending Proposal to Augment Above to Move Projects to Sun Hardware –Begin to Run Butterfly.Net Software on Sun Clusters

Partners. Source: Celia Pearce, UCI Cal-(IT) 2 /SDSC Multi-User Heterogeneous Gaming Living Laboratory Cal-(IT) 2 Game Culture & Technology Lab Linking to Cell Phone Games Athomas Goldberg & Doug Twilleager, Sun Game Technologies

Presenting in Trade Shows With Cal-(IT) 2 Industrial Partners Student Projects From UCI's Sun Microsystems-Sponsored Course In Mobile Game Development Are Being Showcased at the Sun Booth

Cal-(IT) 2 Works with Affiliated Institutions to Enhance Interactions with Industrial Partners Sun Microsystems designated the SDSU Viz Center, as a "Sun Center of Excellence for Collaborative Visualization." More recently, Sun donated a Sun "Zulu" high-end graphics system to that facility Smarr with Eric Frost and Bob Welty, co-Directors of SDSU’s Center for Information Technology and Infrastructure (CITI)