TOPS “Technology for Optical Pixel Streaming” Paul Wielinga Division Manager High Performance Networking SARA Computing and Networking Services

Slides:

Advertisements

Similar presentations

Grids and Biology: A Natural and Happy Pairing Rick Stevens Director, Mathematics and Computer Science Division Argonne National Laboratory Professor,

Advertisements

-Grids and the OptIPuter Software Architecture Andrew A. Chien Director, Center for Networked Systems SAIC Chair Professor, Computer Science and Engineering.

OptIPuter Goal: Removing Bandwidth Barriers to e-Science ATLAS Sloan Digital Sky Survey LHC ALMA.

"The OptIPuter: an IP Over Lambda Testbed" Invited Talk NREN Workshop VII: Optical Network Testbeds (ONT) NASA Ames Research Center Mountain View, CA August.

Basic Principles of PACS Networking Emily Seto Medical Engineering/SIMS Center for Global eHealth Innovation April 29, 2004.

Resource Brokering: Your Ticket Into NetherLight Paola Grosso Jeroen van der Ham Cees de Laat UvA - AIR group.

StarPlane & LightHouse Cees de Laat SURFnet EU University of Amsterdam SARA TI TNONCF.

AHM Overview OptIPuter Overview Third All Hands Meeting OptIPuter Project San Diego Supercomputer Center University of California, San Diego January 26,

Electronic Visualization Laboratory, University of Illinois at Chicago Collaborative Visualization Architecture in Scalable Adaptive Graphics Environment.

Global Lambda Integrated Facility (GLIF) Kees Neggers SURFnet Internet2 Fall meeting Austin, TX, 27 September 2004.

Xingfu Wu Xingfu Wu and Valerie Taylor Department of Computer Science Texas A&M University iGrid 2005, Calit2, UCSD, Sep. 29,

Electronic visualization laboratory, university of illinois at chicago Status and Plans for EVL Software Components Jason Leigh, Luc Renambot Venkat Vishwanath,

Optical networking research in Amsterdam Paola Grosso UvA - AIR group.

May TNC2007 Network Description Language - Semantic Web for Hybrid Networks Network Description Language: Semantic Web for Hybrid Networks Paola.

May TERENA workshopStarPlane StarPlane: Application Specific Management of Photonic Networks Paola Grosso SNE group - UvA.

Oct RoN meetingiGrid2005: a lambda networking facility Paola Grosso AIR/ UvA.

Feb ON*VECTOR Photonics Workshop iGrid 2005 Cyber-Infrastructure iGrid2005 Cyber-infrastructure Paola Grosso GigaPort project UvA.

Accomplishments. Applications Earth Sciences SIO OptIPuter Visualization Cluster 10 node IBM PC Cluster driving two 9.2 million pixels IBM T221 displays.

Dutch Tier 1 SARA/NIKHEF & SURFnet Erik-Jan Bos Director of Network Services SURFnet, The Netherlands To/T1 networking meeting, Geneva, Switzerland July.

SURFnet and the LHC Erik-Jan Bos Director of Network Services, SURFnet Co-chair of GLIF TEC LHC T0/1 Network Meeting, Amsterdam January 21, 2005.

“How LambdaGrids are Transforming Science" Keynote iGrid2005 La Jolla, CA September 29, 2005 Dr. Larry Smarr Director, California Institute.

NORDUnet NORDUnet The Fibre Generation Lars Fischer CTO NORDUnet.

Telescience Project and bandwidth challenge on the TransPAC Toyokazu Akiyama Cybermedia Center, Osaka University.

Distributed Visualization and Data Resources Enabling Remote Interaction and Analysis Scott A. Friedman UCLA Institute for Digital.

OptIPuter Application-Centered Tools and Techniques Jason Leigh (EVL/UIC) Luc Renambot (EVL/UIC) Paul Wielinga (SARA) Tomohiro Kudoh (AIST) Xingfu Wu (Texas.

LambdaGRID the NREN (r)Evolution Kees Neggers Managing Director SURFnet Reykjavik, 26 August 2003.

Kees Neggers SURFnet SC2003 Phoenix, 20 November 2003.

Applications Requirements Working Group HENP Networking Meeting June 1-2, 2001 Participants Larry Price Steven Wallace (co-ch)

HAH 2007/05/09 Connecting LOFAR to the GRID Hanno Holties, ASTRON IVOA - OGF Astro-RG Work Shop Manchester, 9th May 2007.

Electronic visualization laboratory, university of illinois at chicago A Case for UDP Offload Engines in LambdaGrids Venkatram Vishwanath, Jason Leigh.

CA*net 4 International Grid Testbed Tel:

High-quality Internet for higher education and research GigaPort  Overview SURFnet6 Niels den Otter SURFnet EVN-NREN Meeting Amsterdam October 12, 2005.

Chicago/National/International OptIPuter Infrastructure Tom DeFanti OptIPuter Co-PI Distinguished Professor of Computer Science Director, Electronic Visualization.

Dutch Tier Hardware Farm size –now: 150 dual nodes + scavenging 200 nodes –buildup to ~1500 up-to-date nodes in 2007 Network –now: 2 Gbit/s internatl.

Using Photonics to Prototype the Research Campus Infrastructure of the Future: The UCSD Quartzite Project Philip Papadopoulos Larry Smarr Joseph Ford Shaya.

GigaPort NG Network SURFnet6 and NetherLight Kees Neggers SURFnet Amsterdam October 12, 2004.

GLIF Infrastructure Kees Neggers SURFnet SC2004 Pittsburgh, PA 12 November 2004.

BiG Grid at HTC Philips Research Jaap van den Herik BiG Grid and Tilburg University.

Techs in Paradise 2004, Honolulu / Lambda Networking BOF / Jan 27 NetherLight day-to-day experience APAN lambda networking BOF Erik Radius Manager Network.

Advanced IT to Support Digital Libraries Research and Academic Computing & Telecommunications Divisions UITS.

University of Illinois at Chicago Electronic Visualization Laboratory (EVL) SuperDuperNetworking Transforming Supercomputing …from the point of view of.

NL Service Challenge Plans Kors Bos, Sander Klous, Davide Salomoni (NIKHEF) Pieter de Boer, Mark van de Sanden, Huub Stoffers, Ron Trompert, Jules Wolfrat.

HEPix April 2006 NIKHEF site report What’s new at NIKHEF’s infrastructure and Ramping up the LCG tier-1 Wim Heubers / NIKHEF (+SARA)

O AK R IDGE N ATIONAL L ABORATORY U.S. D EPARTMENT OF E NERGY Probe Plans and Status SciDAC Kickoff July, 2001 Dan Million Randy Burris ORNL, Center for.

Advances Toward Economic and Efficient Terabit LANs and WANs Cees de Laat Advanced Internet Research Group (AIRG) University of Amsterdam.

GigaPort NG Network SURFnet6 and NetherLight Erik-Jan Bos Director of Network Services, SURFnet GDB Meeting, SARA&NIKHEF, Amsterdam October 13, 2004.

The OptIPuter Project Tom DeFanti, Jason Leigh, Maxine Brown, Tom Moher, Oliver Yu, Bob Grossman, Luc Renambot Electronic Visualization Laboratory, Department.

Electronic Visualization Laboratory, University of Illinois at Chicago Pacific Research Platform Scalable Visualization and Virtual-Reality Team

For WSIS 2003, CERN and the International Center for Advanced Internet Research (iCAIR) designed several demonstrations of next generation.

IWarp Based Remote Interactive Scientific Visualization CENIC 2008 Oakland, CA Scott A. Friedman UCLA Academic Technology Services Research Computing Technologies.

TransLight Tom DeFanti 50 years ago, 56Kb USA to Netherlands cost US$4.00/minute Now, OC-192 (10Gb) costs US$2.00/minute* That’s 400,000 times cheaper.

WHAT SURF DOES FOR RESEARCH SURF’s Science Engagement TNC15 June 18, 2015 Sylvia Kuijpers (SURFnet)

NSF International Research Network Connections (IRNC) Program: TransLight/StarLight Maxine D. Brown and Thomas A. DeFanti Electronic Visualization Laboratory.

Use of high speed photonic networks for efective use of very high quality media production Michal Krsek (CESNET) Mirek Sochor (CESNET/UPP)

DutchGrid KNMI KUN Delft Leiden VU ASTRON WCW Utrecht Telin Amsterdam Many organizations in the Netherlands are very active in Grid usage and development,

“OptIPuter: From the End User Lab to Global Digital Assets" Panel UC Research Cyberinfrastructure Meeting October 10, 2005 Dr. Larry Smarr.

Optical/Photonic Networking and Grid Integration Cees de Laat Advanced Internet Research Group (AIRG) UvA.

J. Templon Nikhef Amsterdam Physics Data Processing Group Large Scale Computing Jeff Templon Nikhef Jamboree, Utrecht, 10 december 2012.

May 17, 2010 Michal Krsek CESNET Use of high speed photonic networks for effective use of very high quality media production.

Grid Optical Burst Switched Networks

NL Service Challenge Plans

StarPlane: Application Specific Management of Photonic Networks

The SURFnet Project Bram Peeters, Manager Network Services

Using High-Resolution Visualization over Optical Networks

Global Lambda Integrated Facility

TOPS “Technology for Optical Pixel Streaming”

The OptIPortal, a Scalable Visualization, Storage, and Computing Termination Device for High Bandwidth Campus Bridging Presentation by Larry Smarr to.

TOPS “Technology for Optical Pixel Streaming”

Optical Networking Activities in NetherLight

Presentation transcript:

TOPS “Technology for Optical Pixel Streaming” Paul Wielinga Division Manager High Performance Networking SARA Computing and Networking Services Courtesy EVL

iGrid GLVF OptIPuter panel Outline About SARA Rationale for adapting OptIPuter concept TOPS Demonstration US117b at iGrid2005 (Preliminary) Results Other demo’s SARA is involved in

iGrid GLVF OptIPuter panel SARA Computing and Networking Services SARA: National e-Science Support Center Home of  Dutch Supercomputing infrastructure  SURFnet NOC  SURFnet6 major core node  NetherLight (sister site of StarLight)  Amsterdam LightHouse OptIPuter affiliate international partner LHC Tier-1 site Proposed LOFAR storage site SARA is independent and not-for-profit

iGrid GLVF OptIPuter panel Teraflops, Terabytes, Terabits, CAVE SGI Origin 3800 STK tape library Tiled-panel display IBM Cluster 1600 Linux Nationaal Rekencluster Netherlight SURFnet 6 SGI Altix 3700

iGrid GLVF OptIPuter panel Why we adopt OptIPuter Science pull:  Petabytes of complex data explored and analyzed by nationally and internationally dispersed scientists, in many teams  SARA’s mission as e-Science Support Center Life Sciences ~PBytes/sec LHC Tier-1 site (with NIKHEF) Brain Activity Analysis Univ Utrecht LOFAR

iGrid GLVF OptIPuter panel Why we adopt OptIPuter (2) Technology push:  SURFnet6 – Hybrid Optical and Packet Switching Network  5 Photonic RIngs  Light Path Provisioning for all universities and research institutions in NL

iGrid GLVF OptIPuter panel TOPS Technology for Optical Pixel Streaming Use OptIPuter concept to split visualization from display  Render images from very large data sets on central visualization cluster  Use high speed (lambda) networks to stream pixels to ultra- high resolution tiled panel displays Adapt the idea of video streaming: constant stream of pixels from renderer to display Use lossy protocols for long distance connectivity: High performance TCP hard to achieve, UDP performance trivial Light weight application Possibly incorporated in SAGE (EVL and UCSD)?

iGrid GLVF OptIPuter panel DEMO US117b – GLVF TOPS Very large 2D and 3D datasets located at SARA in Amsterdam Render cluster (29 nodes) at SARA 20 Gbps connectivity between cluster and NetherLight, via University of Amsterdam switch 2 * 10 Gbps lambda between Amsterdam and San Diego (SURFnet, CaveWave, WANPHY Amsterdam-SD) UCSD LambdaVision display at iGrid: 100 Megapixel Tiled Display 1 Frame = 100 Mpixel*24 bits = 2.4 Gbits Uncompressed and compressed mode Streaming pixels from Amsterdam to San Diego

iGrid GLVF OptIPuter panel Preliminary results First demoslot, 1 10 Gbps available  Sustained bandwidth used between rendering and display 9.2 Gbps Second demoslot, 2 * 10 Gbps  Sustained bandwidth 5,3 + 6,2 = 11,5 Gbps

iGrid GLVF OptIPuter panel Final results Third demoslot, 2 times 10 Gbps available  Sustained bandwidth used between rendering and display 18 Gbps  Peak bandwidth of 19.5 Gbps! New world record of transatlantic bandwidth usage by one single application visualizing scientific content

iGrid GLVF OptIPuter panel Preliminary results Limitation was MTU size – not whole path was jumbo- frame enabled Display cluster had 100% cpu load due to small MTU size Large UDP packet loss (upto 50%) Noticable difference in latency (visible) between CaveWave (with 4 switches) and direct WANPHY connection Later today:  new trial with jumbo frames enabled  Expect higher framerate and bandwidth usage of 15 Gbps or more

iGrid GLVF OptIPuter panel iGrid2005 demonstrations US117b: GLVF – Unreliable Stream of Images (TOPS) SARA participation in other demo’s:  US117a: SAGE (EVL) computing support in Amsterdam  NL102: Dead Cat (UvA) – Visualization support (Amsterdam)  US106: 10 Gb line-speed security (NORTEL) – Networking and computing support (Amsterdam)

iGrid GLVF OptIPuter panel Credits Bram Stolk (SARA) Jeroen Akershoek (SARA) Ronald van der Pol (SARA) Pieter de Boer (SARA) Hanno Pet (SARA) University of Amsterdam (Paola Grosso et al.) SURFnet (Dennis Paus et al.) Jason Leigh, Luc Renambot, Lance Long and colleagues at EVL and UCSD iGrid2005 networking and LambdaVision crews

Thank You