John D. McCoy Principal Investigator Tom McKenna Project Manager UltraScienceNet Research Testbed Enabling Computational Genomics Project Overview.

Slides:



Advertisements
Similar presentations
CSE 413: Computer Networks
Advertisements

Electronic Visualization Laboratory University of Illinois at Chicago EVL Optical Networking Research Oliver Yu Electronic Visualization Laboratory University.
Appropriateness of Transport Mechanisms in Data Grid Middleware Rajkumar Kettimuthu 1,3, Sanjay Hegde 1,2, William Allcock 1, John Bresnahan 1 1 Mathematics.
Review of Topology and Access Techniques / Switching Concepts BSAD 141 Dave Novak Sources: Network+ Guide to Networks, Dean 2013.
 What Is Desktop Virtualization?  How Does Application Virtualization Help?  How does V3 Systems help?  Getting Started AGENDA.
Desktop Computing Strategic Project Sandia National Labs May 2, 2009 Jeremy Allison Andy Ambabo James Mcdonald Sandia is a multiprogram laboratory operated.
IP –Based SAN extensions and Performance Thao Pham CS 622 Fall 07.
Hands-On Microsoft Windows Server 2003 Networking Chapter 1 Windows Server 2003 Networking Overview.
1© Copyright 2015 EMC Corporation. All rights reserved. SDN INTELLIGENT NETWORKING IMPLICATIONS FOR END-TO-END INTERNETWORKING Simone Mangiante Senior.
Networking and Internetworking Devices Networks and Protocols Prepared by: TGK First Prepared on: Last Modified on: Quality checked by: Copyright 2009.
1 NSF CHEETAH project “End-To-End Provisioned Optical Network Testbed for Large-Scale eScience Applications” Xuan Zheng & Malathi Veeraraghavan Univ. of.
5/8/2006 Nicole SAN Protocols 1 Storage Networking Protocols Nicole Opferman CS 526.
The Importance Of Transactions In The World Of Analytics Doug Aoyama Director, Product Marketing.
C OLUMBIA U NIVERSITY Lightwave Research Laboratory Embedding Real-Time Substrate Measurements for Cross-Layer Communications Caroline Lai, Franz Fidler,
V. Chandrasekar (CSU), Mike Daniels (NCAR), Sara Graves (UAH), Branko Kerkez (Michigan), Frank Vernon (USCD) Integrating Real-time Data into the EarthCube.
High performance video transmission technology SVFTP (Swift Video File Transmission Protocol) KDDI R&D Laboratories Inc.
CS448 Computer Networking Chapter 1 Introduction to Computer Networks Instructor: Li Ma Office: NBC 126 Phone: (713)
NORDUnet NORDUnet The Fibre Generation Lars Fischer CTO NORDUnet.
Towards a Common Communication Infrastructure for Clusters and Grids Darius Buntinas Argonne National Laboratory.
O AK R IDGE N ATIONAL L ABORATORY U. S. D EPARTMENT OF E NERGY DOE-UltraScience Net (& network infrastructure) Update JointTechs Meeting February 15, 2005.
Copyright © 2011 EMC Corporation. All Rights Reserved. MODULE – 6 VIRTUALIZED DATA CENTER – DESKTOP AND APPLICATION 1.
Enabling Cloud and Grid Powered Image Phenotyping Nirav Merchant iPlant Collaborative
Slide 1 DESIGN, IMPLEMENTATION, AND PERFORMANCE ANALYSIS OF THE ISCSI PROTOCOL FOR SCSI OVER TCP/IP By Anshul Chadda (Trebia Networks)-Speaker Ashish Palekar.
A Transport Framework for Distributed Brokering Systems Shrideep Pallickara, Geoffrey Fox, John Yin, Gurhan Gunduz, Hongbin Liu, Ahmet Uyar, Mustafa Varank.
Today’s Topics Chapter 8: Networks Chapter 8: Networks HTML Introduction HTML Introduction.
Electronic visualization laboratory, university of illinois at chicago A Case for UDP Offload Engines in LambdaGrids Venkatram Vishwanath, Jason Leigh.
UVA work items  Provisioning across CHEETAH and UltraScience networks Transport protocol for dedicated circuits: Fixed-Rate Transport Protocol (FRTP)
D EPT. OF I NFO. & C OMM., KJIST Access Grid with High Quality DV Video JongWon Kim, Ph.D. 17 th APAN Meeting /JointTech WS Jan. 29 th, 2004 Networked.
PPDG and ATLAS Particle Physics Data Grid Ed May - ANL ATLAS Software Week LBNL May 12, 2000.
Team Principal investigator and team leader: Ahmed Elmagarmid Task leaders –Park –Spafford –Ghafoor –Korb –Research team: 18 faculty members.
Chapter 1 Communication Networks and Services Network Architecture and Services.
1 Making Networks Smarter. Trends Everything is moving to the network –Telephony –Video –Web services (and further.
Network Performance for ATLAS Real-Time Remote Computing Farm Study Alberta, CERN Cracow, Manchester, NBI MOTIVATION Several experiments, including ATLAS.
Networks and Protocols CE Week 5a. WAN’s and ISDN.
Office of Science U.S. Department of Energy ESCC Meeting July 21-23, 2004 Network Research Program Update Thomas D. Ndousse Program Manager Mathematical,
1 Presented By: Eyal Enav and Tal Rath Eyal Enav and Tal Rath Supervisor: Mike Sumszyk Mike Sumszyk.
Online-Offsite Connectivity Experiments Catalin Meirosu *, Richard Hughes-Jones ** * CERN and Politehnica University of Bucuresti ** University of Manchester.
Hot Interconnects TCP-Splitter: A Reconfigurable Hardware Based TCP/IP Flow Monitor David V. Schuehler
Core 3: Communication Systems. Network software includes the Network Operating Software (NOS) and also network based applications such as those running.
CCNA4 v3 Module 6 v3 CCNA 4 Module 6 JEOPARDY K. Martin.
TeraScale Supernova Initiative: A Networker’s Challenge 11 Institution, 21 Investigator, 34 Person, Interdisciplinary Effort.
CS1001 Lecture 7. Overview Computer Networks Computer Networks The Internet The Internet Internet Services Internet Services Markup Languages Markup Languages.
A demonstrator for IST 2001 G. Romier UREC Lyon. What is IST2001? the IST projects Exhibition is dedicated to displaying the results of projects within.
DOE UltraScience Net The Need –DOE large-scale science applications on supercomputers and experimental facilities require high-performance networking Petabyte.
Roadmap to Next Generation Internet: Indian Initiatives Subbu C-DAC, India.
NORDUnet NORDUnet e-Infrastrucure: Grids and Hybrid Networks Lars Fischer CTO, NORDUnet Fall 2006 Internet2 Member Meeting, Chicago.
1 Device Controller I/O units typically consist of A mechanical component: the device itself An electronic component: the device controller or adapter.
Southern California Infrastructure Philip Papadopoulos Greg Hidley.
Presented by DOE UltraScience Net: High-Performance Experimental Network Research Testbed Nagi Rao Computer Science and Mathematics Division Complex Systems.
Cyberinfrastructure Overview of Demos Townsville, AU 28 – 31 March 2006 CREON/GLEON.
Office of Science U.S. Department of Energy High-Performance Network Research Program at DOE/Office of Science 2005 DOE Annual PI Meeting Brookhaven National.
CRISP WP18, High-speed data recording Krzysztof Wrona, European XFEL PSI, 18 March 2013.
1 Network Measurement Challenges LHC E2E Network Research Meeting October 25 th 2006 Joe Metzger Version 1.1.
Network Processing Systems Design
Network customization
Latency and Communication Challenges in Automated Manufacturing
Clouds , Grids and Clusters
Thin-client based remote volume visualization over wide-area networks
Distributed Systems.
Data Plane Testing on USN, ESnet, and Internet2 Networks
Introduction to Networks
Project overview Agenda Project goals How we plan to work together
Storage Networking Protocols
Lecture 1 Overview of Communication Networks and Services
Performance Evaluation of Computer Networks
Wide-Area Networking at SLAC
Performance Evaluation of Computer Networks
Cost Effective Network Storage Solutions
EEC4113 Data Communication & Multimedia System Chapter 1: Introduction by Muhazam Mustapha, July 2010.
Network customization
Presentation transcript:

John D. McCoy Principal Investigator Tom McKenna Project Manager UltraScienceNet Research Testbed Enabling Computational Genomics Project Overview

2 ObjectiveObjective To research, design, and build a network research testbed over the DOE UltraScienceNet to enable computational genomic applications. This testbed will enable researchers to test and demonstrate applications that cause significant problems for traditional TCP/IP networks.

3 UltraScience Network Chicago Sunnyvale Atlanta ANL FNAL ORNL LBNL SLAC PNNL Access via Site-Funded Connection UltraScienceNet Backbone DOE National Lab Research Exchange Point Seattle

4 Genomics Application Testbed Research Focus Application drivers Cell biology using high-speed spectral confocal microscope Proteomics research using mass spectrometry Research focus Transport methods for remote instrument control High throughput protocols Visualization over dedicated channels

5 metmet

6 We will deliver a proof of concept Microscope prototype demonstration Exert remote control of high speed microscope in real time Near-real time visualization of the experiment Send high quality data to a network cluster for 3D rendering Store the high quality image for further analysis & replay Three Year Project – Design, Develop, Research

7 Nikon Confocal Microscope

8

9

10

11 Issues / Design Considerations Real time data transfer Gbps speed Bulk Data Transfer Will be approaching petabyte sizes Data Availability Must be able to return image data quickly with high quality Remote Instrument Operation Need real time transfer of control signals No packet loss or delay jitter Remote Visualization Need near real-time access to visualizations of running experiments to gain collective insights into cellular responses, and to make immediate decisions regarding the future course of the experiment.

12 PNNL USN Research Partnerships Growing the Program ORNL and Nagi Rao USN Connectivity, Visualization, Research Agenda Robert Grossman Univ. of Illinois - Chicago Incorporating UDT into network research testbed Scott Budge Utah State University FPGA and Streaming Richard Mount SLAC Bulk data management

13 Current Status Cross functional team of biologists, SW & HW developers, network engineers, graphics engineers is in place. Completed requirements specifications. Completed UltraScienceNet API Completed “remotizing” of confocal microscope application Completed microscope emulator Software Configuration Management system running USN Connectivity Completed Microscope Fiber Connectivity Completed. Current focus areas are on image capture and streaming Research agenda and collaborations ongoing.

14 Taking a Phased Approached Toward Enabling Network Research Taking a Phased Approached Toward Enabling Network Research Phase 1 entails establishing the connectivity of the CaMatic software from a remote workstation to a server running software that emulates the confocal microscope over TCP/IP via the USN API. Currently working. Phase 2 includes streaming the real-time visualization imagery of the microscope via the USNAPI from the microscope to the remote workstation. Under Development. Phase 3 This will prove our ability to move large amounts of data off and on the machines utilizing 10GB network cards (Intel LR). Under Development. Phase 4 Test other protocols such as UDP and RTP - start executing research agenda. Year 3 of project.

15 Research Areas – In the Context of Genomics Need to Address: Storage, bus, and NIC optimizations Throughput vs speed Bandwidth allocation Latency (round trip response times) Remote sensing and instrumentation in a high speed, circuit switched network Logic for choosing control protocols Logic for choosing transport protocols Secure access rights to certain types of data - enable secure collaboration Cyber Security – IDS, IPS, Authentication, etc. Deployment and impact upon the biologist. Your input into research agenda is welcomed

16 IMPACTIMPACT The testbed will provide researchers and developers with an experimental infrastructure to provision on-demand, dedicated bandwidth to genomics applications. This work will facilitate genomic discovery by enabling scientists throughout the world to research, teach, and collaborate utilizing state of the art instruments.