CineGrid for Digital Cinema and Beyond Tom DeFanti Research Scientist California Institute for Telecommunications and Information Technology University.

Slides:



Advertisements
Similar presentations
University of Illinois at Chicago The Future of STAR TAP: Enabling e-Science Research Thomas A. DeFanti Principal Investigator, STAR TAP Director, Electronic.
Advertisements

University of Illinois at Chicago Annual Update Thomas A. DeFanti Principal Investigator, STAR TAP Director, Electronic Visualization Laboratory.
Update on Advanced Networking in Singapore L.W.C. Wong & F.B.S. Lee Singapore Advanced Research & Education Network.
Ronn Ritke Tony McGregor NLANR/MNA (UCSD/SDSC) Funded by the National Science Foundation/CISE/SCI cooperative agreement no. ANI
Calit2-Living in the Future " Keynote Sharecase 2006 University of California, San Diego March 29, 2006 Dr. Larry Smarr Director, California Institute.
Why Optical Networks Are Emerging as the 21 st Century Driver Scientific American, January 2001.
StarLight Located in Abbott Hall, Northwestern University’s Chicago Campus Operational since summer 2001, StarLight is a 1GigE and 10GigE switch/router.
AHM Overview OptIPuter Overview Third All Hands Meeting OptIPuter Project San Diego Supercomputer Center University of California, San Diego January 26,
Understanding ULTRA HD. Resolution – According to the CEA An Ultra HD TV must support a minimum pixel count of 3840 Horizontally 2160 Vertically.
EInfrastructures (Internet and Grids) US Resource Centers Perspective: implementation and execution challenges Alan Blatecky Executive Director SDSC.
Global Lambda Integrated Facility (GLIF) Kees Neggers SURFnet Internet2 Fall meeting Austin, TX, 27 September 2004.
Electronic Commerce Semester 1 Term 1 Lecture 2. Forces Fuelling E-Commerce Interest in e-commerce is being fuelled by: –Economic forces –Customer interaction.
Lecturer: Tamanna Haque Nipa
0 23 February, 2006 Tetsuro Fujii NTT Network Innovation Laboratory 4K Pure Cinema Joint Field Trial NTT-WB-TOHO Digital Cinema Distribution over International.
1 International Real-Time Streaming of 4K Digital Cinema iGrid September 2005 Calit2, University of California, San Diego, CA ORGANIZERS Keio.
“How LambdaGrids are Transforming Science" Keynote iGrid2005 La Jolla, CA September 29, 2005 Dr. Larry Smarr Director, California Institute.
Computing in Atmospheric Sciences Workshop: 2003 Challenges of Cyberinfrastructure Alan Blatecky Executive Director San Diego Supercomputer Center.
Supercomputing Center Jysoo Lee KISTI Supercomputing Center National e-Science Project.
Copyright © 2006 Keio University APRU New Initiatives and Open Forum Session New Initiatives for Global Knowledge Sharing by Research Institute.
Summit 2009 Building a New User Community for Very High Quality Media Applications On Very High Speed Networks October 7, 2009 Jim DeRoest ResearchChannel.
Next Generation Peering for Next Generation Networks Jacqueline Brown Executive Director International Partnerships Pacific Northwest Gigapop CANS2004,
The Singapore Advanced Research & Education Network.
Developing a North American Global LambdaGrid Dr. Larry Smarr Director, California Institute for Telecommunications and Information Technology Harry E.
Pacific NorthWest Gigapop, Pacific Wave & International Peering David Morton, PNWGP RENU Technology Workshop.
Chicago/National/International OptIPuter Infrastructure Tom DeFanti OptIPuter Co-PI Distinguished Professor of Computer Science Director, Electronic Visualization.
CineGrid: An Innovative High End Digital Media Collaboration Presentation Sixth Meeting of the University-Industry Demonstration Partnership (UIDP): The.
Innovative Research Alliances Invited Talk IUCRP Fellows Seminar UCSD La Jolla, CA July 10, 2006 Dr. Larry Smarr Director, California Institute for Telecommunications.
A Wide Range of Scientific Disciplines Will Require a Common Infrastructure Example--Two e-Science Grand Challenges –NSF’s EarthScope—US Array –NIH’s Biomedical.
Delivering Circuit Services to Researchers: The HOPI Testbed Rick Summerhill Director, Network Research, Architecture, and Technologies, Internet2 Joint.
MAIN TECHNICAL CHARACTERISTICS Next generation optical transport networks with 40Gbps capabilities are expected to be based on the ITU’s.
DataTAG Research and Technological Development for a Transatlantic Grid Abstract Several major international Grid development projects are underway at.
Copyright 2004 National LambdaRail, Inc N ational L ambda R ail Update 9/28/2004 Debbie Montano Director, Development & Operations
PacificWave Update John Silvester University of Southern California Chair, CENIC Internet2 - ITF, Philadelphia,
Naohisa Ohta The Digital Cinema Lab Research Institute for Digital Media and Content Keio University, Tokyo 4k Streaming on IP Networks iGrid2005 Panel:
Research Institute for Digital Media and Content Keio University Tokyo, Japan Naohisa Ohta
TOPS “Technology for Optical Pixel Streaming” Paul Wielinga Division Manager High Performance Networking SARA Computing and Networking Services
IGENI and GENI Cluster-D Network (GCDnet) Update for GEC 8, Including S2 Status & S3 Plans Joe Mambretti, Director,
Cyberinfrastructure What is it? Russ Hobby Internet2 Joint Techs, 18 July 2007.
3 December 2015 Examples of partnerships and collaborations from the Internet2 experience Interworking2004 Ottawa, Canada Heather Boyles, Internet2
August 3, March, The AC3 GRID An investment in the future of Atlantic Canadian R&D Infrastructure Dr. Virendra C. Bhavsar UNB, Fredericton.
Advanced Networks: The Past and the Future – The Internet2 Perspective APAN 7 July 2004, Cairns, Australia Douglas Van Houweling, President & CEO Internet2.
STAR TAP, Euro-Link, and StarLight Tom DeFanti April 8, 2003.
University of Illinois at Chicago StarLight: Applications-Oriented Optical Wavelength Switching for the Global Grid at STAR TAP Tom DeFanti, Maxine Brown.
The OptIPuter Project Tom DeFanti, Jason Leigh, Maxine Brown, Tom Moher, Oliver Yu, Bob Grossman, Luc Renambot Electronic Visualization Laboratory, Department.
26/05/2005 Research Infrastructures - 'eInfrastructure: Grid initiatives‘ FP INFRASTRUCTURES-71 DIMMI Project a DI gital M ulti M edia I nfrastructure.
CineGrid HPA Tech Retreat 2006 Laurin Herr President, Pacific Interface Inc.
Electronic Visualization Laboratory, University of Illinois at Chicago Pacific Research Platform Scalable Visualization and Virtual-Reality Team
© 2006 Cisco Systems, Inc. All rights reserved.Cisco ConfidentialPresentation_ID 1 C-Wave Overview Kevin McGrattan Consulting System Engineer January 22,
“ Ultra-Broadband and Peta-Scale Collaboration Opportunities Between UC and Canada Summary Talk Canada - California Strategic Innovation Partnership Summit.
When we communicate, we are sharing information. This sharing can be local or remote. Between individuals, local communication usually occurs face to face,
“The UCSD Big Data Freeway System” Invited Short Talk Workshop on “Enriching Human Life and Society” UC San Diego February 6, 2014 Dr. Larry Smarr Director,
“ OptIPuter Year Five: From Research to Adoption " OptIPuter All Hands Meeting La Jolla, CA January 22, 2007 Dr. Larry Smarr Director, California.
Securing the Grid & other Middleware Challenges Ian Foster Mathematics and Computer Science Division Argonne National Laboratory and Department of Computer.
GOLE and Exchange Architectures John Silvester Professor of Electrical Engineering, USC Board Member, CENIC PI, TransLight/PacificWave (NSF-OCI-IRNC)
National LambdaRail, Inc – Confidential & Proprietary National LambdaRail 4/21/2004 Debbie Montano light the future N L.
TransLight Tom DeFanti 50 years ago, 56Kb USA to Netherlands cost US$4.00/minute Now, OC-192 (10Gb) costs US$2.00/minute* That’s 400,000 times cheaper.
Southern California Infrastructure Philip Papadopoulos Greg Hidley.
Internet2. Yesterday’s Internet  Thousands of users  Remote login, file transfer  Applications capitalize on underlying technology.
Network Models. The OSI Model Open Systems Interconnection (OSI). Developed by the International Organization for Standardization (ISO). Model for understanding.
University of Illinois at Chicago Lambda Grids and The OptIPuter Tom DeFanti.
Northwest Indiana Computational Grid Preston Smith Rosen Center for Advanced Computing Purdue University - West Lafayette West Lafayette Calumet.
Internet2 Members Meeting Washington, DC 1 Advanced Networking Infrastructure and Research (ANIR) Aubrey Bush Division Director, ANIR National Science.
Use of high speed photonic networks for efective use of very high quality media production Michal Krsek (CESNET) Mirek Sochor (CESNET/UPP)
“OptIPuter: From the End User Lab to Global Digital Assets" Panel UC Research Cyberinfrastructure Meeting October 10, 2005 Dr. Larry Smarr.
May 17, 2010 Michal Krsek CESNET Use of high speed photonic networks for effective use of very high quality media production.
Maxine Brown, Tom DeFanti, Joe Mambretti
C-Wave Overview Kevin McGrattan Consulting System Engineer
TOPS “Technology for Optical Pixel Streaming”
Optical SIG, SD Telecom Council
TOPS “Technology for Optical Pixel Streaming”
Presentation transcript:

CineGrid for Digital Cinema and Beyond Tom DeFanti Research Scientist California Institute for Telecommunications and Information Technology University of California, San Diego Distinguished Professor Emeritus of Computer Science University of Illinois at Chicago

The CineGrid  Initiative CineGrid is an initiative to provide media professionals access to global cyber-infrastructure capable of carrying ultra-high performance digital media using the photonic networks, middleware, transport protocols and collaboration tools originally developed for scientific research, visualization, and Grid computing. In the process, “learn by doing,” train the next generation, and cultivate global inter-disciplinary communities to help advance the state of the art CineGrid is people, facilities, networks and a not-for-profit organization

Economic Impact of Cinema in California Major Employment from Movie Industry in California by County In 2004, more than 236 new movies were produced in the State of California. In 2005 movie production provided employment for over 245,000 Californians, with an associated payroll of more than $17 billion. Typical big movies each spend more than $60 million on production, have a long-term $200 million economic impact, create more than 900 full-time jobs, and yield $11 million in state sales taxes and income taxes when fully made in California.

CENIC Already Connects California Schools and Research Labs Calit2 UCI USC SFSU Calit2 UCSD Systems developed for CineGrid can be applied to scientific visualization and distance learning in many fields Useful information exchange between communities looking at “extreme” digital media problems from different perspectives CineGrid demonstrations will focus developers, driving a virtuous cycle of “learning by doing”

The CineGrid Node at UCSD/Calit2 200 Seats, 8.2 Sound, Sony SXRD 4K projector, SGI Prism w/21TB, 10GE connectivity, NTT JPEG 2000 codecs

The CineGrid Node at Keio University, Tokyo Japan SXRD-105 4K Projector Imagica 4K Film Scanner Sony 4K Projectors Olympus 4K Cameras NTT JPEG2000 Codec

SAGE OptIPortal Software: 10 Wireless Laptop Users All Pushing Their Desktops to the EVL OptIPortal--Goal is a Distributed Gigapixel in 2007 Source: Luc Renambot, EVL A possible model for 4K workflow?

Los Angeles Seattle CineGrid Cisco GigE Cisco NLR Wave 1& 10 GigE CENIC Waves IEEAF Wave via PNWGP/TLEX CAVEwave (CENIC and NLR via PNWGP) CineGrid Infrastructure Sunnyvale CalIT2 San Diego Cisco is building two 10 GigE "Cisco Waves” on NLR on the West Coast and switches for access points in San Diego, Los Angeles, Sunnyvale, & Seattle for CineGrid CENIC is making available persistent 1 GigE access ports in San Diego, Los Angeles, Sunnyvale, & San Francisco for CineGrid and the fiber for 2x10GigE between UCSD and LA Via GLIF, CineGrid extends to Japan via Seattle & Chicago; to Canada via Seattle & Chicago; to Europe via Chicago & Amsterdam. Further extension likely to China, Korea, Singapore, India, New Zealand, Australia, others. Tokyo Chicago Toronto JGN2 CA*net4

CineGrid Drivers High-performance media is historically driven by three markets –1) Entertainment, media, art and culture –2) Science, medicine, education and research –3) Military, intelligence, security and police All three are in digital convergence and all need: –Fast networking with similar profiles –Access shared instruments, specialized computers and massive storage –Collaboration tools for distributed, remote teams –Robust security to protect intellectual property –Upgraded systems to allow higher quality, greater speed, more distributed applications –A next generation of trained professionals

CineGrid Target Applications Store-and-forward secure content delivery Streaming secure content transmission Pre-production collaborative design & planning Studio and remote production of sound and picture Digital dailies, interactive viewing & mark-up Distributed post production of audio/video Digital film scanning and restoration Digital media archiving Remote calibration and quality control of audio/video Education of next generation professionals These and other CineGrid applications will challenge the engineering of networked systems at every level

DCI Digital Cinema Specification 2005 “DIGITAL CINEMA INITIATIVES (DCI) ANNOUNCES FINAL OVERALL SYSTEM REQUIREMENTS AND SPECIFICATIONS FOR DIGITAL CINEMA Agreement Gives Manufacturers of Digital Projectors and Theater Equipment One Universal Standard in Creating the Next Generation of Cinemas (Hollywood, CA - July 27, 2005) Digital Cinema Initiatives, LLC (DCI) is a joint venture of Disney, Fox, Paramount, Sony Pictures Entertainment, Universal and Warner Bros. Studios. DCI's primary purpose is to establish and document voluntary specifications for an open architecture for digital cinema that ensures a uniform and high level of technical performance, reliability and quality control.” Image format: 2048x1080 (2K) and 4096x2160 (4K) Color: 12-bits/color, 4:4:4, SMPTE XYZ Frame rate: 24fps or 48fps for stereo Compression: JPEG 2000 up to maximum of 250 Mbps for distribution Encryption: AES 128 for Digital Cinema Package; SHA-2 (256bit) for Key Watermarking: invisible injection of time/screen ID in projected image

More: TV and Motion Picture Bit Rates (Data from Laurin Herr, Pacific Interface, Inc.)

Test your existing network connection to Calit2, for example. Use IPERF several times to test UDP and TCP performance. If performance is sub-gigabit/s, use NLR and CENIC, for example, to connect to Calit2. Engineering CineGrid Example You

Create a new vlan for your local network This will bypass local firewalls, expose local switches’ capabilities, motivate new fiber/copper runs, allow fat UDP Remember, GigE is more than most campuses or businesses connect to the outside. Engineering CineGrid: 2 You

Either extend this new vlan to Calit2 or route this local vlan to a shared vlan with Calit2. This obviously takes great cooperation among the institutions and circuit owners. CineGrid is ALL about arranging cooperation. Engineering CineGrid: 3 You

Ensure all vlans support Maximum Transmission Unit (mtu) of 9216 (“jumbo frame enabled”). Ensure all physical interfaces have mtu 9216 support as well. Engineering CineGrid: 4 You

Set up at least one IP interface to the vlan. Test the end-to- end connection again with IPERF. IP interface Engineering CineGrid: 5 You

Send / receive content IP interface Engineering CineGrid: Finale Source: Brian Dunne, Calit2 You

CineGrid.org Starting in 2007 CineGrid will be established as a non-profit international membership organization administratively based in California, starting early To support members’ research, CineGrid will organize network testbeds prepared to host a variety of experimental digital media projects designed to require very high bandwidth with appropriate security safeguards between a limited number of “trusted” users and systems around the globe. CineGrid will periodically organize inter-disciplinary workshops and demonstrations to share results and identify new avenues of research. Education and training of next- generation media professionals is our explicit goal.

Thank You Very Much! Our planning, research, and education efforts are made possible, in major part, by funding from: –US National Science Foundation (NSF) awards ANI , EIA , and SCI –State of California, Calit2 UCSD Division –State of Illinois I-WIRE Program, and major UIC cost sharing Argonne National Laboratory and Northwestern University for StarLight and I-WIRE networking and management National Lambda Rail, Pacific Wave and CENIC NTT Network Innovations Lab Cisco Systems, Inc. Pacific Interface, Inc.

CineGrid Networking As Prototyped by the OptIPuter Project 4K JPEG2000 compressed video is 500Mb/s—peaks to a gigabit/s Uncompressed needs 6Gb/s or more Most campus networks use Mb/s lans to labs. Some have 1Gb/s. Most campus networks have 155Mb/s, 622Mb/s or 1Gb/s connections –Internet connectivity is usually 10s to 100s of Mb/s –Internet2 connectivity is usually 100s of Mb/s to 1Gb/s –A few campuses have 10Gb/s connectivity to Internet2 and/or NLR Future connections will widely support 10Gb/s, but not today However, bandwidth is not the only issue –Need to use protocols that handle the bandwidth (UDP, not TCP) –It’s rude to use large-flow UDP on shared networks –Firewalls are a problem; large-flows are often shut down –Need fiber/copper to the end device(s) from the campus main switch So, at this point, we use virtual local area network (vlan) “layer2” tech –Arguably not scalable, but works, controllable by GMPLS –MPLS has been shown to work as well (with big core routers)