GridCastUK-Japan N+N October 20031 Cambridge Newcastle Edinburgh Oxford Glasgow Manchester Cardiff Soton London Belfast DL RL Hinxton.

Slides:



Advertisements
Similar presentations
June Intelligently Connecting Plug-In Vehicles & the Grid.
Advertisements

The SDMX Registry Model April 2, 2009 Arofan Gregory Open Data Foundation.
© 2006 Open Grid Forum GGF18, 13th September 2006 OGSA Data Architecture Scenarios Dave Berry & Stephen Davey.
Introduction to Planets Hans Hofman Nationaal Archief Netherlands Prague, 17 October 2008.
Opening Access to Research or what the institutional repository can do for you Centre for Geospatial Science Sir Clive Granger Building Monday, 24 th September.
INFSO-RI Enabling Grids for E-sciencE Grid & Data Preservation Boon Low System Development, EGEE Training National.
Iron Mountain’s Continuity Service ©2006 Iron Mountain Incorporated. All rights reserved. Iron Mountain and the design of the mountain are registered.
1 Software & Grid Middleware for Tier 2 Centers Rob Gardner Indiana University DOE/NSF Review of U.S. ATLAS and CMS Computing Projects Brookhaven National.
Digital Mathematics Library July 29, 2002 Technical Discussion.
Network Management Overview IACT 918 July 2004 Gene Awyzio SITACS University of Wollongong.
Chronopolis: Preserving Our Digital Heritage David Minor UC San Diego San Diego Supercomputer Center.
Robust Tools for Archiving and Preserving Digital Data Joseph JaJa, Mike Smorul, and Mike McGann Institute for Advanced Computer Studies Department of.
Tools and Services for the Long Term Preservation and Access of Digital Archives Joseph JaJa, Mike Smorul, and Sangchul Song Institute for Advanced Computer.
SuperJANET4 Update Roland Trice, ULCC SuperJANET4 Rollout Manager.
OU Digital Library development project Liz Mallett – Project Manager James Alexander – Project Developer 25 January 2012.
XenData Digital Archives Simplify your video archive workflow XenData LTO Video Archive Solutions Overview © Copyright 2013 XenData Limited.
November 2009 Network Disaster Recovery October 2014.
1SWIM-SUIT Public Launch – 23 April 2007 System Wide Information Management in OATA Bert Nijhof OATA Technical Manager EUROCONTROL DAS/SAS/OCA.
JDF in the Inter-Enterprise Workflow Achieving JDF workflow automation.
Current Job Components Information Technology Department Network Systems Administration Telecommunications Database Design and Administration.
AL-MAAREFA COLLEGE FOR SCIENCE AND TECHNOLOGY INFO 232: DATABASE SYSTEMS CHAPTER 1 DATABASE SYSTEMS (Cont’d) Instructor Ms. Arwa Binsaleh.
STEALTH Content Store for SharePoint using Caringo CAStor  Boosting your SharePoint to the MAX! "Optimizing your Business behind the scenes"
Grid Data Management A network of computers forming prototype grids currently operate across Britain and the rest of the world, working on the data challenges.
Managing Research Data – The Organisational Challenge at Oxford James A J Wilson Friday 6 th December,
A disaggregated model for preservation of E-Prints Gareth Knight SHERPA DP Project Arts and Humanities Data Service.
GT Components. Globus Toolkit A “toolkit” of services and packages for creating the basic grid computing infrastructure Higher level tools added to this.
The Data Grid: Towards an Architecture for the Distributed Management and Analysis of Large Scientific Dataset Caitlin Minteer & Kelly Clynes.
MOME MOME: An advanced measurement meta-repository IPS-MoMe Workshop, Warsaw, Poland March 14, 2005 Felix Strohmeier Authors:
Production Data Grids SRB - iRODS Storage Resource Broker Reagan W. Moore
INFRASTRUCTURE FOR GIS INTEROPERABLITY APPLICATION FACULTY OF INFORMATION AND COMMUNICATION TECHNOLOGY (FTMK) THE TECHNICAL UNIVERSITY OF MALAYSIA MELAKA.
Web: Minimal Metadata for Data Services Through DIALOGUE Neil Chue Hong AHM2007.
E.Soundararajan R.Baskaran & M.Sai Baba Indira Gandhi Centre for Atomic Research, Kalpakkam.
Chapter 5 McGraw-Hill/Irwin Copyright © 2011 by The McGraw-Hill Companies, Inc. All rights reserved.
Ames Research CenterDivision 1 Information Power Grid (IPG) Overview Anthony Lisotta Computer Sciences Corporation NASA Ames May 2,
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
1 GRID Based Federated Digital Library K. Maly, M. Zubair, V. Chilukamarri, and P. Kothari Department of Computer Science Old Dominion University February,
How to Implement an Institutional Repository: Part II A NASIG 2006 Pre-Conference May 4, 2006 Technical Issues.
Introduction to Grids By: Fetahi Z. Wuhib [CSD2004-Team19]
GGF Telco-CG and TMF. Agenda Who is the GGF? Telco CG: Review of Charter, Discussion of Milestones Review of the Whitepaper on Role of Telco in the Global.
EUDAT receives funding from the European Union's Horizon 2020 programme - DG CONNECT e-Infrastructures. Contract No The pan-European.
Replica Management Kelly Clynes. Agenda Grid Computing Globus Toolkit What is Replica Management Replica Management in Globus Replica Management Catalog.
26/05/2005 Research Infrastructures - 'eInfrastructure: Grid initiatives‘ FP INFRASTRUCTURES-71 DIMMI Project a DI gital M ulti M edia I nfrastructure.
GRID ANATOMY Advanced Computing Concepts – Dr. Emmanuel Pilli.
3/12/2013Computer Engg, IIT(BHU)1 CLOUD COMPUTING-1.
ICC eTerms Repository Supporting the PKI infrastructure and secure electronic commerce Janjaap Bos Dublin, June 2000.
INFSO-RI Enabling Grids for E-sciencE File Transfer Software and Service SC3 Gavin McCance – JRA1 Data Management Cluster Service.
ACGT Architecture and Grid Infrastructure Juliusz Pukacki ‏ EGEE Conference Budapest, 4 October 2007.
ETERE A Cloud Archive System. Cloud Goals Create a distributed repository of AV content Allows distributed users to access.
Data Infrastructure in the TeraGrid Chris Jordan Campus Champions Presentation May 6, 2009.
Grid Services for Digital Archive Tao-Sheng Chen Academia Sinica Computing Centre
ScotGRID is the Scottish prototype Tier 2 Centre for LHCb and ATLAS computing resources. It uses a novel distributed architecture and cutting-edge technology,
ICAO Seminar on Aeronautical spectrum management (Cairo, 7 – 17 June 2006) SAFIRE Spectrum and Frequency Information Resource (presented by Eurocontrol)
Travel Data Consolidation
DataNet Collaboration
UK Grid: Moving from Research to Production
GGF OGSA-WG, Data Use Cases Peter Kunszt Middleware Activity, Data Management Cluster EGEE is a project funded by the European.
Joseph JaJa, Mike Smorul, and Sangchul Song
Overview: Fedora Architecture and Software Features
Network Requirements Javier Orellana
OGSA Data Architecture Scenarios
ICAO Seminar on Aeronautical spectrum management (Cairo, 7 – 17 June 2006) SAFIRE Spectrum and Frequency Information Resource (presented by Eurocontrol)
Implementing an Institutional Repository: Part II
2. An overview of SDMX (What is SDMX? Part I)
JISC and SOA A view Robert Sherratt.
Item 2.2 of the Agenda Remote access to confidential data for researchers: possible actions under the 7th Framework Programme Pascal JACQUES Unit B 5 15.
Distributed Systems Bina Ramamurthy 4/22/2019 B.Ramamurthy.
Reinhard Scholl, GTSC-7 Chairman
Implementing an Institutional Repository: Part II
How to Implement an Institutional Repository: Part II
EOSC-hub Contribution to the EOSC WGs
Presentation transcript:

GridCastUK-Japan N+N October Cambridge Newcastle Edinburgh Oxford Glasgow Manchester Cardiff Soton London Belfast DL RL Hinxton

GridCastUK-Japan N+N October GridCast Using the Grid in Broadcast Infrastructures BBC Ron Perrott Queen’s University, Belfast Belfast e-Science Centre British Telecom

GridCastUK-Japan N+N October The Grid Scenario: The BBC Nations BBC NI, BBC Scotland and BBC Wales BBC Nations provide customised services in each nation Television programmes are distributed to BBC Nations from BBC Network (London) using dedicated leased ATM circuits.

GridCastUK-Japan N+N October Grid Infrastructure Technical –High-bandwidth network connections inter- connect broadcast locations. –Network bandwidth means geography is less of an issue. Organisational –Less centralised

GridCastUK-Japan N+N October Overview To develop a baseline media grid to support a broadcaster –Manage distributed collections of stored media –Prototype security and access mechanisms –Integrate processing and technical resources –Integrate with media standards and hardware To analyse Quality of Service issues –Analyse remote content distribution infrastructures –Analyse remote service provision –To analyse reactivity, reliability and resilience issues in a grid-based broadcast infrastructure

GridCastUK-Japan N+N October Characteristics Stored media files are Gbytes and increasing –1 hour ~ 200 Gbytes; distributes 1 petabyte /year Management and distribution is significant technically Metadata – location, timings, artists, storage formats etc. is an integral part of broadcast structure Content is a valuable commodity – access, modification, copying must be controlled High levels of quality required

GridCastUK-Japan N+N October High level view of the Infrastructure

GridCastUK-Japan N+N October Broadcasting Grid Services Each Broadcast site is defined by its collection of available services Control services Content services

GridCastUK-Japan N+N October A Virtualised Infrastructure

GridCastUK-Japan N+N October Scenario A Network Schedule is defined –This schedule is the framework for Nation schedules Network Schedules are distributed to BBC Nations –Usually via BBC Nations formulate their schedule A Schedule is Broadcast –By programming local network and content control automation

GridCastUK-Japan N+N October Model of Broadcast Automatic distribution of broadcast schedules –Management of schedule archives –Automatic notification Content is copied from archives to local content storage –Content distribution defined by schedule

GridCastUK-Japan N+N October Broadcast grid issues Business change –A revised organisational model. Services and resources –Each broadcast location gains control….no network schedule. Resilience –Resource sharing and no single programme repository –A BBC Nation can be anywhere! Reliability –Use resources available in other BBC sites or from 3 rd party suppliers Cost –Better use of resources and less need for backup resources –Less dependence on particular vendors or suppliers Customisation –Schedule, local resources, local capabilities Interoperability –Business model facilitates sharing with other broadcasters

GridCastUK-Japan N+N October Broadcast Schedule Services Services to control the exchange and modification of schedules Management of a distributed collections of broadcast schedules Services to plan transport of content between sites Services to deliver stored media to local sites Services to manage collections of stored media Services to distributed content to facilitate resilience Services to prepare content for broadcasting

GridCastUK-Japan N+N October Progress Assessment Software Development Good experience of GT3 Understanding of grid service model GT3 shifting sands has been good and bad Network Infrastructure –Essential network infrastructure in place BBCNI---BeSC link in place Janet link complete soon

GridCastUK-Japan N+N October Model: Grid Service Operation A schedule is registered with schedule (network) management service Schedule is automatically distributed to (nation) schedule management –Local controller receives notification of schedule availability Nation Controller registers (nation) schedule with local schedule management Transport services develop a transport plan for content movement Scheduled transport service moves content as defined in transport plan

GridCastUK-Japan N+N October Grid Service Operation Index services track grid sites and available services Discovery services locate available copies of broadcast content –Services for nearest, or least busy or … Discovery services identify best transport service to use –Cross mounted file systems, 3 rd party or ftp-type transport. Transport services move work flows associated with content –The necessary operation(s) when content is delivered

GridCastUK-Japan N+N October Grid Service Operation Transport planner incorporates a model of network load –High cost at peak times and low cost at off-peak –Other models in development Content archives are managed as replica archives –Content locations are tracked….content can be withdrawn Content archives permit automatic replication –For resilience and/or QoS Public and private services facilitate operation with public and private networks –Co-ordinating security policies with internal BBC policies