The National e-Science Centre: Role and Activities Dave Berry, Research Manager Indo-UK Workshop on e-Science Delhi, February 2004.

Slides:



Advertisements
Similar presentations
Dr Richard Sinnott Dr Dave Berry 5 th February 2004 National e-Science Centre Local Developments Technical Director National e-Science Centre ||| Deputy.
Advertisements

Abstraction Layers Why do we need them? –Protection against change Where in the hourglass do we put them? –Computer Scientist perspective Expose low-level.
E-Science Data Information and Knowledge Transformation BinX An edikt Project Testbed Ted Wen, Robert Carroll, Denise Ecklund, Bob Gibbins, Davy Virdee,
Research Councils ICT Conference Welcome Malcolm Atkinson Director 17 th May 2004.
National e-Science Centre Glasgow e-Science Hub Opening: Remarks NeSCs Role Prof. Malcolm Atkinson Director 17 th September 2003.
Enterprise Java and Data Services Designing for Broadly Available Grid Data Access Services.
Open Grid Service Architecture - Data Access & Integration (OGSA-DAI) Dr Martin Westhead Principal Consultant, EPCC Telephone: Fax:+44.
NeSC: National e-Science Centre. NeSC Mission Help the UK develop international strength in Grid computing Industry, Commerce, Scientific Research, …
E-Science Data Information and Knowledge Transformation Edikt : e-Science Data, Information and Knowledge Transformation NeSC Review, 30 September 2003.
Grid Engineering Experience & Biological Applications Dr Richard Sinnott Technical Director National e-Science Centre ||| Deputy Director Technical Bioinformatics.
NeSC Data Projects and Initiatives Dr. Dave Berry Research Manager.
OMII-UK Steven Newhouse, Director. © 2 OMII-UK aims to provide software and support to enable a sustained future for the UK e-Science community and its.
Knowledge Exchange and Economic Benefit Dr Mark Parsons Commercial Director EPCC and NeSC.
Introduction to NeSC: The Gateway to UK e-Science Dave Berry, Research Manager HEPix Meeting, May 2004.
National e-Science Centre Arthur Trew Director, EPCC Deputy Director, NeSC.
GEODE Workshop 16 th January 2007 Issues in e-Science Richard Sinnott University of Glasgow Ken Turner University of Stirling.
1 Software & Grid Middleware for Tier 2 Centers Rob Gardner Indiana University DOE/NSF Review of U.S. ATLAS and CMS Computing Projects Brookhaven National.
NextGRID & OGSA Data Architectures: Example Scenarios Stephen Davey, NeSC, UK ISSGC06 Summer School, Ischia, Italy 12 th July 2006.
Requirements from astronomy in the Virtual Observatory era Bob Mann Institute for Astronomy & NeSC University of Edinburgh.
© HATII, University of Glasgow Introduction to the UK ’ s Digital Curation Centre Prof Seamus Ross Visiting Fellow at Oxford Internet Institute ,
UK e-Science Dave Berry, Research Manager National e-Science Centre e-Science: Computational Grid Infrastructure and Scientific & Engineering Applications.
QCDgrid Technology James Perry, George Beckett, Lorna Smith EPCC, The University Of Edinburgh.
Welcome e-Science in the UK Building Collaborative eResearch Environments Prof. Malcolm Atkinson Director 23 rd February 2004.
GridPP Tuesday, 23 September 2003 Tim Phillips. 2 Bristol e-Science Vision National scene Bristol e-Science Centre Issues & Challenges.
A long tradition. e-science, Data Centres, and the Virtual Observatory why is e-science important ? what is the structure of the VO ? what then must we.
Database Taskforce and the OGSA-DAI Project Norman Paton University of Manchester.
1 UK NeSC Meeting, November 18 th, 2004 Terry Sloan EPCC, The University of Edinburgh INWA : using OGSA-DAI in a commercial environment.
Software from Science for Science Steven Newhouse, Director.
Centre Review Dr Anna Kenway Centre Manager 27 May 2005.
Extensible Framework for Data Access & Integration Malcolm Atkinson Director 10 th November 2004.
Astronomical data curation and the Wide-Field Astronomy Unit Bob Mann Wide-Field Astronomy Unit Institute for Astronomy School of Physics University of.
QCDGrid Progress James Perry, Andrew Jackson, Stephen Booth, Lorna Smith EPCC, The University Of Edinburgh.
Sys-Bio Talk, 24 th Feb 2005 Towards Grid-Based System Biology Dr Richard Sinnott Technical Director National e-Science Centre ||| Deputy Director (Technical)
Patterns for E-Research Dave Berry, Research Manager E-Research within the University of Edinburgh, 2 nd March 2005.
Centre Review 30 September 2003 Centre Manager’s Report Dr Anna Kenway.
DAIT (DAI Two) NeSC Review 18 March Description and Aims Grid is about resource sharing Data forms an important part of that vision Data on Grids:
Dr Richard Sinnott Technical Director National e-Science Centre ||| Deputy Director Technical Bioinformatics Research Centre University of Glasgow
E-Science Data Information and Knowledge Transformation Edikt : e-Science Data, Information and Knowledge Transformation E-Science Centres of Excellence.
Future of e-Science Malcolm Atkinson Director 18 th March 2004.
Grid Execution Management for Legacy Code Applications Grid Enabling Legacy Code Applications Tamas Kiss Centre for Parallel.
UK e-Science AHM th September 2005 Comparison of Data Access and Integration Technologies in the Life Science Domain Dr Richard Sinnott Technical.
DAME: A Distributed Diagnostics Environment for Maintenance Duncan Russell University of Leeds.
Usability Talk, 26 th January 2006 Development of Usable Grid Services for the Biomedical Community Prof Richard Sinnott Technical Director National e-Science.
SEEK Welcome Malcolm Atkinson Director 12 th May 2004.
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
Data and the UK e-Science Programme Paul Watson Director North-East Regional e-Science Centre School of Computing Science University of.
AHM September 2004 Grid Services Supporting the Usage of Secure Federated, Distributed Biomedical Data Dr Richard Sinnott Technical Director National e-Science.
Grid Execution Management for Legacy Code Applications Grid Enabling Legacy Applications.
IBM & HSBC visit Malcolm Atkinson Director & e-Science Envoy UK National e-Science Centre & e-Science Institute 30 th March 2006.
European Network Policy Group Malcolm Atkinson Director 28 th October 2004.
1 The Challenge of Data Integration Data + Grid = Discovery? Prof. Malcolm Atkinson Director 22 nd January 2003.
OGSA-DAI & DAIT projects Update for TAG Prof. Malcolm Atkinson Director 30 th October 2003.
OGSA-DAI Users’ Meeting Introduction Malcolm Atkinson Director 7 th April 2004.
National e-Science Institute and National e-Science Centre The Way Ahead Prof. Malcolm Atkinson Director 30 th September 2003.
An Introduction to UK e-Science Anne E Trefethen Deputy Director UK e-Science Core Programme.
NeSC/eDIKT & AstroGrid Phase B NeSC and IBM Grid work NeSC and IBM Grid work NeSC/WFAU sky survey DB design work NeSC/WFAU sky survey DB design work Astro-related.
Toward a common data and command representation for quantum chemistry Malcolm Atkinson Director 5 th April 2004.
Chinese Delegation Visit High Performance Computer Mission UK e-Science & The National e-Science Centre Prof. Malcolm Atkinson Director
Japanese & UK N+N Data, Data everywhere and … Prof. Malcolm Atkinson Director 3 rd October 2003.
GRIDSTART a European GRID coordination attempt Fabrizio Gagliardi CERN.
Welcome Grids and Applied Language Theory Dave Berry Research Manager 16 th October 2003.
Grid Execution Management for Legacy Code Architecture Exposing legacy applications as Grid services: the GEMLCA approach Centre.
RC ICT Conference 17 May 2004 Research Councils ICT Conference The UK e-Science Programme David Wallace, Chair, e-Science Steering Committee.
Welcome & The National e-Science Centre Prof. Malcolm Atkinson Director 6 th November 2003.
The National e-Science Centre. eSI in Edinburgh NeSC Roles National: help coordinate and lead the UK e- Science Programme Community building activities,
Building Castles with Shifting Sands?
Welcome to National e-Science Centre Official Opening
UK e-Science OGSA-DAI November 2002 Malcolm Atkinson
Grid Portal Services IeSE (the Integrated e-Science Environment)
Presentation transcript:

The National e-Science Centre: Role and Activities Dave Berry, Research Manager Indo-UK Workshop on e-Science Delhi, February 2004

Outline: The National e-Science Centre The National e-Science Centre Role and mission The e-Science Institute NeSC projects

NeSC Roles Help coordinate and lead the UK e-Science Programme Community building activities, regional support & outreach Skill building through training events & support centre Help establish the UK’s international role International meetings, standardisation work & presentations Run the e-Science Institute Knowledge building through workshops and conferences Research visitors and events Undertake R&D projects To deliver reliable middleware To engage industry To stimulate the uptake of e-Science technology and methods Emphasis on scientific data management

e-Science Institute A meeting place The focus for presenting UK e-Science Visiting researchers Collaborate in our research and development Engage in and develop our event programme Build bridges with their community Visits last between one week and six months Research-oriented event programme e-Science research topics Training to e-Science research teams

eSI Events held in the 2 nd Year (from 1 Aug 2002 to 31 Jul 2003) We have had 86 events: 11 project meetings 11 research meetings 25 workshops 2 “summer” schools 15 training sessions 12 outreach events 5 international meetings 5 e-Science management meetings (though the definitions are fuzzy!)

eSI Workshops Space for real work Crossing communities Creativity: new strategies and solutions Written reports Scientific Data Mining, Integration and Visualisation Grid Information Systems Portals and Portlets Virtual Observatory as a Data Grid Imaging, Medical Analysis and Grid Environments Open Issues in Grid Scheduling Data Provenance & Annotation e-Science Workflow Services GeoSciences & Scottish Bioinformatics Forum Suggestions always welcome!

eSI Industrial Involvement 194 registered users from 97 companies 133 different delegates have attended events (169 event registrations) from 64 companies including not only IBM, Microsoft, Oracle, Sun, Hewlett- Packard but also … Apple, Astra Zeneca, BAE, Cisco, Honeywell, Motorola, Organon, Pfizer, Siemens

Research visitors Establish a collaboration with NeSC Pre-established mutual interests We encourage diversity of disciplines and interests Complementary experience, knowledge and skills We can help match interests and develop a plan Visitors must already be engaged in relevant R&D This is not a training opportunity Our support depends on the length and value of visit Typically covers travel and/or local living costs Application via our web site

eSI in Edinburgh National e-Science Centre

Outline: NeSC Projects The National e-Science Centre Role and mission The e-Science Institute NeSC Projects

e-Science Projects OGSA-DAI/DAIT, MS.NETGrid, SunDCG, GridWeaver, BRIDGES, PGPGrid, FirstDIG, ODD-Genes EGEE, NextGrid OGSA Test Grid, IBM Early Evaluation edikt Digital Curation Centre, Publishing Scientific Data GridPP, AstroGrid, QCDGrid, RealityGrid Portal Biological Spatio-Temporal Databases CoAKTinG, Grid-enabled Modelling Tools and Databases for Neuroinformatics, e-Diamond Dynamic Configuration of Grid Fabrics, Dependable Grid Services, Deductive Synthesis Techniques, Inferring QoS Properties for Grid Applications, Mobile Resource Guarantees TIES, TIES-II

Digital Curation Centre Industry research collaborators standards bodies testbeds & tools communities of practice: users community support & outreach research development services management & co- ordination curation organisations Collaborative Associates Network of Data Organisations

The Virtual Observatory International Virtual Observatory Alliance UK, Australia, EU, China, Canada, Italy, Germany, Japan, Korea, US, Russia, France, India How to integrate many multi-TB collections of heterogeneous data distributed globally? Sociological and technological challenges to be met

Data Services GGF Data Access and Integration Svcs(DAIS) OGSI-compliant interfaces to access relational and XML databases Needs to be generalized to encompass other data sources Generalized DAIS becomes the foundation for: Replication: Data located in multiple locations Federation: Composition of multiple sources Provenance: How was data generated?

1a. Request to Registry for sources of data about “x” 1b. Registry responds with Factory handle 2a. Request to Factory for access to database 2c. Factory returns handle of GDS to client 3a. Client queries GDS with XPath, SQL, etc 3b. GDS interacts with database 3c. Results of query returned to client as XML SOAP/HTTP service creation API interactions RegistryFactory 2b. Factory creates GridDataService to manage access Grid Data Service Client XML / Relationa l database Data Access & Integration Services

edikt The team: 8 professional software engineers, support staff, project manager, commercialisation manager, architect, and SAB SHEFC funded research and development grant 3 years funding: May 2002 – years funding upon successful project and review Standards Edikt project Requirements analysis Technology matchmaking Gap fillingRigorous engineering CS Research Grid Services for e-Science Data Management Commercial SW components and skills E-Science Apps

Java Framework ELDAS – Data Access Service Implemented using Enterprise Java Beans Data Access Components interface to distinct DBMSs Accessible as a grid data service or a web data service ELDAS DB2 DBMySQL DBXindice DB Web User1 Oracle 9i DB EJB - DAS DAC ELDAS runs anywhere Web Servlet Grid Proxy Grid User1Grid User2 Suitable for grid & web

e-Science Application Binary Data File BinX – accessing legacy binary data The Problem: Many binary data files Applications must “know” the data format Binary data formats are machine-specific BinX Library The Solution: Write a “stand-aside” format description in XML Provide a library to  Interpret the description  Provide file access across different machines Build higher-level services BinX file describes binary file structure simulations

Shared data BRIDGES Glasgow Edinburgh Leicester Oxford London Netherlands Public curated data Private data Private data Private data Private data Private data Private data

Problems specific to Bio-Informatics Community PDB Content Growth DBs growing exponentially!!! Biobliographic (MedLine, …) Amino Acid Seq (SWISS-PROT, …) 3D Molecular Structure (PDB, …) Nucleotide Seq (GenBank, EMBL, …) Biochemical Pathways (KEGG, WIT…) Molecular Classifications (SCOP, CATH,…) Motif Libraries (PROSITE, Blocks, …)

More genomes …... Arabidopsis thaliana mouse rat Caenorhabitis elegans Drosophila melanogaster Mycobacterium leprae Vibrio cholerae Plasmodium falciparum Mycobacterium tuberculosis Neisseria meningitidis Z2491 Helicobacter pylori Xylella fastidiosa Borrelia burgorferi Rickettsia prowazekii Bacillus subtilis Archaeoglobus fulgidus Campylobacter jejuni Aquifex aeolicus Thermotoga maritima Chlamydia pneumoniae Pseudomonas aeruginosa Ureaplasma urealyticum Buchnerasp. APS Escherichia coli Saccharomyces cerevisiae Yersinia pestis Salmonella enterica Thermoplasma acidophilum

System Usage Scenario BRIDGES Portal Client Site X Secure access for CFG VO Shared/ Private Data Sets Personalised Services BLAST Smith W SV DL OGSA-DAI Remote data in Oracle, DB2,Sybase, Excel, flat files, XML... Browser based clients… Authorisation Per user, per site Java App downloaded (via WebStart) Push relevant data onto ScotGrid for BLAST’ing Secure Data Repository Up to date results input to DB wrappers Generic services used by other projects

Website National e-Science Centre Mission, Background, Foundation Locations, Staff, Resources, Projects Register interest, Mailing lists, NeSCForge Regional associations and Collaborations News, Notices Presentations and Lectures e-Science Institute Mission, Events (Future and Past) Register for Events, Visitor Programme UK e-Science Map and Index of Centres Technical Papers Index of >100 Projects Task Forces General Information Glossary, Bibliography, Who’s who E-Science job vacancies

Questions?