An short overview of INSTRUCT and its computational requirements Alexandre M.J.J. Bonvin Project coordinator Bijvoet Center for Biomolecular Research Faculty.

Slides:



Advertisements
Similar presentations
A Worldwide e-Infrastucture for NMR and structural biology Project Coordinator: Prof. Alexandre M.J.J. Bonvin, Utrecht University, NL
Advertisements

IPlant Collaborative Tools and Services Workshop iPlant Collaborative Tools and Services Workshop Collaborating with iPlant.
SICSA student induction day, 2009Slide 1 Social Simulation Tutorial Session 6: Introduction to grids and cloud computing International Symposium on Grid.
European Life Sciences Infrastructure for Biological Information ELIXIR
1 Common Challenges Across Scientific Disciplines Laurence Field CERN 18 th November 2013.
Climate Sciences: Use Case and Vision Summary Philip Kershaw CEDA, RAL Space, STFC.
IPlant Collaborative Tools and Services Workshop iPlant Collaborative Tools and Services Workshop Collaborating with iPlant.
IPlant Collaborative Tools and Services Workshop iPlant Collaborative Tools and Services Workshop Collaborating with iPlant.
The Future of the iPlant Cyberinfrastructure: Coming Attractions.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks ?? Athens, May 5-6th 2009 Community Support.
R. Keegan 1, J. Bibby 3, C. Ballard 1, E. Krissinel 1, D. Waterman 1, A. Lebedev 1, M. Winn 2, D. Rigden 3 1 Research Complex at Harwell, STFC Rutherford.
E-HTPX: A User Perspective Robert Esnouf, University of Oxford.
 Our mission Deploying and unifying the NMR e-Infrastructure in System Biology is to make bio-NMR available to the scientific community in.
ESFRI & e-Infrastructure Collaborations, EGEE’09 Krzysztof Wrona September 21 st, 2009 European XFEL.
A worldwide e-Infrastructure for NMR and structural biology A worldwide e-Infrastructure for NMR and structural biology Introduction Structural biology.
Structural Biology on the GRID Dr. Tsjerk A. Wassenaar Biomolecular NMR - Utrecht University (NL)
Towards a Structural Biology Work Bench Chris Morris, STFC.
Computing at SSRL: Experimental User Support Timothy M. McPhillips Stanford Synchrotron Radiation Laboratory.
© Copyright AARNet Pty Ltd PRAGMA Update & some personal observations James Sankar Network Engineer - Middleware.
Ian Bird CERN, 17 th July 2013 July 17, 2013
The WeNMR HADDOCK portal goes crowd computing Alexandre M.J.J. Bonvin Project coordinator Bijvoet Center for Biomolecular Research Faculty of Science,
Northwest Indiana Computational Grid Preston Smith Rosen Center for Advanced Computing Purdue University - West Lafayette West Lafayette Calumet.
Get Data to Computation eudat.eu/b2stage B2STAGE How to shift large amounts of data Version 4 February 2016 This work is licensed under the.
West-Life: A VRE for Structural Biology Alexandre Bonvin, Utrecht University Chris Morris STFC EGI Community Forum Bari, November
EUDAT receives funding from the European Union's Horizon 2020 programme - DG CONNECT e-Infrastructures. Contract No West-Life.
ERA-Instruments Thomas Gübitz, Johannes Janssen, Christian Renner, Bonn, 4 Februar 2008 Infrastructure Funding in the Life Sciences.
A worldwide e-Infrastructure and Virtual Research Community for NMR and structural biology Alexandre M.J.J. Bonvin Project coordinator Bijvoet Center for.
Structural Biology on the Grid Christophe Schmitz Bijvoet Center for Biomolecular Research Faculty of Science, Utrecht University The Netherlands
DutchGrid KNMI KUN Delft Leiden VU ASTRON WCW Utrecht Telin Amsterdam Many organizations in the Netherlands are very active in Grid usage and development,
Requirements from the WeNMR VRC User Forum 2011, Vilnius Workshop.
INTRODUCTION TO XSEDE. INTRODUCTION  Extreme Science and Engineering Discovery Environment (XSEDE)  “most advanced, powerful, and robust collection.
EGI-InSPIRE RI EGI Compute and Data Services for Open Access in H2020 Tiziana Ferrari Technical Director, EGI.eu
Meeting of the ESFRI Social Sciences and Humanities Projects, City University London, 27/01/2009 Report to the Legal Workshop, Brussels, 6 th February.
Project Database Handler The Project Database Handler is a brokering application which will mediate interactions between the project database and other.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI Overview for ENVRI Gergely Sipos, Malgorzata Krakowian EGI.eu
1 The Life-Science Grid Community Tristan Glatard 1 1 Creatis, CNRS, INSERM, Université de Lyon, France The Spanish Network for e-Science 2/12/2010.
EGI-InSPIRE RI An Introduction to European Grid Infrastructure (EGI) March An Introduction to the European Grid Infrastructure.
A Competence Center to Serve Translational Research from Molecule to Brain Alexandre M.J.J. Bonvin MoBrain CC coordinator Bijvoet Center for Biomolecular.
EGEE-III INFSO-RI Enabling Grids for E-sciencE Application Porting Support SSC and proposal Gergely Sipos
Enabling Grids for E-sciencE University of Perugia Computational Chemistry status report EGAAP Meeting – 21 rst April 2005 Athens, Greece.
Bob Jones EGEE Technical Director
Accessing the VI-SEEM infrastructure
GPGPU use cases from the MoBrain community
Next Steps.
Integrating Scientific Tools and Web Portals
GISELA & CHAIN Workshop Digital Cultural Heritage Network
Tools and Services Workshop
MSc-Student Activities at the European XFEL
Joslynn Lee – Data Science Educator
Alexandre M.J.J. Bonvin MoBrain CC coordinator
ELIXIR: Potential areas for collaboration with e-Infrastructures
EGEE support for HEP and other applications
CCP4 6.1 and beyond: Tools for Macromolecular Crystallography
Grid Computing.
Grid Portal Services IeSE (the Integrated e-Science Environment)
Recap: introduction to e-science
NA3: User Community Support Team
Data processing Creative Biostructure now can provide a collection of tools and analysis package for biomolecular structure determination, refinement and.
Connecting the European Grid Infrastructure to Research Communities
EGI – Organisation overview and outreach
EGI Webinar - Introduction -
MAX IV Laboratory National Synchrotron Light Source – two storage rings (1.5 & 3.0 GeV) and a Short Pulse Facility Characteristics of User Program: 15.
LifeWatch Cloud Computing Workshop
Common Authentication and Authorisation Service for Life Science Research Mikael Linden, ELIXIR Finland.
Promoting Desktop Grids Virtual Team (Q1/2014 updates)
Common Solutions to Common Problems
Storing and Accessing G-OnRamp’s Assembly Hubs outside of Galaxy
GISELA & CHAIN Workshop Digital Cultural Heritage Network
The National Grid Service Mike Mineter NeSC-TOE
The site to download BALBES:
Presentation transcript:

An short overview of INSTRUCT and its computational requirements Alexandre M.J.J. Bonvin Project coordinator Bijvoet Center for Biomolecular Research Faculty of Science, Utrecht University the Netherlands EGI User Community Forum 2012, München

Instruct One of 6 first-generation biomedical infrastructure projects in Europe (ESFRI) Provides access to key technologies and support via 15 Centres and 5 National Affiliate Centres Operational Phase formally launched at Brussels on 23rd February 2012.

Instruct mission Instruct is the dynamic hub of structural biology; integrating the infrastructure of expertise, technology platforms and education to further the frontiers of science.

History of Instruct and Instruct-NL ESFRI Roadmap established 2006 NWO-CW approves signing of Instruct Agreement for NL 2008 Dutch Roadmap established, with NeCEN (EM) Start of Instruct Operational Phase Dutch Roadmap updated, with uNMR-NL (NMR) and (MS) 2011 Instruct agreement signed by member States including NL 2010 Start of Instruct Preparatory Phase 2011 Instruct Centre for MS established in Utrecht and Oxford Instruct-NL Affiliate Centre approved founding members:

Facilities Technologies NMR Dutch EU Electron microscopy Mass spectrometry Crystallography Protein expression Instruct-NL Centre for Mass Spectrometry of Protein Complexes (Utrecht / Oxford) Protein modeling NMR LSF NKI protein facility Community single crystal facility Instruct-NL : Instruct : “Molecular Life Sciences” “From atoms to cells” “From structure to function”

Computational Requirements of Macromolecular Crystallography Traditional structure solution process: A few hundred images, each 10s MB. Quickly reduced to a list of average intensities. Structure solution on desktop / laptop - combination of programs and manual steps Deposition in Protein DataBank which provides long- term curation and dissemination GRID resources not required in this scenario.

Automated approaches Balbes web service for structure solution by molecular replacement. Being moved to CCISB at Harwell, backed by 40-node cluster. ARP/wARP web service for automated model building. Based at EMBL- Hamburg. Advent of automated structure solution, using computationally intensive parameter and protocol sweeps

High-throughput data collection New PILATUS detectors on macromolecular beamlines. Users now collect 100s of datasets per day. A beamline can produce TBs data per day. Challenge is now to process the data very quickly, or store large quantities of data for later processing.

Challenges for Macromolecular Crystallography Automated approaches require significant CPU time. Can NGIs help here? Potentially, but issue of software licensing unresolved. Most MX software is free to academics, but nevertheless requires a licence. Post-processing of synchrotron data requires remote access after beamtime is over. Suggestion of running cloud-like service, where image data and MX software are available. Resourcing is still an issue, but perhaps NGIs can help?

Computational Centre for Integrated Structural Biology (CCISB) The Instruct Centre focussing on computational techniques Software packages, web services, data processing at facilities Formally based at the Research Complex at Harwell (adjacent to Diamond), but composed of geographically distributed groups Brings together computational groups covering a range of structural biology techniques Centre for Bioinformatics University of Tel Aviv CNB - Madrid

CCISB - what is offered through Instruct? Instruct provides access to centres of expertise. Typically access to a facility or lab. Computation somewhat different. Aims to provide: a route to a variety of software suites increasing availability via web services access to expert help training a focus for multi-disciplinary software development

UK Collaborative Computational Projects Mainly physical sciences, but also some biological Exist to support the computational needs of particular science communities. Carry out code development projects Maintain and distribute code libraries Organise training Hold meetings and workshops

New: CCP-EM (cryo-EM) Increase in cryoEM, evidenced by growth in EMDB entries (currently 1300 and growing fast) MRC Partnership Grant: – "Towards a Collaborative Computational Project for Electron cryo-Microscopy (CCP-EM) and bridging the gaps between structure determination methods" Planned for July June developers co-located with CCP4 at RCaH Workshop and training schools Requirements: simultaneous processing of a large amount of data (images) –GPU clusters are also being used for that

Future plans BioMedBridges BioMedBridges is a project to work on data interoperability between the biomedical ESFRI projects, of which Instruct is one. See Instruct Network for more information: CECAM Workshop: Integrated Software for integrative structural biology Hosted by CCISB at Cosener's House (near Oxford) – coorganised by WeNMR 21st-23rd May

The NMR structure determination workflow

WeNMR platform (February 2012) Largest VO in the life sciences 400 registered users from 41 nationalities and growing ~ CPU cores > 890 CPU years over the last 12 months > 1.6 million jobs over the last 12 months >30% of Life Sciences on the Grid User-friendly access to Grid via web portals

NMR Software characteristics CPU intensive Includes parallel jobs (Gromacs portal) Limited data transfer (except for software deployment) Usually low I/O Usually no storage required Our main requirements: Lots of CPUs Queues of various lengths (including short ones) Our main requirements: Lots of CPUs Queues of various lengths (including short ones)

Structural biology community in the life sciences Linked to ESFRI–INSTRUCT Linked to FP7 EU infrastructure projects (I3s) (e.g. BioNMR) WeNMR & Instruct