E-HTPX: A User Perspective Robert Esnouf, University of Oxford.

Slides:



Advertisements
Similar presentations
PiMS, xtalPiMS and beyond: proteins, crystals and data Chris Morris STFC Daresbury Laboratory… …and the PIMS development team CCP4 Study Weekend, Nottingham,
Advertisements

Key Considerations for Report Generation & Customization Richard Wzorek Director, Production IT Confidential © Almac Group 2012.
PiMS overview: version 0.3 & beyond Robert Esnouf, PiMS Project Sponsor, Oxford.
Refresh, V.10, July 2, 2010 Name Title, Date Copyright © 2011 Infor. All rights reserved. INFOR – A LOOK INTO THE FUTURE NameJamie Bridgman TitleAccount.
Structural Genomics – an example of transdisciplinary research at Stanford Goal of structural and functional genomics is to determine and analyze all possible.
21 st July 2006FLOSSIE Conference Open Source Assistive Technology Software OATS David Colven, Steve Lee & Simon Judge.
Use of RCP for Instrument Control Tony Lam 2006 Eclipse SLAC.
Building Data-intensive Pipelines Ravi K Madduri Argonne National Lab University of Chicago.
26-28 th April 2004BioXHIT Kick-off Meeting: WP 5.2Slide 1 WorkPackage 5.2: Implementation of Data management and Project Tracking in Structure Solution.
PIMS: The Problems of Project Management Robert Esnouf, Scientific Sponsor for PIMS OPPF/STRUBI, University of Oxford strubi.ox.ac.uk.
Hunt for Molecules, Paris, 2005-Sep-20 Software Development for ALMA Robert LUCAS IRAM Grenoble France.
Module 1: Server Roles and Initial Configuration Tasks
By Crystal Mosley 1. Need Collaboration and sharing information Global diversity Flexibility and convenience Common work and storage space 2.
GTL Facilities Computing Infrastructure for 21 st Century Systems Biology Ed Uberbacher ORNL & Mike Colvin LLNL.
IPlant Collaborative Tools and Services Workshop iPlant Collaborative Tools and Services Workshop Collaborating with iPlant.
Colour of Ocean Data, Brussels, November 2002 Colour of Ocean Data: Discussion Panel Lesley Rickards British Oceanographic Data Centre.
Crystal-25 April The Rising Power of the Web Browser: Douglas du Boulay, Clinton Chee, Romain Quilici, Peter Turner, Mathew Wyatt. Part of a.
High-Throughput Crystallography at Monash Noel Faux Dept of Biochemistry and Molecular Biology Monash University.
IPlant Collaborative Tools and Services Workshop iPlant Collaborative Tools and Services Workshop Collaborating with iPlant.
V e RSI Victorian eResearch Strategic Initiative VBL Introduction Crystal 25 Rev 1.2.
1 st -4 th December st BioXHIT Annual Meeting WorkPackage 5.2: Implementation of Data management and Project Tracking in Structure Solution Peter.
Crystal25 Hunter Valley, Australia, 11 April 2007 Crystal25 Hunter Valley, Australia, 11 April 2007 JAINIS (JCU and Indiana Instrument Services): A Grid.
R. Keegan 1, J. Bibby 3, C. Ballard 1, E. Krissinel 1, D. Waterman 1, A. Lebedev 1, M. Winn 2, D. Rigden 3 1 Research Complex at Harwell, STFC Rutherford.
Accipiens - Increase Business Performance with new Generation Solutions Vantyx Systems | Nuno Silva Implementing Business Solutions with a Local.
SOA-25: Data Distribution Solutions Using DataXtend ® Semantic Integrator for Sonic ™ ESB Users Jim Barton Solution Architect.
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
Data Integration and Management A PDB Perspective.
In context…. xia2: what is it? Automated expert data reduction – images in, reflections suitable for phasing out. Handles: –MAD data –Multiple passes.
Project Database Handler The Project Database Handler dbCCP4i is a brokering application that mediates interactions between the project database and an.
Data Harvesting: automatic extraction of information necessary for the deposition of structures from protein crystallography Martyn Winn CCP4, Daresbury.
NewRail Paperless integration of ICT and Transport Logistics
Project Database Handler The Project Database Handler is a brokering application that mediates interactions between the project database and the external.
17 th October 2005CCP4 Database Meeting York University Database Requirements for CCP4 Projects Monday 17 th October 2005 Abstract Gather information on.
Project Database Handler The Project Database Handler is a brokering application, which will mediate interactions between the project database and other.
The User Perspective Michelle Osmond. The Research Challenge Molecular biology, biochemistry, plant biology, genetics, toxicology, chemistry, and more.
NeuroLOG ANR-06-TLOG-024 Software technologies for integration of process and data in medical imaging A transitional.
| nectar.org.au NECTAR TRAINING Module 2 Virtual Laboratories and eResearch Tools.
Development of e-Science Application Portal on GAP WeiLong Ueng Academia Sinica Grid Computing
Simplified Experiment Submit Proposal Results Excited Users Do Expt Data Analysis Feedback.
Towards a Structural Biology Work Bench Chris Morris, STFC.
Managing crystallization experiments within PIMS.
High throughput biology data management and data intensive computing drivers George Michaels.
AUTOMATION OF MACROMOLECULAR DATA COLLECTION - INTEGRATION OF DATA COLLECTION AND DATA PROCESSING Harold R. Powell 1, Graeme Winter 1, Andrew G.W. Leslie.
1 10 th February 2016 JRA2 SOLEIL MOTIVATIONS FOR ITS PARTICIPATION IN JRA Alain BUTEAU : Software for Controls and Data Acquisition group leader.
EUDAT receives funding from the European Union's Horizon 2020 programme - DG CONNECT e-Infrastructures. Contract No EUDAT Aalto Data.
System Software Laboratory Databases and the Grid by Paul Watson University of Newcastle Grid Computing: Making the Global Infrastructure a Reality June.
Project Database Handler The Project Database Handler is a brokering application which will mediate interactions between the project database and other.
An short overview of INSTRUCT and its computational requirements Alexandre M.J.J. Bonvin Project coordinator Bijvoet Center for Biomolecular Research Faculty.
BIOXHIT Working Group 1 Co-ordinator / Developer
ISPyB December 4th, 2013 From sample to data analysis: how to track every step of an experiment in the ISPyB database. Marjolaine Bodin, ESRF/EXP/Structural.
Tools and Services Workshop
Joslynn Lee – Data Science Educator
Module 1: Introduction to Administering Accounts and Resources
Company Link Technologies S.A.P.I. de C.V. Headquarters
CCP4 6.1 and beyond: Tools for Macromolecular Crystallography
Grid Portal Services IeSE (the Integrated e-Science Environment)
Database Requirements for CCP4 17th October 2005
PiMS, xtalPiMS and beyond: proteins, crystals and data Chris Morris STFC Daresbury Laboratory… …and the PIMS development team CCP4 Study Weekend, Nottingham,
Experimental Definition in SynchWeb for XPDF
Developing Innovative Unified Communications Applications
BrightSign Network Secure, scalable and affordable cloud-based digital sign network service.
Current CRIMS – ISPyB communication status
Microsoft Office 365 Add-In Enhances Task and Project Management and Improves Workflows “With Office 365, businesses receive a comprehensive stack of technologies.
Project tracking system for the structure solution software pipeline
Replace with Application Image
Automation from a user perspective
An ecosystem of contributions
Karen Bartleson, President, IEEE Standards Association
eHTPX crystallization, shipping and future
CCLRC Daresbury Laboratory
Presentation transcript:

e-HTPX: A User Perspective Robert Esnouf, University of Oxford

The e-HTPX Research Challenge Managing the processes along the protein crystallography pipeline: –Remote user managing a complete experiment –Target selection, protein production, crystallization, data collection, structure solution, deposition –Exchange of data between laboratories, synchrotrons, computational resources, etc… –Development sites: SRS, EBI, York, Oxford, BM14 –Test sites: Oxford, York, Glasgow, (St Andrews’)

Potential benefits of e-HTPX Growing problems in protein crystallography: –Higher throughput, automation, distributed working, data volumes, better structure solution methods ESRF JSBG beam lines 74MB images, 1s exposures –Need secure, universal data exchange Standardized data model, single sign on, universal naming –Compute power Automated data analysis against structure/sequence DBs –Current PX interest mainly limited to compute resources and small clusters (MrBUMP)

e-HTPX e-Research Requirements e-HTPX is primarily a (meta-)data management & data exchange problem: –Administration: single sign on, access rights, roles –Computation: small clusters (real-time data reduction) –Data sharing & integration: standardization & unique naming –Workflow: ‘expert’ data collection software –Collaboration tools: reporting, project management

Getting Users to Adopt e-HTPX Structural biology community is not necessarily computer literate –Focus more on understanding complex biology –No local software installation / complex certificates –Portal must offer real benefit in terms of experiment automation, access to remote services or simplifying data management/archiving –Error prevention by exchanging metadata and using barcoding intelligently –Integrated access to tools and resources

Lessons from e-HTPX at Oxford Strengths –Managing multi-researcher experiments –Highly automated crystallization management –‘Champion’ driving developments at BM14 Weaknesses –Balance of flexible data model & simple UI –Usefulness constrained by level of automation –Added burden/restriction on experimental freedom –Coping with rates of diffraction data acquisition

BM14 at the ESRF, Grenoble

Future Plans for e-HTPX Merging e-HTPX with other developments –Widespread adoption of data exchange standards –Crystallization management interface  PiMS –e-HTPX Portal/Hub linked to PiMS (merged?) –ISPyB now ESRF-wide standard experiment log –DNA needs improving but desperately needed –MrBUMP now part of CCP4 suite –Diamond natural focus for synchrotron automation

Take home messages Crystallography is an experimental science –The e is much less important than the Science and must be invisible to the user –A simple tool addressing a well defined problem is much more likely to be taken up –Uptake guaranteed if Diamond data management is addressed –Need science champions to get over adoption ‘transition state’ –Low data volume but high complexity & variability