Authors Project Database Handler The project database handler dbCCP4i is a small server program that handles interactions between the job database and.

Slides:



Advertisements
Similar presentations
Test Case Management and Results Tracking System October 2008 D E L I V E R I N G Q U A L I T Y (Short Version)
Advertisements

Case Tools Trisha Cummings. Our Definition of CASE  CASE is the use of computer-based support in the software development process.  A CASE tool is a.
T-FLEX DOCs PLM, Document and Workflow Management.
A New Learning Tools. Topic Maps is a standard for the representation and interchange of knowledge, with an emphasis on the findability of information.
Requirements Specification
Software Frameworks for Acquisition and Control European PhD – 2009 Horácio Fernandes.
Interpret Application Specifications
Examine Quality Assurance/Quality Control Documentation
Automated Tests in NICOS Nightly Control System Alexander Undrus Brookhaven National Laboratory, Upton, NY Software testing is a difficult, time-consuming.
Microsoft Visual Basic 2012 CHAPTER ONE Introduction to Visual Basic 2012 Programming.
26-28 th April 2004BioXHIT Kick-off Meeting: WP 5.2Slide 1 WorkPackage 5.2: Implementation of Data management and Project Tracking in Structure Solution.
Introduction to Information System Development.
Moving forward our shared data agenda: a view from the publishing industry ICSTI, March 2012.
Introduction to the Enterprise Library. Sounds familiar? Writing a component to encapsulate data access Building a component that allows you to log errors.
Architecture Of ASP.NET. What is ASP?  Server-side scripting technology.  Files containing HTML and scripting code.  Access via HTTP requests.  Scripting.
A Scalable Application Architecture for composing News Portals on the Internet Serpil TOK, Zeki BAYRAM. Eastern MediterraneanUniversity Famagusta Famagusta.
Systems Analysis – Analyzing Requirements.  Analyzing requirement stage identifies user information needs and new systems requirements  IS dev team.
EUROPEAN UNION Polish Infrastructure for Supporting Computational Science in the European Research Space The Capabilities of the GridSpace2 Experiment.
Reporting and Build Statistics Using Business Intelligence By Naga Sowjanya Karumuri Build Team, VMware, Cambridge Summer Internship 2008.
CCP4 Study Weekend 3rd January 2003 CCP4i - “Tricks and Tools” Peter Briggs CCP4 Daresbury.
CIS 375—Web App Dev II Microsoft’s.NET. 2 Introduction to.NET Steve Ballmer (January 2000): Steve Ballmer "Delivering an Internet-based platform of Next.
Peter J. Briggs, Liz Potterton *, Pryank Patel, Alun Ashton, Charles Ballard, Martyn Winn CLRC Daresbury Laboratory, Warrington, Cheshire WA4 4AD, UK *
RUP Implementation and Testing
28 th March 2007 MrBUMP – Automated Molecular Replacement Ronan Keegan, Martyn Winn CCP4, Daresbury Laboratory.
28 Mar 06Automation1 Overview of developments within CCP4 Generation 1 ccp4i tasks Generation 2 isolated scripts / web service Generation 3 integrated.
 To explain the importance of software configuration management (CM)  To describe key CM activities namely CM planning, change management, version management.
Managed by UT-Battelle for the Department of Energy 1 Integrated Catalogue (ICAT) Auto Update System Presented by Jessica Feng Research Alliance in Math.
DCE (distributed computing environment) DCE (distributed computing environment)
Configuration Management (CM)
BALBES (Current working name) A. Vagin, F. Long, J. Foadi, A. Lebedev G. Murshudov Chemistry Department, University of York.
28 th March 2007CCP4 Developers Meeting BIOXHIT/CCP4(i) Database Wanjuan Yang & Peter Briggs.
CCP4(i) Database Development Wanjuan (Wendy) Yang CCP4 Annual developer’s meeting March 28, 2006 York.
BLU-ICE and the Distributed Control System Constraints for Software Development Strategies Timothy M. McPhillips Stanford Synchrotron Radiation Laboratory.
23 rd March 2005CCP4 Annual Developers’ Meeting 1 DL: Releases, Conferences and Other Activities Peter Briggs, CCP4 Daresbury.

Control & Monitoring System Update Contributors: Brian Martlew - Daresbury Laboratory - STFC James Leaver - Imperial College Pierrick Hanlet - Fermilab.
1 st -4 th December st BioXHIT Annual Meeting WorkPackage 5.2: Implementation of Data management and Project Tracking in Structure Solution Peter.
28-29 th March 2006CCP4 Automation STAB MeetingCCP4i and Automation 1 CCP4i and Automation : Opportunities and Limitations Peter Briggs, CCP4.
An Introduction to CCP4i The CCP4 Graphical User Interface Peter Briggs CCP4.
R. Keegan 1, J. Bibby 3, C. Ballard 1, E. Krissinel 1, D. Waterman 1, A. Lebedev 1, M. Winn 2, D. Rigden 3 1 Research Complex at Harwell, STFC Rutherford.
Jamie Hall (ILL). SciencePAD Persistent Identifiers Workshop PANData Software Catalogue January 30th 2013 Jamie Hall Developer IT Services, Institut Laue-Langevin.
17 th October 2005CCP4 Database Meeting (York) CCP4(i)/BIOXHIT Database Project: Scope, Aims, Plans, Status and all that jazz Peter Briggs, Wanjuan Yang.
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
Developments with CCP4i & the Database Handler Peter Briggs.
Development of a Distributed MATLAB Environment with Real-Time Data Visualization Authors: Joseph Diamond, Richard McEver Affiliation: Dr. Jian Huang,
Project Database Handler The Project Database Handler dbCCP4i is a brokering application that mediates interactions between the project database and an.
26-28 th April 2004BioXHIT Kick-off Meeting1 Task 4.7.1: Automation in Computation Peter Briggs, CCP4.
Chapter 6 CASE Tools Software Engineering Chapter 6-- CASE TOOLS
Data Harvesting: automatic extraction of information necessary for the deposition of structures from protein crystallography Martyn Winn CCP4, Daresbury.
Project Database Handler The Project Database Handler is a brokering application that mediates interactions between the project database and the external.
CASE (Computer-Aided Software Engineering) Tools Software that is used to support software process activities. Provides software process support by:- –
Project Database Handler The Project Database Handler is a brokering application, which will mediate interactions between the project database and other.
Software Engineering Chapter: Computer Aided Software Engineering 1 Chapter : Computer Aided Software Engineering.
IBM Software Group ® Managing Reusable Assets Using Rational Suite Shimon Nir.
Getting Started with.NET Getting Started with.NET/Lesson 1/Slide 1 of 31 Objectives In this lesson, you will learn to: *Identify the components of the.NET.
17 th March 2008 MrBUMP progress report Ronan Keegan & Martyn Winn Daresbury Laboratory.
Towards a Structural Biology Work Bench Chris Morris, STFC.
Software automation – What STAB sees as key aims? 1.Brief review of activities and recommendations (so far) 2.Reality checks 3. Things to do…
AHM04: Sep 2004 Nottingham CCLRC e-Science Centre eMinerals: Environment from the Molecular Level Managing simulation data Lisa Blanshard e- Science Data.
Learning Objectives Understand the concepts of Information systems.
Oman College of Management and Technology Course – MM Topic 7 Production and Distribution of Multimedia Titles CS/MIS Department.
ATLAS-specific functionality in Ganga - Requirements for distributed analysis - ATLAS considerations - DIAL submission from Ganga - Graphical interfaces.
INFSO-RI Enabling Grids for E-sciencE Using of GANGA interface for Athena applications A. Zalite / PNPI.
Peter J. Briggs, Alun Ashton, Charles Ballard, Martyn Winn and Pryank Patel CCLRC Daresbury Laboratory, Warrington, Cheshire WA4 4AD, UK The CCP4 project.
Advanced Higher Computing Science The Project. Introduction Worth 60% of the total marks for the course Must include: An appropriate interface using input.
Project Database Handler The Project Database Handler is a brokering application which will mediate interactions between the project database and other.
CCP4 6.1 and beyond: Tools for Macromolecular Crystallography
Database Requirements for CCP4 17th October 2005
Project tracking system for the structure solution software pipeline
CCP4-PDB Workshop ACA 2004 Chicago
Presentation transcript:

Authors Project Database Handler The project database handler dbCCP4i is a small server program that handles interactions between the job database and other programs. The handler is written in Python but communications are via sockets, so the clients can be written in any language. Tcl and Python “client API" libraries are provided to hide the details of the socket communications and simplify access to the database. The system runs on both UNIX/Linux and MS Windows platforms. dbCCP4i: Tracking data in PX Structure Determination Software Pipelines Introduction and Background The European Integrated Project "BIOXHIT" [1] aims to deliver an integrated technology platform for protein structure determination by X-ray crystallography (PX). A key part of this platform is the development and integration of automated structure solution software pipelines which cover various parts of the post-data collection stages of the macromolecular structure determination process. Such pipelines are useful in high-throughput contexts such as Structural Genomics, but are equally well suited to use by novice crystallographers. Project Tracking Database The dbCCP4i system is built on the existing database used within the graphical user interface CCP4i [4], and records information about each program run, including the date, input parameters, associated input and output files, and the outcome of the run. At present dbCCP4i uses the same "database.def" file infrastructure as CCP4i in order to store the job data, to ensure compatibility with existing data. More sophisticated data storage mechanisms (for example, SQLite) are also being investigated for future use. Data Visualiser: dbviewer The dbviewer client application aims to present the tracking data in an intuitive manner to the end user, by showing the jobs with links between them indicating the transfer of data. The user can interact with the view to see the files and other data associated with each job. The viewer uses the Graphviz package[5] as an engine for generating the layouts of the history graphs. The viewer is written in the Tcl/Tk scripting language and so is able to reuse many of the tools already developed in CCP4i. Project Tracking System for the Structure Solution Software Pipeline Acknowledgements The work on dbCCP4i has largely been undertaken within the BIOXHIT project, which is funded by the European Commission within its 6th Framework Programme, under the thematic area "Life sciences, genomics and biotechnology for health", contract number LHSG-CT Both the dbCCP4i and MrBUMP projects have also been generously supported by Collaborative Computational Project No.4 (CCP4), which is part of the UK's Science and Technology Facilities Council (STFC), and which is also supported by funding from the Biotechnology and Biological Sciences Research Council (BBSRC). Peter Briggs, Wanjuan Yang and Ronan Keegan, STFC Daresbury Laboratory, Warrington WA4 4AD, UK The project tracking system consists of a number of key components show in the figure (left): Project database handler Database for storing job data Client APIs Visualisation tools Each of these is described briefly in the following panels. More information can be found at where version 0.2 of dbCCP4i is also available for download Typically software pipelines generate large amounts of data in their operation, and accurate recording and tracking of the data is important both for the automated pipeline and for the end user who will need to interpret the final result. This poster describes the dbCCP4i project tracking system [2] that aims to address some of these issues, and how this system has been incorporated within the automated "MrBUMP" system [3] to track the progress of runs and present its output in a more easily understandable format. Using dbCCP4i in the MrBUMP Molecular Replacement Pipeline MrBUMP is a framework that automates the determination of macromolecular structures via the Molecular Replacement method (MR). In MR, a trial model based on a known structure is used as a template for extracting the structural information of the target from the experimental reflection data. As the success of the MR procedure is critically dependent upon the choice of trial model, the approach used in MrBUMP emphasises the generation of a variety of possible search models; it has already been used successfully to solve several MR problems [6-8]. In good cases MrBUMP will find a single clear solution to an MR problem; in other cases it will suggest a number of likely search models that can be investigated manually by the scientist – typically around search models will be generated (in atypical cases it could be ten times that number). Each model also undergoes rounds of processing by various programs. As a result the end user faces a challenge when reviewing and evaluating the results of the MrBUMP run, and in earlier versions end users needed to filter through many different output files and directories. The most recent release of MrBUMP (0.4.0) uses dbCCP4i to record information on the MR process in order to address this problem and present the data in a more intuitive graphical form via the dbviewer (see right). The graphical view makes it much easier for the end user to monitor the progress of the MrBUMP run, and to more easily find and examine References [1] The BIOXHIT Project: [2] P.J.Briggs and W.Yang CCP4 Newsletter on Protein Crystallography 45 (Winter 2006/7) [3] R.M.Keegan and M.D.Winn Acta Cryst. D63 (2007) [4] E Potterton et al. Acta Cryst. D59 (2003) [5] The Graphviz package: [6] Obiero et al. Acta Cryst. F62 (2006) [7] Karbat et al. J. Mol. Biol. 366 (2007) [8] El Omari et al. Acta Cryst. F62 (2006) Peter Briggs Senior CCP4 software developer Wanjuan Yang Principal BIOXHIT software developer Ronan Keegan Lead MrBUMP software developer a particular file associated with the processing of each search model. Thus the use of dbCCP4i substantially improves the usefulness of MrBUMP for the end user. MrBUMP version incorporating dbCCP4i is available for download from The viewer is available for general CCP4 usage and could easily be used by other automation projects. The use of dbCCP4i allows for much more complexity in these automated systems whilst making the outcome much clearer and accessible to the user, allowing them to arrive at a solution for their structure more quickly. Above: Example of the dbviewer showing the output from a MrBUMP job