Nick Draper Tessella Instrument Independent Reduction and Analysis at ISIS and SNS.

Slides:



Advertisements
Similar presentations
Quality Monitoring for Communication Manager
Advertisements

Where did I go ?. Where did I work ? What did I ANSTO ? 1.Choose a device bus 2.Choose a programming language 3.Propose and develop an architecture.
Technical - SharePoint SharePoint grew out of the Exchange Development Teams collaboration work and Digital Dashboard initiative. SharePoint Team Services.
Horacio Bouzas Ocean Portfolio Manager, Schlumberger The power of diversity.
ICAT + Information Model Brian Matthews Scientific Information Group E-Science Centre STFC Rutherford Appleton Laboratory
EUFORIA FP7-INFRASTRUCTURES , Grant JRA4 Overview and plans M. Haefele, E. Sonnendrücker Euforia kick-off meeting 22 January 2008 Gothenburg.
Introduction Main technologies: core written in Java embedded Jython interpreter code managed using the Eclipse plugin framework client program uses Eclipse.
Systems Analysis and Design in a Changing World
The Developer Perspective Michelle Osmond. Design – Requirements Gathering Sales & Research projects –Prototypes/Demos User group meetings Usability workshops.
Visual Studio Team System (VSTS). Richard Hundhausen Author of software development books Microsoft Regional Director Microsoft MVP (VSTS) MCT, MCSD,
Report from DANSE Workshop Sept. 3-8, 2003 Goals: 1) To explain DANSE to selected scientists and engineers who develop software for neutron scattering.
Summary Role of Software (1 slide) ARCS Software Architecture (4 slides) SNS -- Caltech Interactions (3 slides)
The NeXus Reloaded Tony Lam Bragg Institute Data Acquisition Team NOBUGS 06.
DCS Architecture Bob Krzaczek. Key Design Requirement Distilled from the DCS Mission statement and the results of the Conceptual Design Review (June 1999):
Introduction to DANSE Brent Fultz Prof. Materials Science and Applied Physics California Institute of Technology Distributed Data Analysis Architecture.
8 Systems Analysis and Design in a Changing World, Fifth Edition.
1 ParaView Current Architecture and History Current Architecture and History Issues with the Current Design Issues with the Current Design.
Web-based Portal for Discovery, Retrieval and Visualization of Earth Science Datasets in Grid Environment Zhenping (Jane) Liu.
How Open is OpenInsight?
 1. Introduction  2. Development Life-Cycle  3. Current Component Technologies  4. Component Quality Assurance  5. Advantages and Disadvantages.
Introducing Enterprise Technologies David Dischiave Syracuse University School of Information Studies “The original iSchool” June 3, 2013 Information School,
DYNAMICS CRM AS AN xRM DEVELOPMENT PLATFORM Jim Novak Solution Architect Celedon Partners, LLC
- 1 - Grid Programming Environment (GPE) Ralf Ratering Intel Parallel and Distributed Solutions Division (PDSD)
Page - 1 Ariba Buyer Upgrade Benefits/Enhancements  Streamlined User Interface  Requisition Function and Company eForms  Increased Performance.
1 ISA&D7‏/8‏/ ISA&D7‏/8‏/2013 Systems Development Life Cycle Phases and Activities in the SDLC Variations of the SDLC models.
Nick Draper Teswww.mantidproject.orgwww.mantidproject.org Instrument Independent Reduction and Analysis at ISIS and SNS.
Company Overview for GDF Suez December 29, Enthought’s Business Enthought provides products and consulting services for scientific software solutions.
ISIS: towards a 21st century facility computing environment (slowly) Robert McGreevy Science and Technology Facilities Council ISIS, Rutherford Appleton.
DANSE Diffraction Software for the SNS: DiffDANSE S.J.L. Billinge Dept. Physics and Astronomy Michigan State University.
GumTree Feature Overview Tony Lam Data Acquisition Team Bragg Institute eScience Workshop 2006.
WordFreak A Language Independent, Extensible Annotation Tool.
Through the development of advanced middleware, Grid computing has evolved to a mature technology in which scientists and researchers can leverage to gain.
Mantid Scientific Steering Committee Nick Draper 10/11/2010.
Ch 1. A Python Q&A Session Spring Why do people use Python? Software quality Developer productivity Program portability Support libraries Component.
Mantid Development introduction Nick Draper 11/04/2008.
Nick Draper 05/11/2008 Mantid Manipulation and Analysis Toolkit for ISIS data.
Software Quality Assurance
Australian Nuclear Science & Technology Organisation GumTree A Java Based GUI Framework for Beamline Experiments Tony Lam (ANSTO) Andy Götz (ESRF) Ferdi.
BalticGrid-II Project The Second BalticGrid-II All-Hands Meeting, Riga, May, Joint Research Activity Enhanced Application Services on Sustainable.
1 Yield Analysis and Increasing Engineering Efficiency Spotfire Users Conference 10/15/2003 William Pressnall, Scott Lacey.
Mantid Current Development and Future Plans Nicholas Draper ICNS 2013.
Mantid Stakeholder Review Nick Draper 01/11/2007.
W3af S. Qi,X. Ma,Y. Zhang,B Zhao,Y Zhu EC521 Fall 2014.
Mantid Stakeholder Review Nick Draper 01/11/2007.
Mantid Manipulation and Analysis Toolkit for ISIS data.
Toby Perring. Visualisation & Analysis Toolkit Extensions VATES.
A Remote Collaboration Environment for Protein Crystallography HEPiX-HEPNT Conference, 8 Oct 1999 Nicholas Sauter, Stanford Synchrotron Radiation Laboratory.
With TANGO S. Poirier – Data management group.
EUFORIA FP7-INFRASTRUCTURES , Grant Migrating Desktop Uniform Access to the Grid Marcin Płóciennik Poznan Supercomputing and Networking Center.
Mantid Manipulation and Analysis Toolkit for Instrument data.
Mantid: A new approach to data analysis at large scale facilities Jon Taylor Project WIKI (Binary downloads)
Mantid Scientific Steering Committee Nick Draper 03/10/2011.
The Integrated Spectral Analysis Workbench (ISAW) DANSE Kickoff Meeting, Aug. 15, 2006, D. Mikkelson, T. Worlton, Julian Tao.
Migrating Desktop Uniform Access to the Grid Marcin Płóciennik Poznan Supercomputing and Networking Center Poznan, Poland EGEE’07, Budapest, Oct.
Migrating Desktop Uniform Access to the Grid Marcin Płóciennik Poznan Supercomputing and Networking Center Poland EGEE’08 Conference, Istanbul, 24 Sep.
ICAT Status Alistair Mills Project Manager Scientific Computing Department.
Physical Oceanography Distributed Active Archive Center THUANG June 9-13, 20089th GHRSST-PP Science Team Meeting GHRSST GDAC and EOSDIS PO.DAAC.
Nick Draper Tessella The Mantid Project: Notes from an international software collaboration.
VisIt for the Mantid Project Owen Arnold (Tessella LLC) Michael Reuter (ORNL NSSD) February 10, 2011.
Integration and Forms Tools for Laserfiche from TCi IS124 Kevin Pederson & Chris Sharp.
Mantid Scientific Steering Committee Nick Draper 18/06/2010.
Mantid Scientific Steering Committee Nick Draper 13/05/2011.
Systems Analysis and Design in a Changing World, Fifth Edition
Deployment of Flows Loretta Auvil
An Introduction to the IVC Software Framework
Learn how Sage CRM partner add-ons can help you target new customers
Course: Module: Lesson # & Name Instructional Material 1 of 32 Lesson Delivery Mode: Lesson Duration: Document Name: 1. Professional Diploma in ERP Systems.
Software for Neutron Imaging Analysis
AIMS Equipment & Automation monitoring solution
Diamond is all about data…
Presentation transcript:

Nick Draper Tessella Instrument Independent Reduction and Analysis at ISIS and SNS

Project Organisation Users Scientific Steering Committee Development Team Users Scientific Steering Committee Development Team SNS/HIFR ISIS 27 beamlines, 1600 users 9 Key scientists PM & 16 Developers Project Management Board 26 beamlines, 850 unique users 4 Key scientists

How we do it Technically Organisation –Open source –Continuous integration –Automated build, test & deploy –Distributed team C++ Framework –Win, Linux, Mac –Memory Management –Performance optimisation OpenMP –Common Interfaces –Plug in Mechanism Qt GUI –Extended from QtiPlot Python Scripting –Using Boost Python –Powerful and extensive coverage –Integration with NumPy ICAT

User interfaces MantidPlot –1, 2 and 3D plotting –Interactive Instrument view –Ad hoc analysis –Specific User interfaces –Integrated scripting –Extendable with plugins MantidScript –Pure command line support

Rollout ISIS SNSHFIR In Use Under Evaluation Active Development

Challenges Documentation –User –Developer Large distributed team –Communication –Direction Rapid development vs refactoring Weaknesses in third party components –Visit vs Paraview No two facilities are the same –Archive structure –Information catalog No two instruments are the same –Workflow differences

Future tasks Absorption correction improvements –Total scattering –Complex sample environments Multiple frequency data analysis Event based Rollout at ISIS VATES –100GB + data sets –Multiple dimensions of interest –Single Crystal & Diffuse Diffraction –Quantitative analysis of 3D and 4D data

VATES - Advanced visualisation Problem –Large 100GB datasets –4+ dimensions Q(x,y,z), , temp, field, etc. Solution –Distributed Parallel visualization Paraview –On the fly parallel data rebinning DataFile Rebinning+Visualization Servers Your Laptop

Multidimensional data visualisation

Further Information Project Web Page – Project Introduction Document – troduction%20Document.dochttp://svn.mantidproject.org/mantid/trunk/Documents/Requirements/Project%20In troduction%20Document.doc User Requirements Document – Architectural Design Document – ign%20Document.dochttp://svn.mantidproject.org/mantid/trunk/Documents/Design/Architecture%20Des ign%20Document.doc