DANSE Diffraction sub-group report S.J.L. Billinge Dept. Physics and Astronomy Michigan State University.

Slides:



Advertisements
Similar presentations
CS3500 Software Engineering Legacy Systems (1) Legacy systems are software (and sometimes hardware) systems that have been developed sometime in the past.
Advertisements

Key-word Driven Automation Framework Shiva Kumar Soumya Dalvi May 25, 2007.
Alternate Software Development Methodologies
DANSE – DiffDANSE report and Community Engagement S.J.L. Billinge Department of Applied Physics and Applied Mathematics Columbia University, CMPMS, Brookhaven.
Adding scalability to legacy PHP web applications Overview Mario A. Valdez-Ramirez.
Report from DANSE Workshop Sept. 3-8, 2003 Goals: 1) To explain DANSE to selected scientists and engineers who develop software for neutron scattering.
ARCS Data Analysis Software An overview of the ARCS software management plan Michael Aivazis California Institute of Technology ARCS Baseline Review March.
Experimental Facilities DivisionORNL - SNS June 22, 2004 SNS Update – Team Building Steve Miller June 22, 2004 DANSE Meeting at Caltech.
Copyright © 2006 Software Quality Research Laboratory DANSE Software Quality Assurance Tom Swain Software Quality Research Laboratory University of Tennessee.
REES: Reasoning Engines Evaluation Shell version 3.0 Automated Reasoning Lab University of California, Irvine.
© , Michael Aivazis DANSE Software Issues Michael Aivazis California Institute of Technology DANSE Software Workshop September 3-8, 2003.
Copyright © 2007 Software Quality Research Laboratory DANSE Software Quality Assurance Tom Swain Software Quality Research Laboratory University of Tennessee.
Introduction to DANSE Brent Fultz Prof. Materials Science and Applied Physics California Institute of Technology Distributed Data Analysis Architecture.
DANSE Diffraction Software for the SNS: DiffDANSE S.J.L. Billinge Dept. Physics and Astronomy Michigan State University.
© , Michael Aivazis DANSE Software Architecture Challenges and opportunities for the next generation of data analysis software Michael Aivazis.
Systems Analysis and Design in a Changing World, 6th Edition
System Design/Implementation and Support for Build 2 PDS Management Council Face-to-Face Mountain View, CA Nov 30 - Dec 1, 2011 Sean Hardman.
The SAM-Grid Fabric Services Gabriele Garzoglio (for the SAM-Grid team) Computing Division Fermilab.
Framework for Automated Builds Natalia Ratnikova CHEP’03.
Chapter 2 The process Process, Methods, and Tools
-Nikhil Bhatia 28 th October What is RUP? Central Elements of RUP Project Lifecycle Phases Six Engineering Disciplines Three Supporting Disciplines.
Effective User Services for High Performance Computing A White Paper by the TeraGrid Science Advisory Board May 2009.
Java Analysis Studio Status Update 12 May 2000 Altas Software Week Tony Johnson
Project Management Building the Project Plan Managing the Project Plan Results and Progress Mike McKerns, Caltech.
Software Software is omnipresent in the lives of billions of human beings. Software is an important component of the emerging knowledge based service.
Nick Draper Teswww.mantidproject.orgwww.mantidproject.org Instrument Independent Reduction and Analysis at ISIS and SNS.
SPACE TELESCOPE SCIENCE INSTITUTE Operated for NASA by AURA COS Pipeline Language(s) We plan to develop CALCOS using Python and C Another programming language?
DANSE Diffraction Software for the SNS: DiffDANSE S.J.L. Billinge Dept. Physics and Astronomy Michigan State University.
Using the Open Metadata Registry (openMDR) to create Data Sharing Interfaces October 14 th, 2010 David Ervin & Rakesh Dhaval, Center for IT Innovations.
Brent Fultz; Co-PIs are Michael Aivazis, Ian Anderson; PM is Mike McKerns California Institute of Technology.
Mantid Development introduction Nick Draper 11/04/2008.
Lars Ehm National Synchrotron Light Source
DANSE Software serving the community Simon Billinge, Columbia University Brent Fultz, California Institute of Technology, DMR ) New Science Through.
SIMO SIMulation and Optimization ”New generation forest planning system” Antti Mäkinen Dept. of Forest Resource Management / University of Helsinki.
Chapter 10 Analysis and Design Discipline. 2 Purpose The purpose is to translate the requirements into a specification that describes how to implement.
Software Engineering Prof. Ing. Ivo Vondrak, CSc. Dept. of Computer Science Technical University of Ostrava
WGISS-39, Tsukuba, Japan, May 11-15, 2015 GEO Community Portals Ken McDonald/NOAA CWIC Session, WGISS–39 May 13, 2015.
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
Presented by Scientific Annotation Middleware Software infrastructure to support rich scientific records and the processes that produce them Jens Schwidder.
SSC SI Data Processing Pipeline Plans Tom Stephens USRA Information Systems Development Manager SSSC Meeting – Sept 29, 2009.
Small Angle Neutron Scattering (SANS) A DANSE Subproject May 31, 2007 Manassas VA A University of Tennessee Subproject report.
March 2004 At A Glance autoProducts is an automated flight dynamics product generation system. It provides a mission flight operations team with the capability.
Mantid Stakeholder Review Nick Draper 01/11/2007.
A Software Framework for Distributed Services Michael M. McKerns and Michael A.G. Aivazis California Institute of Technology, Pasadena, CA Introduction.
Project Database Handler The Project Database Handler is a brokering application that mediates interactions between the project database and the external.
Nick Draper Tessella Instrument Independent Reduction and Analysis at ISIS and SNS.
1 COMPUTER SCIENCE DEPARTMENT COLORADO STATE UNIVERSITY 1/9/2008 SAXS Software.
HP PPM Center release 8 Helping IT answer the tough questions
Mantid Stakeholder Review Nick Draper 01/11/2007.
ADASS the Planning and Scheduling Perspective Roadmap: - How planning and scheduling fits in at ADASS - ADASS planning and scheduling posters and presentations.
February 8, 2006copyright Thomas Pole , all rights reserved 1 Lecture 3: Reusable Software Packaging: Source Code and Text Chapter 2: Dealing.
Copyright All right reserved 1 i - LIKE Linked Data enrichment for an e-learning system Networked interactions to create, learn and share knowledge.
Process Asad Ur Rehman Chief Technology Officer Feditec Enterprise.
Tool Integration with Data and Computation Grid “Grid Wizard 2”
Future plans & strategy for CCP4 (for discussion) Tadeusz Skarzynski, 30 March 2006.
Unit – I Presentation. Unit – 1 (Introduction to Software Project management) Definition:-  Software project management is the art and science of planning.
March 2004 At A Glance Advanced Mission Design (AMD) researches and develops innovative trajectories and the mathematical methods used for optimal designs.
The Integrated Spectral Analysis Workbench (ISAW) DANSE Kickoff Meeting, Aug. 15, 2006, D. Mikkelson, T. Worlton, Julian Tao.
1/30/2003 Los Alamos National Laboratory1 A Migration Framework for Legacy Scientific Applications  Current tendency: monolithic architectures large,
Modelling a team-based astronomy task using LAMS James Dalziel Professor of Learning Technology, and Director, Macquarie E-Learning Centre Of Excellence.
Software Engineering Salihu Ibrahim Dasuki (PhD) CSC102 INTRODUCTION TO COMPUTER SCIENCE.
Leverage Big Data With Hadoop Analytics Presentation by Ravi Namboori Visit
1 The XMSF Profile Overlay to the FEDEP Dr. Katherine L. Morse, SAIC Mr. Robert Lutz, JHU APL
Chapter 18 Maintaining Information Systems
MICE Collaboration Meeting Saturday 22nd October 2005 Malcolm Ellis
Maintaining software solutions
Project tracking system for the structure solution software pipeline
Software engineering -1
Enterprise Program Management Office
Lecture 13 Teamwork Bryan Burlingame 1 May 2019.
Presentation transcript:

DANSE Diffraction sub-group report S.J.L. Billinge Dept. Physics and Astronomy Michigan State University

Diffraction methods Single crystal diffraction –TOPAZ Powder diffraction –POWGEN3, VULCAN, NOMAD, SNAP Total scattering –POWGEN3, NOMAD, SNAP (macromolecular diffraction)

Frontiers of Structural Science Structure studies are ubiquitous: Whatever the scientific frontier in materials science knowledge of structure is important Complex materials: the nanostructure problem –Structural fluctuations at the nanoscale –Nanoparticles –Inhomogeneous systems, intercalated nanoporous systems Materials science through diffraction –Grain structure –Texture –Particle size –Thin films Materials in action –Parametric studies –Combinatorial studies –Materials under extreme conditions (Mechanical properties through diffraction)

Complex modeling for Complex structures Solve the inverse problem 1.Regularize the problem (more constraints/restraints than degrees of freedom) 2.Develop algorithms to solve it DANSE is ideally suited for this kind of application DiffLAB task Thanks to Igor Levin for help producing the figure

Group Pavol Juhas (PD – part time) Wenduo Zhou (PD – full time) Emil Bozin (PD – part time) Jiwu Liu (GS – part time) Chris Farrow (GS – part time) Dmitriy Bryndin (not shown GS full time) Simon Billinge (PI)

Danse.us/trac/diffraction

Software enabling new science from SNS New science by enabling expert scientists, non-expert scatterers –Get scientists closer to what they do: the science –Expanding the range of problems that utilize neutron diffraction, expanding the user base of non-experts New science by enabling expert scatterers –More powerful, flexible configurable software E.g. complex modeling paradigm Rich (and growing) libraries of components New science by extending software capabilities –New algorithms, new methods

Flagship Applications PDFgui/SrReal – Enabling scientists –Enhanced real-space analysis capabilities –PDFgui uses existing PDFfit2 engine. 1.0beta is released –SrReal is our holding name for the replacement built on refactored library routines SrRietveld – Enabling scientists –Enhanced powder diffraction/Rietveld refinement capabilities –Initially with an existing engine (Fullprof), later using library routines –Design foci are to optimize for Get the scientist closer to the science: Automation, visualization Real-time operation: will require distributed implementation Scalable and optimized for parametric refinements of multiple datasets

Diffpy – Expert scatterers –Modular libraries of diffraction components that are available in Python and in Pyre DiffLab – Expert scatterers –Application for building (and executing) “complex modeling” refinement applications on the fly using the Diffpy library User designs her own refinement program depending on what information is available –Extensible: grows in power as the libraries grow

Progress: PDFgui v1.0beta: Adopted by Thomas Proffen for his instrument, currently being used in a PDF workshop in Canada New features: –Dynamic memory allocation –Supports space-groups –Supercell expansion –Spherical nanoparticle form-factor implemented –Supports xyz, CIF, PDB file formats (expanded from discus) –Automatically generates Symmetry constraints Analytic derivatives of user and symmetry constraint equations –Live plotting –Structure visualization –Parametric plotting –Macro language for T-series, doping-series, r- series –Smart extraction of meta-data from files and file- names –User requested usability features such as fit summary and automated updating of inputs –Built-in bug-reporting

Enabling new science Real-time analysis at the beamline (faked example, but it has really been used in this way at GPPD) Temperature series of LaMnO 3 from 15K to 300K Quick to set up and refine structure at each point while visualizing a refined parameter

Enabling new science Student: HyunJeong Kim Large zeolite structure with Se chains or rings inside Would never have been attempted with the old program –Structure too large without special version of the code compiled – Asymmetric unit would have had to be expanded by hand from 9 to 750 atoms! –Constraint equations due to the crystal symmetry coded by hand

Year 1 Summary DiffDANSE team in place (not quite finished yet) Learned a lot about software engineering Put in place a software development process that we are happy with Put in place an EVR reporting process that we are happy with Released first full-featured software application to the community Begun planning and design for Rietveld and DiffLAB Complex modeling applications

Next Year forecast PDFgui is now shipped. We will maintain but not develop it further ( SrRietveld –Focus on PDFgui type functionality in a Rietveld code with an existing Rietveld engine that will be operating on POWGEN3 by the end of the year –Engine will be replaced gradually in out years DiffLAB –Working version of Difflab –Collaborate with Michael Aivazis to ensure that Pyre has the functionality to support this Begin the task of creating diffpy libraries –Basic design and API’s will be an early focus –Support for needs of Engineering Diffraction will be an early focus

DiffDANSE outreach Software support and research-community engagement –Described in the research part of the talk Education –Developing K12 science curricula: PI now has an active role in the PROMSE project at MSU – can PROMSE/DANSE activities leverage each other? –Developing University nanoscience and scientific software curricula and content – scheduled for later in the project Broadening participation – Individual efforts of the group members to recruit underrepresented persons e.g., female high-school student will join us for 6 weeks in the summer PI has an active relationship with a science teacher Scott Goodman at Everett high-school. Very interactive, but less active this year due to reprioritization of efforts of Scott due to some personal reasons

Single Crystal Support We are very interested in single crystal diffraction but this was largely descoped from the original DANSE WBS. Why? –Existing scope is already large –Many of the existing single crystal requirements that we identified could be satisfied with existing software once integrated intensities are extracted from the data –Novel uses of single crystal data (e.g., analyzing diffuse scattering) are very exciting but still very much at the research stage. These were in the WBS as research grade, not production grade, tasks and were descoped when we were over-budget –Our expectation is that most of the data-reduction tasks to obtain integrated intensities will be handled by the SNS data reduction group –Our knowledge of single crystal is lower Therefore, the only tasks that remained in DiffDANSE were interfacing SNS reduction routines to the DANSE framework.

New Possibility Funding request to DMR from Dennis and Ruth Mikkelson and Tibor Koritsanszky to support single crystal developments Proposal to integrate these with DANSE and SNS developments DiffDANSE proposal: This development can be integrated into the DiffDANSE software development process –Use the same svn and Trac infrastructure –Development software engineering work-products synchronized with DiffDANSE standards will ease releases and transition to SNS –Ensure interoperability of single crystal components with other DiffDANSE and DANSE modules by tighter integration into the DiffDANSE group