Scientific computing in x-ray microscopy F. Meirer 1, Y. Liu 2, J.C. Andrews 2, A. Mehta 2, P. Pianetta 2 1 MiNALab, CMM-irst, Fondazione Bruno Kessler,

Slides:



Advertisements
Similar presentations
Experiment Workflow Pipelines at APS: Message Queuing and HDF5 Claude Saunders, Nicholas Schwarz, John Hammonds Software Services Group Advanced Photon.
Advertisements

Storage Devices.
2 Copyright © 2005, Oracle. All rights reserved. Installing the Oracle Database Software.
TechnoTeam Workshop 2011: LMK mobile advanced LMK mobile advanced restrictions, instructions and tips.
Multiple-choice quiz using Content Generator By Sam Lee.
SCANCOMEDICAL Computed Tomography SCANCO User Meeting 2005 Dr. Bruno Koller SCANCO Medical AG
Computational Biology: A Measurement Perspective Alden Dima Information Technology Laboratory
Stanford Synchrotron Radiation Laboratory Software for X-ray Scattering Measurement Apurva Mehta.
Hardware Basics: Inside the Box 2  2001 Prentice Hall2.2 Chapter Outline “There is no invention – only discovery.” Thomas J. Watson, Sr. What Computers.
Analysis and Performance Results of a Molecular Modeling Application on Merrimac Erez, et al. Stanford University 2004 Presented By: Daniel Killebrew.
MCITP: Microsoft Windows Vista Desktop Support - Enterprise Section 1: Prepare to Deploy.
Biomedical Image Analysis and Machine Learning BMI 731 Winter 2005 Kun Huang Department of Biomedical Informatics Ohio State University.
Application of Digital Signal Processing in Computed tomography (CT)
Installing software on personal computer
Maurizio Conti, Siemens Molecular Imaging, Knoxville, Tennessee, USA
Hardware and Software Basics. Computer Hardware  Central Processing Unit - also called “The Chip”, a CPU, a processor, or a microprocessor  Memory (RAM)
Paper on Best implemented scientific concept for E-Governance Virtual Machine By Nitin V. Choudhari, DIO,NIC,Akola By Nitin V. Choudhari, DIO,NIC,Akola.
Digital Graphics and Computers. Hardware and Software Working with graphic images requires suitable hardware and software to produce the best results.
© 2007 Cisco Systems, Inc. All rights reserved.Cisco Public ITE PC v4.0 Chapter 1 1 Personal Computers and Applications Networking for Home and Small Businesses.
Frontiers in 3D scanning Prof Phil Withers Manchester X-ray imaging Facility University of Manchester.
Paper on Best implemented scientific concept for E-Governance projects Virtual Machine By Nitin V. Choudhari, DIO,NIC,Akola.
Operating Systems Networking for Home and Small Businesses – Chapter 2 – Introduction To Networking.
Building a Real Workflow Thursday morning, 9:00 am Lauren Michael Research Computing Facilitator University of Wisconsin - Madison.
Add on cards. Also known as Expansion card or interface adapter. It can be inserted into an expansion slot of a motherboard to add functionality to a.
BLU-ICE and the Distributed Control System Constraints for Software Development Strategies Timothy M. McPhillips Stanford Synchrotron Radiation Laboratory.
Group 1 Remote Computer Monitoring System Nick ConwayDoug Lother James HaggardWes Reinhart.
Chapter 4 Realtime Widely Distributed Instrumention System.
Frontiers in Massive Data Analysis Chapter 3.  Difficult to include data from multiple sources  Each organization develops a unique way of representing.
Detectors for Light Sources Contribution to the eXtreme Data Workshop of Nicola Tartoni Diamond Light Source.
Light Source Reviews The BES Perspective July 23, 2002 Pedro A. Montano Materials Sciences and Engineering Basic Energy Sciences BASIC ENERGY SCIENCES.
DISTRIBUTED COMPUTING. Computing? Computing is usually defined as the activity of using and improving computer technology, computer hardware and software.
Interactive Rendering With Coherent Ray Tracing Eurogaphics 2001 Wald, Slusallek, Benthin, Wagner Comp 238, UNC-CH, September 10, 2001 Joshua Stough.
Building a Real Workflow Thursday morning, 9:00 am Lauren Michael Research Computing Facilitator University of Wisconsin - Madison.
Thoughts on Data Management Nicholas Schwarz Software Services Group Advanced Engineering Support (AES) Division Advanced Photon Source (APS) 25 June 2013.
Detection of Labeling Markers on Synthetic DNA molecules Background Deoxyribonucleic acid (DNA) is the “code of life” that provides the recipe of genetic.
30 Nov 2005User Committee1 Instruments: NAC. 30 Nov 2005User Committee2 Instruments: NAC.
DMBS Internals I. What Should a DBMS Do? Store large amounts of data Process queries efficiently Allow multiple users to access the database concurrently.
Nanco: a large HPC cluster for RBNI (Russell Berrie Nanotechnology Institute) Anne Weill – Zrahia Technion,Computer Center October 2008.
BOĞAZİÇİ UNIVERSITY DEPARTMENT OF MANAGEMENT INFORMATION SYSTEMS MATLAB AS A DATA MINING ENVIRONMENT.
Heterometallic Carbonyl Cluster Precursors Heterometallic molecular cluster precursor - mediate transport and growth of nanoscale bimetallic particles.
Welcome to the PRECIS training workshop
Computing at SSRL: Experimental User Support Timothy M. McPhillips Stanford Synchrotron Radiation Laboratory.
Image Processing A Study in Pixel Averaging Building a Resolution Pyramid With Parallel Computing Denise Runnels and Farnaz Zand.
PROOF tests at BNL Sergey Panitkin, Robert Petkus, Ofer Rind BNL May 28, 2008 Ann Arbor, MI.
 System Requirements are the prerequisites needed in order for a software or any other resources to execute efficiently.  Most software defines two.
CIP HPC CIP - HPC HPC = High Performance Computer It’s not a regular computer, it’s bigger, faster, more powerful, and more.
2: Operating Systems Networking for Home & Small Business.
Capacity Planning in a Virtual Environment Chris Chesley, Sr. Systems Engineer
A U.S. Department of Energy laboratory managed by UChicago Argonne, LLC. Introduction APS Engineering Support Division –Beamline Controls and Data Acquisition.
Information Technology (IT). Information Technology – technology used to create, store, exchange, and use information in its various forms (business data,
Compute and Storage For the Farm at Jlab
DIT314 ~ Client Operating System & Administration
APPENDIX A Hardware and Software Basics
Installation 1. Installation Sources
NRAO VLA Archive Survey
Detection of Labeling Markers on Synthetic DNA molecules
VirtualGL.
BL09-MISTRAL DATA treatment flow-chart for soft X-ray cryo-tomography
BUSINESS PLUG-IN B3 HARDWARE AND SOFTWARE BASICS
Scientific computing in x-ray microscopy
TechnoSpecialist Computers Information Package
Networking for Home and Small Businesses – Chapter 2
IMAGE MOSAICING MALNAD COLLEGE OF ENGINEERING
Tomography at Advanced Photon Source
Networking for Home and Small Businesses – Chapter 2
Operating Systems Networking for Home and Small Businesses – Chapter 2 – Introduction To Networking.
Software for Neutron Imaging Analysis
Lesson 9 Types of Storage Devices.
ECE 477 DESIGN REVIEW TEAM 14  SPRING 2010
Data Management Components for a Research Data Archive
Presentation transcript:

Scientific computing in x-ray microscopy F. Meirer 1, Y. Liu 2, J.C. Andrews 2, A. Mehta 2, P. Pianetta 2 1 MiNALab, CMM-irst, Fondazione Bruno Kessler, Via Sommarive 18, Povo, Trento, Italy 2 Stanford Synchrotron Radiation Lightsource, SLAC National Accelerator Laboratory, Menlo Park, CA 94025, USA SCSC – SLAC Scientific computing workshop 2011

Full field X-ray transmission microscopy Full field X-ray transmission microscopy: -) typical FOV: 15x15 or 30x30 microns 2 -) typical image size: 1024x1024pixels, 12bit grayscale -) typical exposure times: 0.25 – 1 second -) typical file size: 2 Mb (including metadata) -) total writing speed (including overheads for motor movements): ~0.85 seconds per file for 0.25 sec exposure time How many files are needed per experiment? The instrument was upgraded with the capability to execute scripts -> sophisticated experiments involving complex motor movements are now possible -> the number of files per experiment increased drastically (from <100 to several 10000) during the last year and depends on the measurement mode used Schematic diagram of the Zernike phase contrast X-ray microscope X-ray transmission image of the Siemens calibration standard with 30 nm minimum features. FOV: 30x30 microns 2

X-ray microscopy – measurement modes Single image mode Mosaic modeTomography modeEnergy mode Multiple single images are tiled together to cover a larger area One single image for each angle (typically 180 deg in 1 deg steps) One image for each different X-ray energy (elemental imaging, XANES) manual mode automated mode Mosaic tomographyXANES tomography Element-specific tomography Mosaic XANES tomography Element-specific mosaic tomography Mosaic XANES 180 x Nr. of elements 180 x Nr. of energies (~140) Nr. of tiles x Nr. of energies (~140) 180 x nr. of tiles 180 x tiles x energies (~140) 180 x tiles x Nr. of elements MATLAB software packages for data collection and evaluation have been developed for all measurement modes

X-ray microscopy – measurement modes MATLAB software packages for data collection and evaluation have been developed for all measurement modes time 2011: First in situ experiments -) in situ XANES -) in situ mosaics -) in situ tomography

XANES tomography Example: XANES tomography change energy re-align Zoneplate record image(s) record reference image Code & GUI generate script for automated measurement Several 1000 commands (motor movements) are necessary measurementdata pre-processing Code & GUI for: reference correction averaging image alignment (PhCo, SIFT) cropping filtering … data analysis Code & GUI for XANES analysis: (up to 10 6 spectra have to be processed for each single FOV) filtering & XANES normalization edge energy clustering least squares LC fitting PCA & target transformation … Code & GUI for tomographic reconstruction using Filtered Backprojection (FBP) or Iterative Algebraic Reconstruction Technique (i-ART)

Nanostructure & phase imaging of battery electrodes: XANES tomography of NiO/Ni metal particles 3D resolution: ~60nm Total measurement time: ~18h Data processing time: ~5 days (old system, single CPU) 20x faster with new system Visualization: Avizo Fire NiO Ni metal X-ray microscopy at BL6-2 – state of the art 16 different user groups at 6-2 Jan-June % of experiments use automated measurement mode developed software package is freeware and used by 15 groups and beamline scientists at 4 synchrotrons (SSRL, APS, BSRF, NSLS-2 and NSRL) only 2 dedicated workstations for data evaluation at BL 6-2:12Gb Ram, 8 CPUs 32Gb Ram, 24 CPUs average amount of data collected per week: ~1Tb (x2 after processing) > files 24h non-stop data collection: ~250Gb To be improved: a)Data is transferred (also for backup) via network or external drives b)Software is not optimized for read/write operations and disk space usage c)User often don’t have access to necessary hardware d)Users still need help with data evaluation -> improve software documentation e)Need for human interaction during data pre-processing and evaluation Hardware needs Software needs Next steps: improved data management improved automation of data pre-processing (pre-processing during collection) use of GPUs for parallel processing?