Scientific computing in x-ray microscopy

Slides:



Advertisements
Similar presentations
Experiment Workflow Pipelines at APS: Message Queuing and HDF5 Claude Saunders, Nicholas Schwarz, John Hammonds Software Services Group Advanced Photon.
Advertisements

Storage Devices.
2 Copyright © 2005, Oracle. All rights reserved. Installing the Oracle Database Software.
Computational Biology: A Measurement Perspective Alden Dima Information Technology Laboratory
Stanford Synchrotron Radiation Laboratory Software for X-ray Scattering Measurement Apurva Mehta.
MCITP: Microsoft Windows Vista Desktop Support - Enterprise Section 1: Prepare to Deploy.
Biomedical Image Analysis and Machine Learning BMI 731 Winter 2005 Kun Huang Department of Biomedical Informatics Ohio State University.
Installing software on personal computer
Hardware and Software Basics. Computer Hardware  Central Processing Unit - also called “The Chip”, a CPU, a processor, or a microprocessor  Memory (RAM)
Paper on Best implemented scientific concept for E-Governance Virtual Machine By Nitin V. Choudhari, DIO,NIC,Akola By Nitin V. Choudhari, DIO,NIC,Akola.
Digital Graphics and Computers. Hardware and Software Working with graphic images requires suitable hardware and software to produce the best results.
© 2007 Cisco Systems, Inc. All rights reserved.Cisco Public ITE PC v4.0 Chapter 1 1 Personal Computers and Applications Networking for Home and Small Businesses.
Frontiers in 3D scanning Prof Phil Withers Manchester X-ray imaging Facility University of Manchester.
Paper on Best implemented scientific concept for E-Governance projects Virtual Machine By Nitin V. Choudhari, DIO,NIC,Akola.
Operating Systems Networking for Home and Small Businesses – Chapter 2 – Introduction To Networking.
Building a Real Workflow Thursday morning, 9:00 am Lauren Michael Research Computing Facilitator University of Wisconsin - Madison.
Add on cards. Also known as Expansion card or interface adapter. It can be inserted into an expansion slot of a motherboard to add functionality to a.
BLU-ICE and the Distributed Control System Constraints for Software Development Strategies Timothy M. McPhillips Stanford Synchrotron Radiation Laboratory.
Scientific computing in x-ray microscopy F. Meirer 1, Y. Liu 2, J.C. Andrews 2, A. Mehta 2, P. Pianetta 2 1 MiNALab, CMM-irst, Fondazione Bruno Kessler,
Group 1 Remote Computer Monitoring System Nick ConwayDoug Lother James HaggardWes Reinhart.
Detectors for Light Sources Contribution to the eXtreme Data Workshop of Nicola Tartoni Diamond Light Source.
Interactive Rendering With Coherent Ray Tracing Eurogaphics 2001 Wald, Slusallek, Benthin, Wagner Comp 238, UNC-CH, September 10, 2001 Joshua Stough.
Building a Real Workflow Thursday morning, 9:00 am Lauren Michael Research Computing Facilitator University of Wisconsin - Madison.
Thoughts on Data Management Nicholas Schwarz Software Services Group Advanced Engineering Support (AES) Division Advanced Photon Source (APS) 25 June 2013.
30 Nov 2005User Committee1 Instruments: NAC. 30 Nov 2005User Committee2 Instruments: NAC.
“Live” Tomographic Reconstructions Alun Ashton Mark Basham.
Nanco: a large HPC cluster for RBNI (Russell Berrie Nanotechnology Institute) Anne Weill – Zrahia Technion,Computer Center October 2008.
BOĞAZİÇİ UNIVERSITY DEPARTMENT OF MANAGEMENT INFORMATION SYSTEMS MATLAB AS A DATA MINING ENVIRONMENT.
TechnoSpecialist Computers Information Package By Troy Rayner.
CDMS Computing Project Don Holmgren Other FNAL project members (all PPD): Project Manager: Dan Bauer Electronics: Mike Crisler Analysis: Erik Ramberg Engineering:
Mantid Stakeholder Review Nick Draper 01/11/2007.
 System Requirements are the prerequisites needed in order for a software or any other resources to execute efficiently.  Most software defines two.
2: Operating Systems Networking for Home & Small Business.
Planning Server Deployments Chapter 1. Server Deployment When planning a server deployment for a large enterprise network, the operating system edition.
A U.S. Department of Energy laboratory managed by UChicago Argonne, LLC. Introduction APS Engineering Support Division –Beamline Controls and Data Acquisition.
Starter You have 2 minutes to find out: 1.What is the fastest type of computer memory? 2.Where would you normally find it?
Compute and Storage For the Farm at Jlab
Suren Chilingaryan, Andreas Kopmann
Basic Computer Hardware and Software.
DIT314 ~ Client Operating System & Administration
APPENDIX A Hardware and Software Basics
GPU-based iterative CT reconstruction
Current Generation Hypervisor Type 1 Type 2.
By Chris immanuel, Heym Kumar, Sai janani, Susmitha
Installation 1. Installation Sources
NRAO VLA Archive Survey
Lecture 16: Data Storage Wednesday, November 6, 2006.
MCTS Guide to Microsoft Windows 7
VirtualGL.
Spatial Analysis With Big Data
BL09-MISTRAL DATA treatment flow-chart for soft X-ray cryo-tomography
BUSINESS PLUG-IN B3 HARDWARE AND SOFTWARE BASICS
Lecture 11: DMBS Internals
Chapter 2 Objectives Identify Windows 7 Hardware Requirements.
Personal Computers and Applications
TechnoSpecialist Computers Information Package
Networking for Home and Small Businesses – Chapter 2
IMAGE MOSAICING MALNAD COLLEGE OF ENGINEERING
Advanced Topics in Data Management
What Happens if There is no Free Frame?
Deep Neural Networks for Onboard Intelligence
Tomography at Advanced Photon Source
Networking for Home and Small Businesses – Chapter 2
Hilbert-Huang Transform Data Processing System (HHT-DPS) V1.2
Specifications Clean & Match
Operating Systems Networking for Home and Small Businesses – Chapter 2 – Introduction To Networking.
Software for Neutron Imaging Analysis
Lesson 9 Types of Storage Devices.
ECE 477 DESIGN REVIEW TEAM 14  SPRING 2010
Data Management Components for a Research Data Archive
Presentation transcript:

Scientific computing in x-ray microscopy SCSC – SLAC Scientific computing workshop 2011 Scientific computing in x-ray microscopy F. Meirer1, Y. Liu2, J.C. Andrews2, A. Mehta2, P. Pianetta2   1 MiNALab, CMM-irst, Fondazione Bruno Kessler, Via Sommarive 18, 38123 Povo, Trento, Italy 2 Stanford Synchrotron Radiation Lightsource, SLAC National Accelerator Laboratory, Menlo Park, CA 94025, USA

Full field X-ray transmission microscopy Schematic diagram of the Zernike phase contrast X-ray microscope Full field X-ray transmission microscopy: -) typical FOV: 15x15 or 30x30 microns2 -) typical image size: 1024x1024pixels, 12bit grayscale -) typical exposure times: 0.25 – 1 second -) typical file size: 2 Mb (including metadata) -) total writing speed (including overheads for motor movements): ~0.85 seconds per file for 0.25 sec exposure time How many files are needed per experiment? The instrument was upgraded with the capability to execute scripts -> sophisticated experiments involving complex motor movements are now possible -> the number of files per experiment increased drastically (from <100 to several 10000) during the last year and depends on the measurement mode used X-ray transmission image of the Siemens calibration standard with 30 nm minimum features. FOV: 30x30 microns2

X-ray microscopy – measurement modes manual mode Single image mode Multiple single images are tiled together to cover a larger area One single image for each angle (typically 180 deg in 1 deg steps) One image for each different X-ray energy (elemental imaging, XANES) Mosaic mode Tomography mode Energy mode 180 x nr. of tiles Mosaic tomography XANES tomography 180 x Nr. of energies (~140) Nr. of tiles x Nr. of energies (~140) Element-specific tomography 180 x Nr. of elements Mosaic XANES Mosaic XANES tomography 180 x tiles x energies (~140) 180 x tiles x Nr. of elements Element-specific mosaic tomography automated mode MATLAB software packages for data collection and evaluation have been developed for all measurement modes

X-ray microscopy – measurement modes 2011: First in situ experiments -) in situ XANES -) in situ mosaics -) in situ tomography time MATLAB software packages for data collection and evaluation have been developed for all measurement modes

Example: XANES tomography measurement data pre-processing change energy re-align Zoneplate record image(s) record reference image Code & GUI for: reference correction averaging image alignment (PhCo, SIFT) cropping filtering … Code & GUI generate script for automated measurement Several 1000 commands (motor movements) are necessary data analysis Code & GUI for XANES analysis: (up to 106 spectra have to be processed for each single FOV) filtering & XANES normalization edge energy clustering least squares LC fitting PCA & target transformation … Code & GUI for tomographic reconstruction using Filtered Backprojection (FBP) or Iterative Algebraic Reconstruction Technique (i-ART)

X-ray microscopy at BL6-2 – state of the art 16 different user groups at 6-2 Jan-June 2011 100% of experiments use automated measurement mode developed software package is freeware and used by 15 groups and beamline scientists at 4 synchrotrons (SSRL, APS, BSRF, NSLS-2 and NSRL) only 2 dedicated workstations for data evaluation at BL 6-2: 12Gb Ram, 8 CPUs 32Gb Ram, 24 CPUs average amount of data collected per week: ~1Tb (x2 after processing) >150.000 files 24h non-stop data collection: ~250Gb NiO Ni metal Nanostructure & phase imaging of battery electrodes: XANES tomography of NiO/Ni metal particles 3D resolution: ~60nm Total measurement time: ~18h Data processing time: ~5 days (old system, single CPU) 20x faster with new system Visualization: Avizo Fire Next steps: improved data management improved automation of data pre-processing (pre-processing during collection) use of GPUs for parallel processing? To be improved: Data is transferred (also for backup) via network or external drives Software is not optimized for read/write operations and disk space usage User often don’t have access to necessary hardware Users still need help with data evaluation -> improve software documentation Need for human interaction during data pre-processing and evaluation Hardware needs Software needs