Single Crystal Software Workshop ECM21-2003 Louis J. Farrugia, Department of Chemistry University of Glasgow GLASGOW G12 8QQ Scotland Processing of Bruker.

Slides:



Advertisements
Similar presentations
1 GONG Magnetogram pipeline. 2 The GONG Data Processing Pipeline
Advertisements

PLATON TUTORIAL A.L.Spek, National Single Crystal Service Facility,
Introduction to Operation of the XL-30 Scanning Electron Microscope Tutorial # 1 Overview of XL-30 Microscope Control Program.
Computational Biology, Part 23 Biological Imaging II Robert F. Murphy Copyright  1996, 1999, All rights reserved.
With TimeCard appointments are tagged with information that converts them into time sheets. This way users can report time and expenses from their Outlook.
Data preprocessing before classification In Kennedy et al.: “Solving data mining problems”
1 Lites FPP-SP Initial Reduct SOT #17 Meeting, NAOJ, April Solar-B FPP Initial Data Reduction for the FPP Spectro- Polarimeter October, 2004 Bruce.
CMS ECAL Laser Monitoring System Toyoko J. Orimoto, California Institute of Technology, on behalf of the CMS ECAL Group High-resolution, high-granularity.
Data Collection and Processing Using APEX2, SHELXTL and the Bruker PHOTON 100 Kevin J. Gagnon
By Hrishikesh Gadre Session II Department of Mechanical Engineering Louisiana State University Engineering Equation Solver Tutorials.
Data collection, data processing and scaling (1) relationship of Mosflm to CCP4 (2) some thoughts on data collection (3) simple processing with Mosflm.
The System-S Approach to Automated Structure Determination: Problems and Solutions Ton Spek National Single Crystal Service Utrecht University, The Netherlands.
Using SAINT Using SADABS File Name Confusion Data Reduction.
A Fully Automated Small Molecule Single Crystal X-Ray Diffraction System Mark E Light * & Michael B Hursthouse, Department of Chemistry, University of.
Lecture 2: Image filtering
Linear and generalised linear models
The goal of Data Reduction From a series of diffraction images (films), obtain a file containing the intensity ( I ) and standard deviation (  ( I ))
1 1 Slide © 2003 South-Western/Thomson Learning™ Slides Prepared by JOHN S. LOUCKS St. Edward’s University.
Using SAINT Using SADABS File Name Confusion Data Reduction.
Linear and generalised linear models Purpose of linear models Least-squares solution for linear models Analysis of diagnostics Exponential family and generalised.
A Primer on Image Acquisition and Data Reduction Using TheSky6, CCDSoft V5 and Microsoft Excel Thomas C. Smith Dark Ridge Observatory (DRO)
Solving Centrosymmetric Crystal Structures in Non-Centrosymmetric Space Groups Michael Shatruk September 12, 2011.
+ Photoshop – Monitor and Printer Calibration! Drycreekphoto.com.
Face Detection using the Viola-Jones Method
Detector noise analysis (DINO) demo Max Mutchler ACS-R Optimization Campaign dry-dryrun 30 January 2009.
Updated Release of R-Code Occultation Timing Extractor Programmed by Robert L. (Bob) Anderson Presentation by Tony George at the 2014 Bethesda, Maryland.
ACL: Introduction & Tutorial
Hands-on Introduction to R. Outline R : A powerful Platform for Statistical Analysis Why bother learning R ? Data, data, data, I cannot make bricks without.
ITEC224 Database Programming
Lesson 16 Preliminary Steps to Data Collection While there are many types of equipment out there our discussions will be directed at area detectors and.
Blue: Histogram of normalised deviation from “true” value; Red: Gaussian fit to histogram Presented at ESA Hyperspectral Workshop 2010, March 16-19, Frascati,
Twinning Non-merohedral twinning Merohedral twinning.
IVC : a simulation and model-fitting tool for optical-IR interferometry Abstract I present a new software tool, called “Interferometry Visibility Computations”
Analysis of E852 Data at Indiana University Ryan Mitchell PWA Workshop Pittsburgh, PA February 2006.
Under Supervision of Dr. Kamel A. Arram Eng. Lamiaa Said Wed
GDT Development Tutorial. GDT Development Tutorial Doug Evans and Detlef Lexut GDT 2008 International User Conference August 10 – 13  Lake Las Vegas,
Lesson 16 CCD Detectors Visit the Lab. Charged Coupled Device The ccd is essentially a digital camera To keep noise down it is cooled It is almost realtime.
Lesson 18 Integration Scaling Other Corrections. An Overview Integration consists of changing the frame data into numbers—the intensity and the sigma.
The Software Development Process
CSC508 Convolution Operators. CSC508 Convolution Arguably the most fundamental operation of computer vision It’s a neighborhood operator –Similar to the.
Least squares & Rietveld Have n points in powder pattern w/ observed intensity values Y i obs Minimize this function: Have n points in powder pattern w/
Sep 13, 2006 Scientific Computing 1 Managing Scientific Computing Projects Erik Deumens QTP and HPC Center.
Lecture 2: Filters.
14 January Observational Astronomy SPECTROSCOPIC data reduction Piskunov & Valenti 2002, A&A 385, 1095.
Tutorial I: Missing Value Analysis
Learning Objectives Understand the concepts of Information systems.
Project Planning Defining the project Software specification Development stages Software testing.
GCSE ICT 3 rd Edition The system life cycle 18 The system life cycle is a series of stages that are worked through during the development of a new information.
Judging the Quality of a Crystal. Determining the Best Exposure Time. Data Collection Strategy. From Crystal to Diffraction Pattern.
Aggregator Stage : Definition : Aggregator classifies data rows from a single input link into groups and calculates totals or other aggregate functions.
Modeling Space/Time Variability with BMEGUI Prahlad Jat (1) and Marc Serre (1) (1) University of North Carolina at Chapel Hill.
Chapter 14 EXPLORATORY FACTOR ANALYSIS. Exploratory Factor Analysis  Statistical technique for dealing with multiple variables  Many variables are reduced.
Tool Support for Testing Classify different types of test tools according to their purpose Explain the benefits of using test tools.
MODEL DIAGNOSTICS By Eni Sumarminingsih, Ssi, MM.
Automating the Single Crystal X-Ray Diffraction Experiment – Mark Light – School of Chemistry - University of Southampton – ECM22 – Budapest 2004 Automating.
HYDRA Framework. Setup of software environment Setup of software environment Using the documentation Using the documentation How to compile a program.
AutoDidge Digitizing scanned well log images. Autodidge AUTODIDGE is a program that allows you to digitize scanned well log images to capture curve data.
1 Least squares & Rietveld Have n points in powder pattern w/ observed intensity values Y i obs Minimize this function:
Software Testing.
Adaptive Median Filter
WORKSHOP 7 PID TUNING.
NAC flat fielding and intensity calibration
A Practical Workshop on EXAFS Shell Fitting for Environmental Samples
UNIVERSITY OF MASSACHUSETTS Dept
Motion Segmentation with Missing Data using PowerFactorization & GPCA
Data Reduction using SORTAV
ENFORCED MOTION IN TRANSIENT ANALYSIS
Other Xport data analysis and reduction components
M. Kezunovic (P.I.) S. S. Luo D. Ristanovic Texas A&M University
Presentation transcript:

Single Crystal Software Workshop ECM Louis J. Farrugia, Department of Chemistry University of Glasgow GLASGOW G12 8QQ Scotland Processing of Bruker & Nonius CCD data

Single Crystal Software Workshop ECM Processing of Bruker & Nonius CCD data There are two main stages of CCD data processing : First procedure is specialised, involves many corrections to the raw CCD data - no facilities in WinGX for this (Denzo, EvalCCD, SAINT). Second procedure is handled in WinGX by a variety of routes Frame integration relies on “black box” commercial software. Frame integration - extraction of intensities from images Post processing - error modelling, merging, abs corrections, etc

Single Crystal Software Workshop ECM

Denzox program Denzox was written by Bob Blessing, but extensively modified in Glasgow Reads.x files produced by Denzo and concatenates data does little massaging of reflection intensities transfers fulls transparently - no change in I or  (I) simple statistical summation of partials to provide I and  (I) some rejection criteria -  2 of fit, partials at edge of scan set, sin  / calculates direction cosines re-indexing for equivalent orientation matrices (NOT re-orientation !) various possibilities for batch number - frame, scan-set, experiment output file denzox_hkl.sortav for Sortav (or Gaussian abs correction) output file denzox.sad for Sadabs

Single Crystal Software Workshop ECM

Processing of KappaCCD data

Single Crystal Software Workshop ECM Processing of KappaCCD data Most data reduction programs handled through KappaCCD GUI Load cell from various sources Filter data by sin(  ) or batch no. Quick view of data quality by Weiss or Diederich - Karplus programs Concatenation of input files Plots (Sortav)

Single Crystal Software Workshop ECM Processing of KappaCCD data Most data reduction programs handled through KappaCCD GUI Load cell from various sources Filter data by sin(  ) or batch no. Quick view of data quality by Weiss or Diederich - Karplus programs Concatenation of input files Plots (Sortav)

Single Crystal Software Workshop ECM Denzox GUI Denzox by R. Blessing Reads.x files and calculates direction cosines + batch no.’s Writes out files denzox_hkl.sortav denzox.sad Reads.x files from disk files or CD-ROM Allows for Denzo matrix variation

Single Crystal Software Workshop ECM Sortav GUI Sortav by R. Blessing Pre-correction with GAUSSIAN abs. cor. Apply frame/batch scaling Apply empirical absorption correction Data merging & reject outliers Check that parameters are correct !

Single Crystal Software Workshop ECM Sortav GUI - Empirical absorption Requires sufficient data redundancy Uses spherical harmonics to model absorption anisotropy Odd harmonics used to model non- centrosymmetric systematic errors  -dependency also possible R. H. Blessing, Acta Crystallogr., Sect A 1995, 51,

Single Crystal Software Workshop ECM Sortav GUI - Merging Several schemes for outlier rejection Normally use Tukey downweighting and rejection of outliers “Autoreject Outliers” until no further ones found R. H. Blessing, J Apply Cryst 1997, 30,

Single Crystal Software Workshop ECM Sortav GUI - Output Save intermediate results here Controls number of plots and verbosity of output. Remove unwanted files R. H. Blessing, J Apply Cryst 1997, 30,

Single Crystal Software Workshop ECM Sortav GUI - Results Shows outliers and rejected reflections Shown missing reflections R. H. Blessing, J Apply Cryst 1997, 30,

Single Crystal Software Workshop ECM Processing of SMART/SAINT data Reads in all.RAW files found in directory Provides ranges of Intensities, exposure time, frame numbers. Necessary to provide batch numbers for scaling. In this example, files should be processed in four batches

Single Crystal Software Workshop ECM Processing of SMART/SAINT data Choose which sets of RAW files to concatenate

Single Crystal Software Workshop ECM Processing of SMART/SAINT data Choose which sets of RAW files to concatenate Decide on way to derive batch numbers for scaling Write file concat_hkl.sortav which is exact translation of the data in RAW file. Suitable for merging etc with Sortav