Data Reduction using SORTAV

Slides:



Advertisements
Similar presentations
Crystal Quality – A Practical Guide Louis J Farrugia Jyväskylä Summer School on Charge Density August 2007.
Advertisements

Stefan Roesler SC-RP/CERN on behalf of the CERN-SLAC RP Collaboration
Biomedical Statistics Testing for Normality and Symmetry Teacher:Jang-Zern Tsai ( 蔡章仁 ) Student: 邱瑋國.
Principal Component Analysis Based on L1-Norm Maximization Nojun Kwak IEEE Transactions on Pattern Analysis and Machine Intelligence, 2008.
Low x workshop Helsinki 2007 Joël Feltesse 1 Inclusive F 2 at low x and F L measurement at HERA Joël Feltesse Desy/Hamburg/Saclay On behalf of the H1 and.
Chapter 7 Statistical Data Treatment and Evaluation
Errors in Chemical Analyses: Assessing the Quality of Results
PCA + SVD.
Physics 114: Lecture 7 Uncertainties in Measurement Dale E. Gary NJIT Physics Department.
Data Collection and Processing Using APEX2, SHELXTL and the Bruker PHOTON 100 Kevin J. Gagnon
Summary 1 l The Analytical Problem l Data Handling.
Chapter 7: Statistical Analysis Evaluating the Data.
Curve-Fitting Regression
Limitations of Analytical Methods l The function of the analyst is to obtain a result as near to the true value as possible by the correct application.
Evaluating Hypotheses
Ionization. Measuring Ions A beam of charged particles will ionize gas. –Particle energy E –Chamber area A An applied field will cause ions and electrons.
Chapter 3 Experiments with a Single Factor: The Analysis of Variance
Support Vector Regression David R. Musicant and O.L. Mangasarian International Symposium on Mathematical Programming Thursday, August 10, 2000
Statistical Treatment of Data Significant Figures : number of digits know with certainty + the first in doubt. Rounding off: use the same number of significant.
Linear Regression Analysis 5E Montgomery, Peck and Vining 1 Chapter 6 Diagnostics for Leverage and Influence.
The goal of Data Reduction From a series of diffraction images (films), obtain a file containing the intensity ( I ) and standard deviation (  ( I ))
Regression Eric Feigelson. Classical regression model ``The expectation (mean) of the dependent (response) variable Y for a given value of the independent.
Continuous Probability Distribution  A continuous random variables (RV) has infinitely many possible outcomes  Probability is conveyed for a range of.
Relationships Among Variables
 Deviation is a measure of difference for interval and ratio variables between the observed value and the mean.  The sign of deviation (positive or.
The horseshoe estimator for sparse signals CARLOS M. CARVALHO NICHOLAS G. POLSON JAMES G. SCOTT Biometrika (2010) Presented by Eric Wang 10/14/2010.
Model Building III – Remedial Measures KNNL – Chapter 11.
1 Refinement parameters What are the parameters to be determined? atom positional parameters atom thermal motion parameters atom site occupancy parameters.
1 Theoretical Physics Experimental Physics Equipment, Observation Gambling: Cards, Dice Fast PCs Random- number generators Monte- Carlo methods Experimental.
Measurement Uncertainties Physics 161 University Physics Lab I Fall 2007.
LECTURER PROF.Dr. DEMIR BAYKA AUTOMOTIVE ENGINEERING LABORATORY I.
Chapter 5 Errors In Chemical Analyses Mean, arithmetic mean, and average (x) are synonyms for the quantity obtained by dividing the sum of replicate measurements.
3. Spot Finding 7(i). 2D Integration 2. Image Handling 7(ii). 3D Integration 4. Indexing 8. Results Gwyndaf Evans 1, Graeme Winter 1, David Waterman 2,
Lecture 4 Basic Statistics Dr. A.K.M. Shafiqul Islam School of Bioprocess Engineering University Malaysia Perlis
LECTURER PROF.Dr. DEMIR BAYKA AUTOMOTIVE ENGINEERING LABORATORY I.
Ionic Conductors: Characterisation of Defect Structure Lecture 15 Total scattering analysis Dr. I. Abrahams Queen Mary University of London Lectures co-financed.
Lars Ehm National Synchrotron Light Source
SUPA Advanced Data Analysis Course, Jan 6th – 7th 2009 Advanced Data Analysis for the Physical Sciences Dr Martin Hendry Dept of Physics and Astronomy.
Lesson Multiple Regression Models. Objectives Obtain the correlation matrix Use technology to find a multiple regression equation Interpret the.
Center for Radiative Shock Hydrodynamics Fall 2011 Review Assessment of predictive capability Derek Bingham 1.
1. Diffraction intensity 2. Patterson map Lecture
© Copyright McGraw-Hill Correlation and Regression CHAPTER 10.
CHEMISTRY ANALYTICAL CHEMISTRY Fall Lecture 6.
Lesson 18 Integration Scaling Other Corrections. An Overview Integration consists of changing the frame data into numbers—the intensity and the sigma.
Strip-Plot Designs Sometimes called split-block design For experiments involving factors that are difficult to apply to small plots Three sizes of plots.
CHEMISTRY ANALYTICAL CHEMISTRY Fall
Least squares & Rietveld Have n points in powder pattern w/ observed intensity values Y i obs Minimize this function: Have n points in powder pattern w/
3. Spot Finding 7(i). 2D Integration 2. Image Handling 7(ii). 3D Integration 4. Indexing 8. Results 1. Introduction5. Refinement Background mask and plane.
Chapter 20 Classification and Estimation Classification – Feature selection Good feature have four characteristics: –Discrimination. Features.
Analysis of Experimental Data; Introduction
QUANTITATIVE ANALYSIS OF POLYMORPHIC MIXTURES USING INFRARED SPECTROSCOPY IR Spectroscopy Calibration –Homogeneous Solid-State Mixtures –Multivariate Calibration.
Tutorial I: Missing Value Analysis
Single Crystal Software Workshop ECM Louis J. Farrugia, Department of Chemistry University of Glasgow GLASGOW G12 8QQ Scotland Processing of Bruker.
Presentation Outline ANAELU: 2-D XRD texture analysis Experimental 2D XRD patterns Representation of structure Simulation of single-crystal XRD Polycrystal.
And distribution of sample means
Inference about the slope parameter and correlation
Chapter 4 Basic Estimation Techniques
Fundamentals of estimation and detection in signals and images
University of Stellenbosch Business School & Statistics South Africa
Reduce the need for human intervention in protein model building
…Don’t be afraid of others, because they are bigger than you
Statistics Presentation
Introduction to Instrumentation Engineering
Linear Regression.
Multiple Regression Models
Common Problems in Writing Statistical Plan of Clinical Trial Protocol
AP Statistics Day 5 Objective: Students will be able to understand and calculate variances and standard deviations.
Experimental Design Data Normal Distribution
1-Way Random Effects Model
Mean Absolute Deviation
Presentation transcript:

Data Reduction using SORTAV Jyväskylä Summer School on Charge Density August 2007 Data Reduction using SORTAV Louis J Farrugia

Data Reduction using SORTAV Jyväskylä Summer School on Charge Density August 2007 Data Reduction using SORTAV SORTAV is a multi-purpose data reduction program, capable of handling data from area-detectors and scintillation point-detectors. It performs the following tasks 1. Time dependent sample decomposition 2. Inter sub-set scaling 3. Empirical absorption correction based on multiple observations 4. Empirical TDS corrections (point-detectors only) 5. Data averaging and merging 6. Bayesian treatment for weak reflections Input data are raw intensities as taken from integration program. For a charge density analysis, we need to have multiple observations (especially with area-detector data) to improve the precision of experimental structure factors. R. H. Blessing (1987) Crystallogr. Rev. 1, 3

Data Reduction using SORTAV Jyväskylä Summer School on Charge Density August 2007 Data Reduction using SORTAV Absorption corrections Numerical – analytical or by Gaussian quadrature Requires measurement of face indices – can be difficult to measure thin plates accurately. If the sample is medium-strongly absorbing, i.e.  > 3 mm-1, then this method is virtually mandatory for highly accurate work. J. de Meulenaar & H. Tompa (1966) Acta Cryst. A19, 1014 P. Coppens, L. Leiserowitz & D. Rabinovich, D. (1965) Acta Cryst. A18 1035. G. T. DeTitta (1985) J. Appl. Cryst. 18, 75 (crystal in a capilliary)

Data Reduction using SORTAV Jyväskylä Summer School on Charge Density August 2007 Data Reduction using SORTAV Absorption corrections Empirical - requires multiple measurements to determine absorption surface. Aaniso = Ah,i for each ith measurement, Ih,i among nh measurements which are equivalent by symmetry (or through azimuthal rotation). The ylm are real spherical harmonics, and their arguments (-uo and u1) are the reversed-incident and diffracted beam unit direction vectors referred to the crystal-based orthonormal axial system. The alm are refinable coefficients obtained by a least squares fit to minimise the residual 2(summed over the equivalent reflections R. H. Blessing (1995) Acta. Cryst. A51, 33

Data Reduction using SORTAV Jyväskylä Summer School on Charge Density August 2007 Data Reduction using SORTAV Data averaging An advanced feature of SORTAV is the outlier downweighting used, which biases the sample mean towards the sample median. The most appropriate for average data sets is the robust resistant Tukey downweighting (which is chosen by default by the SORTAVGUI). The outliers can also be identified and rejected on input – the program will then repeat the process of downweighting. This can be carried on in a cycle until no new outliers are identified. For a high quality data-set, a few cycles suffice to reach this stage R. H. Blessing (1997) J. Appl. Cryst. 30, 421

Data Reduction using SORTAV Jyväskylä Summer School on Charge Density August 2007 Data Reduction using SORTAV Analysis of variance improves the estimate of (F2)

Data Reduction using SORTAV Jyväskylä Summer School on Charge Density August 2007 Data Reduction using SORTAV Rmerge indices Several merging agreement indices are printed, which including adjustments for small sample statistics. normalised mean absolute deviation R1 the normalised RMS deviation R2 and the RMS standardised deviation Z K. Diederichs & P. A. Karplus (1997) Nature Struct Biol. 4, 269

Jyväskylä Summer School on Charge Density August 2007 The SORTAVGUI

Jyväskylä Summer School on Charge Density August 2007 The SORTAVGUI

Jyväskylä Summer School on Charge Density August 2007 The SORTAVGUI

Jyväskylä Summer School on Charge Density August 2007 The SORTAVGUI