3. Spot Finding 7(i). 2D Integration 2. Image Handling 7(ii). 3D Integration 4. Indexing 8. Results Gwyndaf Evans 1, Graeme Winter 1, David Waterman 2,

Slides:



Advertisements
Similar presentations
EigenFaces and EigenPatches Useful model of variation in a region –Region must be fixed shape (eg rectangle) Developed for face recognition Generalised.
Advertisements

QR Code Recognition Based On Image Processing
電腦視覺 Computer and Robot Vision I
CCP4 workshop Argonne, June 2011 Strategy of diffraction data collection (at synchrotrons) Zbigniew Dauter MCL-NCI & ANL-BIO.
Estimation, Variation and Uncertainty Simon French
電腦視覺 Computer and Robot Vision I Chapter2: Binary Machine Vision: Thresholding and Segmentation Instructor: Shih-Shinh Huang 1.
Practice of analysis and interpretation of X-ray diffraction data
Chem Single Crystals For single crystals, we see the individual reciprocal lattice points projected onto the detector and we can determine the values.
Structure of thin films by electron diffraction János L. Lábár.
Chapter 13 Tetracorder. Simple definition of band depth D = 1 - R b /R c where R b is reflectance in band center and R c is reflectance in continuum at.
Data Collection and Processing Using APEX2, SHELXTL and the Bruker PHOTON 100 Kevin J. Gagnon
© University of Minnesota Data Mining for the Discovery of Ocean Climate Indices 1 CSci 8980: Data Mining (Fall 2002) Vipin Kumar Army High Performance.
Announcements Mailing list: –you should have received messages Project 1 out today (due in two weeks)
Edge Detection Today’s reading Forsyth, chapters 8, 15.1
Edge Detection Today’s readings Cipolla and Gee –supplemental: Forsyth, chapter 9Forsyth Watt, From Sandlot ScienceSandlot Science.
A Novel 2D To 3D Image Technique Based On Object- Oriented Conversion.
The goal of Data Reduction From a series of diffraction images (films), obtain a file containing the intensity ( I ) and standard deviation (  ( I ))
Elementary Crystallography for X-ray Diffraction
Data Analysis I19 Upgrade Workshop 11 Feb Overview Short history of automated processing for Diamond MX beamlines Effects of adding Pilatus detectors.
Microarray Gene Expression Data Analysis A.Venkatesh CBBL Functional Genomics Chapter: 07.
CHE (Structural Inorganic Chemistry) X-ray Diffraction & Crystallography lecture 2 Dr Rob Jackson LJ1.16,
Copyright 2000, Media Cybernetics, L.P. Array-Pro ® Analyzer Software.
ACA meeting July 2009 Highlights. Small Angle Scattering (X-rays, Neutrons) Don’t need.
Multimodal Interaction Dr. Mike Spann
Particle Image Velocimetry 2 and Particle Tracking Velocimetry
Twinning Non-merohedral twinning Merohedral twinning.
Diffraction Basics Coherent scattering around atomic scattering centers occurs when x-rays interact with material In materials with a crystalline structure,
Chem Structure Factors Until now, we have only typically considered reflections arising from planes in a hypothetical lattice containing one atom.
Spatial Interpolation III
Phasing Today’s goal is to calculate phases (  p ) for proteinase K using PCMBS and EuCl 3 (MIRAS method). What experimental data do we need? 1) from.
1. Diffraction intensity 2. Patterson map Lecture
CS654: Digital Image Analysis Lecture 25: Hough Transform Slide credits: Guillermo Sapiro, Mubarak Shah, Derek Hoiem.
Assessing Single Crystal Diamond Quality
Computer Graphics Chapter 6 Andreas Savva. 2 Interactive Graphics Graphics provides one of the most natural means of communicating with a computer. Interactive.
POINTLESS & SCALA Phil Evans. POINTLESS What does it do? 1. Determination of Laue group & space group from unmerged data i. Finds highest symmetry lattice.
Data Harvesting: automatic extraction of information necessary for the deposition of structures from protein crystallography Martyn Winn CCP4, Daresbury.
Lesson 13 How the reciprocal cell appears in reciprocal space. How the non-translational symmetry elements appear in real space How translational symmetry.
Lesson 13 How the reciprocal cell appears in reciprocal space. How the non-translational symmetry elements appear in real space How translational symmetry.
An Introduction to Mosflm (1) what Mosflm does (2) where it fits in the crystallography process (3) run through a typical job (4) introduction to the CCP4.
3. Spot Finding 7(i). 2D Integration 2. Image Handling 7(ii). 3D Integration 4. Indexing 8. Results 1. Introduction5. Refinement Background mask and plane.
BEST strategy / SAD optimization Gleb Bourenkov EMBL-Hamburg Kappa Workgroup Meeting September 28-29, 2009 MAXLAB.
CSE 185 Introduction to Computer Vision Feature Matching.
Atomic structure model
Fourier transform from r to k: Ã(k) =  A(r) e  i k r d 3 r Inverse FT from k to r: A(k) = (2  )  3  Ã(k) e +i k r d 3 k X-rays scatter off the charge.
Crystallography : How do you do? From Diffraction to structure…. Normally one would use a microscope to view very small objects. If we use a light microscope.
AUTOMATION OF MACROMOLECULAR DATA COLLECTION - INTEGRATION OF DATA COLLECTION AND DATA PROCESSING Harold R. Powell 1, Graeme Winter 1, Andrew G.W. Leslie.
Presentation Outline ANAELU: 2-D XRD texture analysis Experimental 2D XRD patterns Representation of structure Simulation of single-crystal XRD Polycrystal.
Mathematical Derivation of Probability
Serial Femtosecond Crystallography
CHARACTERIZATION OF THE STRUCTURE OF SOLIDS
FOURIER THEORY: KEY CONCEPTS IN 2D & 3D
The Crystal Screening Interface at ALS
Organic Chemistry Lesson 21 X-ray crystallography.
Data Reduction using SORTAV
3.1 Clustering Finding a good clustering of the points is a fundamental issue in computing a representative simplicial complex. Mapper does not place any.
Basics of Photometry.
Structure of the Yeast RNA Polymerase II Holoenzyme
Microtubule Structure at 8 Å Resolution
Volume 96, Issue 9, Pages (May 2009)
Rubén Díaz-Avalos, Donald L.D. Caspar  Biophysical Journal 
Microtubule Structure at 8 Å Resolution
Edge Detection Today’s readings Cipolla and Gee Watt,
Introduction to Sensor Interpretation
Michael E Wall, James B Clarage, George N Phillips  Structure 
CSE 185 Introduction to Computer Vision
Introduction to Sensor Interpretation
Volume 84, Issue 3, Pages (March 2003)
Volume 54, Issue 4, Pages (May 2007)
Introduction to Artificial Intelligence Lecture 22: Computer Vision II
Evidence of Cholesterol Accumulated in High Curvature Regions: Implication to the Curvature Elastic Energy for Lipid Mixtures  Wangchen Wang, Lin Yang,
Presentation transcript:

3. Spot Finding 7(i). 2D Integration 2. Image Handling 7(ii). 3D Integration 4. Indexing 8. Results Gwyndaf Evans 1, Graeme Winter 1, David Waterman 2, James Parkhurst 1, Luis Fuentes-Montero 1, Richard Gildea 1, Aaron Brewster 3, Nicholas Sauter 3, 1 Diamond Light Source, 2 CCP4, 3 Lawrence Berkeley National Laboratory 1. Introduction5. Refinement Diffraction Integration for Advanced Light Sources Background mask and plane determination using background pixels, equivalent to that of MOSFLM Default refinement parameterization in DIALS, where the detector, sample and beam are refined: extensions allow for more complex detectors such as CS-PAD at LCLS and the Dectris P12M Background pixel identification via outliers similar to that used in XDS 6. Background Determination Spot finding – raw image, mean, variance map… … dispersion map, threshold map and final centroids Indexing of six lattices from 1° sweep of micro-crystal data 2D profile fitting: averaging of background subtracted reflection profiles to determine optimum 3D profile fitting: background subtracted reflection data mapped to reciprocal space before averaging and fitting Correlation of reflection profiles with reference, over detector and intensity Low resolution limit High resolution limit Rmerge (within I+/I-) Rmeas (within I+/I-) Rpim (within I+/I-) Total number of observations Total number unique Mean((I)/sd(I)) Mn(I) half-set CC(1/2) Completeness Multiplicity Anomalous completeness Anomalous multiplicity DelAnom correlation half-sets Mid-Slope of Anom Probability References: Evans, P. R. & Murshudov, G. N. (2013). Acta Crystallogr. D. Biol. Crystallogr. 69, 1204–1214. Grosse-Kunstleve, R. W., et al. (2002). J. Appl. Crystallogr. 35, 126–136. Kabsch, W. (2010a). Acta Crystallogr. Sect. D Biol. Crystallogr. 66, 133–144. Kabsch, W. (2010b). Acta Crystallogr. Sect. D Biol. Crystallogr. 66, 125–132. Leslie, A. G. W. (1999). Acta Crystallogr. Sect. D Biol. Crystallogr. 1696–1702. Leslie, A. G. W. & Powell, H. R. (2007). Evolving Methods for Macromolecular Crystallography, pp. 41–51. Experimental electron density from fast_ep (SHELX C/D/E) and merging statistics from AIMLESS, from DNA / ligand complex Low resolution limit High resolution limit Rmerge (all I+ and I-) Rmeas (all I+ & I-) Rpim (all I+ & I-) Total number of observations Total number unique Mean((I)/sd(I)) Mn(I) half-set CC(1/2) Completeness Multiplicity R* Rfree* *non protein atoms removed from refinement for difference map calculation Difference density from glucose isomerase test sample, calculated using dimple (CCP4 / REFMAC5) Time varying refinement of unit cell parameters of a 720° radiation damaged thaumatin data set DIALS is a collaborative initiative to produce an open source software toolbox encompassing all aspects of diffraction data analysis. DIALS has been developed as a modular framework that permits flexibility not only in the development of new methods and algorithms but also in the application of these methods to data analysis as illustrated above. DIALS builds on the computational crystallography toolbox cctbx. Positional (i.e. pixel offset x, y) and parallax correction tables for DECTRIS Pilatus 6M SN 100 at Diamond Light Source, I04 (x)(y) (x)(y)

References: Evans, P. R. & Murshudov, G. N. (2013). Acta Crystallogr. D. Biol. Crystallogr. 69, 1204–1214. Grosse-Kunstleve, R. W., et al. (2002). J. Appl. Crystallogr. 35, 126–136. Kabsch, W. (2010a). Acta Crystallogr. Sect. D Biol. Crystallogr. 66, 133–144. Kabsch, W. (2010b). Acta Crystallogr. Sect. D Biol. Crystallogr. 66, 125–132. Leslie, A. G. W. (1999). Acta Crystallogr. Sect. D Biol. Crystallogr. 1696–1702. Leslie, A. G. W. & Powell, H. R. (2007). Evolving Methods for Macromolecular Crystallography, pp. 41– Introduction: Within DIALS a key aim is to be flexible in the approach to data integration. If time is of the essence then the processing may be performed with minimal refinement; however, if time is available recycling may be performed to polish these results. Today DIALS reads data via dxtbx (2) and can perform spot finding (3) indexing (4) refinement (5) background subtraction (6) and integration (7) using a variety of algorithms. For scaling AIMLESS is used. 2. Image Handling: The dxtbx is a software toolkit that provides a general and user extensible approach to the reading and interpretation of diffraction image data and metadata. It implements an extensible plug-in framework allowing developers to add their own modules to support new instruments and file formats. The library also provides simple high-level access to the data from an entire sweep of images and can support complex mappings from mm position on the detector face to image pixel as illustrated in the figures. 3. Spot Finding: A threshold is applied to each image to select peak and background pixels, by calculating the index of dispersion around each pixel, assuming a Poisson distribution for background pixel intensities. A 3D connected component labeling algorithm is applied to the list of peak pixels to create a spot list, the centroids of which are then calculated and the list filtered for spot shape (e.g. for ice rings). 4. Indexing: The indexing in DIALS may be performed using three algorithms: one and three dimensional FFT (with the former derived from LABELIT) and using a new real space grid search method. Multiple lattices may be indexed, as in the figure where spots found on a 1° wedge of data were analyzed and six crystal diffraction patterns were identified. 5. Refinement: The refinement in DIALS allows for a completely general experimental geometry, in terms of the beam, rotation axis and detector, where the parameters μ 1, μ 2 refer to the beam direction, φ 1, φ 2, φ 3 to the crystal orientation and τ 1, τ 2, τ 3 to the detector orietation. The detector may be modeled as a single sensor for e.g. Pilatus 6M or as a collection of panels for e.g. the Pilatus 12M curved detector at Diamond beamline I23 or the CS-PAD detector at the LCLS CXI beamline. The modeling of the crystal allows for globally refined but time-dependent crystal orientation and unit cell parameters, as shown with data from a severely radiation damaged thaumatin crystal. 6. Background Determination: The integration step in DIALS is explicitly split into background subtraction and peak evaluation. Currently two algorithms are implemented for background determination: a plane fit and pixel outlier rejection. The former follows the method in MOSFLM and fits a plane via least squares. The latter follows XDS and determines a constant background across the spot, which is subtracted from every pixel prior to transformation. Following the DIALS philosophy, the choice of background algorithm does not influence the peak integration algorithm choice. 7. Integration: DIALS allows for multiple approaches to the evaluation of peak intensity, using two and three dimensional treatment of the data and straight summation and profile fitting (i.e. currently four integration methods). The two dimensional methods use estimates of the crystal mosaic spread and beam divergence (following the XDS definitions) to identify those pixels belonging to the peak (see mask in 7(i)). For the three dimensional profile fitting those same parameters are used to control the transformation of intensity from image to reciprocal space. 7(i). 2D Integration: the 2D profile fitting aims to perform the integration in the same way as MOSFLM – reflections are interpolated and added to the reference profile, centered on the predicted centroid. The integration uses a weighted average of nearby reference profiles to determine a profile to fit via least squares to each reflection. 7(ii). 3D Integration: here the profile fitting begins by transforming the detector space profiles of each reflection into a local reflection-specific coordinate frame on the Ewald sphere (illustrated on the left of the figure.) This transformation standardizes the appearance of the reflection profiles improving profile fitting. Reference profiles are constructed at 9 points on the detector surface and each reflection is then integrated using the nearest reference profile. 8. Results: the results of processing two data sets with DIALS. Glucose isomerase (top) showing the difference density in the active site calculated with DIMPLE, and the merging statistics from AIMLESS. The second example (bottom) is SAD data from a complex of Λ-[Ru(TAP)2(dppz)] 2+ and d(TCGGCGCCGA) the data for which were also scaled with AIMLESS and solved using fast_ep employing SHELX C/D/E. The correlation of reflection profiles for this second data set are shown on the right, indicating that the correlation of stronger reflections to the reference profile is higher as should be expected. These diagnostics were generated after DIALS processing with the tool dials.analyse_output. Gwyndaf Evans 1, Graeme Winter 1, David Waterman 2, James Parkhurst 1, Luis Fuentes-Montero 1, Richard Gildea 1, Aaron Brewster 3, Nicholas Sauter 3, 1 Diamond Light Source, 2 CCP4, 3 Lawrence Berkeley National Laboratory Diffraction Integration for Advanced Light Sourceshttp://dials.sourceforge.net