GSCII Project Gauging the quality of the GSCII DB with QA_2plates: First results R. Pannunzio, R. Morbidelli, A Spagna, M. G.Lattanzi.

Slides:



Advertisements
Similar presentations
Original Figures for "Molecular Classification of Cancer: Class Discovery and Class Prediction by Gene Expression Monitoring"
Advertisements

Describing Quantitative Variables
Chapter 2 Exploring Data with Graphs and Numerical Summaries
Copyright © 2010, 2007, 2004 Pearson Education, Inc. All Rights Reserved. Lecture Slides Elementary Statistics Eleventh Edition and the Triola.
Slide Slide 1 Copyright © 2007 Pearson Education, Inc Publishing as Pearson Addison-Wesley. Lecture Slides Elementary Statistics Tenth Edition and the.
Modeling Process Quality
Visual Documentation v User Interface Active class (for selection and some processes)
Assessment. Schedule graph may be of help for selecting the best solution Best solution corresponds to a plateau before a high jump Solutions with very.
Chapter18 Determining and Interpreting Associations Among Variables.
Chapter 7 Data Screening From: McCune, B. & J. B. Grace Analysis of Ecological Communities. MjM Software Design, Gleneden Beach, Oregon
Regression Diagnostics - I
B a c kn e x t h o m e Classification of Variables Discrete Numerical Variable A variable that produces a response that comes from a counting process.
Visual Documentation v User Interface Active class (for selection and some processes)
Descriptive Statistics  Summarizing, Simplifying  Useful for comprehending data, and thus making meaningful interpretations, particularly in medium to.
Geo479/579: Geostatistics Ch13. Block Kriging. Block Estimate  Requirements An estimate of the average value of a variable within a prescribed local.
Programming in R Describing Univariate and Multivariate data.
Descriptive Statistics  Summarizing, Simplifying  Useful for comprehending data, and thus making meaningful interpretations, particularly in medium to.
Quantitative Skills: Data Analysis and Graphing.
1 Statistical Analysis - Graphical Techniques Dr. Jerrell T. Stracener, SAE Fellow Leadership in Engineering EMIS 7370/5370 STAT 5340 : PROBABILITY AND.
Chapter 2 Summarizing and Graphing Data
Census A survey to collect data on the entire population.   Data The facts and figures collected, analyzed, and summarized for presentation and.
Univariate Data Chapters 1-6. UNIVARIATE DATA Categorical Data Percentages Frequency Distribution, Contingency Table, Relative Frequency Bar Charts (Always.
Chapter 2 Describing Data.
Wednesday, May 13, 2015 Report at 11:30 to Prairieview.
Seminars on formation and evolution of the Galaxy Feb 12, 2002 The construction of the GSC2.2 Catalog Mario G. Lattanzi Osservatorio Astronomico di Torino.
Chapter 3 Data Visualization 1. Introduction Data visualization involves: Creating a summary table for the data. Generating charts to help interpret,
Chapter 2 Graphs, Charts, and Tables - Describing Your Data ©
GRAPHS AND NUMBERS 1 / 1 As we study graphs and numerical summaries, we keep firmly in mind where the data come from and what we hope to learn from them.
© Copyright McGraw-Hill Correlation and Regression CHAPTER 10.
Descriptive statistics Petter Mostad Goal: Reduce data amount, keep ”information” Two uses: Data exploration: What you do for yourself when.
Geo479/579: Geostatistics Ch4. Spatial Description.
Statistics: Scatter Plots and Lines of Fit
Numerical Measures. Measures of Central Tendency (Location) Measures of Non Central Location Measure of Variability (Dispersion, Spread) Measures of Shape.
© Tan,Steinbach, Kumar Introduction to Data Mining 8/05/ Data Mining: Exploring Data Lecture Notes for Chapter 3 Introduction to Data Mining by Tan,
Quality Improvement Tools CHAPTER SIX SUPPLEMENT McGraw-Hill/Irwin Copyright © 2011 by the McGraw-Hill Companies, Inc. All rights reserved.
MGL/OATo 7th GSC2 Meeting, Barolo (I), 22 Oct 2001 The GSC2.2 Catalog: Global Properties Mario G. Lattanzi Osservatorio Astronomico di Torino.
Copyright © 2010 Pearson Education, Inc. Publishing as Prentice Hall2(2)-1 Chapter 2: Displaying and Summarizing Data Part 2: Descriptive Statistics.
Chapter 4 – Measurements of Location and Position Math 22 Introductory Statistics.
NGST/NEXUS Operations Jane Morrison October 19, 2000 Nexus NGST.
Equations of Circles. You can write an equation of a circle in a coordinate plane, if you know: Its radius The coordinates of its center.
GSC-II Classifications Oct 2000 Annual Meeting V. Laidler G. Hawkins, R. White, R. Smart, A. Rosenberg, A. Spagna.
Pisa, 4 May 2009 Alessandro Spagna A new kinematic survey (from GSC-II and SDSS-DR7) to study the stellar populations of the Milky Way Alessandro Spagna.
By Sariaya Phillips. Are all galaxies alike in the universe? *I investigated this question based upon the color variations of stars in galaxies. My new.
1 Giuseppe Romeo Voronoi based Source Detection. 2 Voronoi cell The Voronoi tessellation is constructed as follows: for each data point  i (also called.
1 Statistical Analysis - Graphical Techniques Dr. Jerrell T. Stracener, SAE Fellow Leadership in Engineering EMIS 7370/5370 STAT 5340 : PROBABILITY AND.
3/13/2016 Data Mining 1 Lecture 2-1 Data Exploration: Understanding Data Phayung Meesad, Ph.D. King Mongkut’s University of Technology North Bangkok (KMUTNB)
Astrometry with Schmidt Plates Difficulty in attaining highly accurate positions -Bending of plates as they are placed in plate holder -Characteristics.
GSPC -II Program GOAL: extend GSPC-I photometry to B = V ˜ 20 add R band to calibrate red second-epoch surveys HOW: take B,V,R CCD exposures centered at.
(Unit 6) Formulas and Definitions:. Association. A connection between data values.
Describing Data Week 1 The W’s (Where do the Numbers come from?) Who: Who was measured? By Whom: Who did the measuring What: What was measured? Where:
Thursday, May 12, 2016 Report at 11:30 to Prairieview
Probability and Statistics for Computer Scientists Second Edition, By: Michael Baron Chapter 8: Introduction to Statistics CIS Computational Probability.
CHAPTER 2 Modeling Distributions of Data
Chapter 4 Review December 19, 2011.
To compare information such as the mean and standard deviation it is useful to be able to describe how far away a particular observation is from the mean.
Topic 5: Exploring Quantitative data
Volume 87, Issue 1, Pages (July 2015)
Figure 4-1 (p.104) The statistical model for defining abnormal behavior. The distribution of behavior scores for the entire population is divided into.
Warmup Normal Distributions.
Basic Practice of Statistics - 3rd Edition
Basic Practice of Statistics - 3rd Edition
CHAPTER 2 Modeling Distributions of Data
Indicator Variables Response: Highway MPG
Chapter 3 Modeling Distributions of Data
Detecting Dark Clouds in the Galactic Plane with 2MASS data
Fall Final Topics by “Notecard”.
Normal as Approximation to Binomial
Biostatistics Lecture (2).
Data exploration and visualization
Descriptive Statistics Civil and Environmental Engineering Dept.
Presentation transcript:

GSCII Project Gauging the quality of the GSCII DB with QA_2plates: First results R. Pannunzio, R. Morbidelli, A Spagna, M. G.Lattanzi

Diagram of QA_2plates procedures

QA_2Plates First level procedures (connection with CIQA) Procedure nameLevelDescriptionStatus Input_variables Common Allows proper data transfer from the FDB to IDL (required for compatibility with CIQA) Operational Output_variables Common Declares the names of the internal variables used by the QA_2Plates procedures “ “ Define_internal_variables First Generates values for internal variables (defined in Output_variables) from the FDB values read in Input_variables “ “ Evaluate_magnitudes First Computes the magnitude ranges of the measured objects on both plates “ “ Class_index First Generates tables of indices for all combinations among objects with different classification (needed by several procedures that require classification codes) “ “

QA_2Plates: s econd level procedures Procedure nameLevelDescriptionStatus Write_reportSecond Write an ASCII report file with relevant statistical information on the given plates Operational ClassesSecond Generates histograms describing the relative (to the overlap plate) performance of the classifier on the source plate as a function of magnitude “ “ Plate_overlap_2platesSecond Graphic representation of the overlap area between the two plates and most relevant information on the plates themselves (location on sky, passband,...) “ “ VectorsSecond Vector representation of mean errors in position as function of position on plate (classification is also considered) “ “ TrendsSecond Plots mean positional and magnitude differences vs magnitude (object classifications also considered) “ “ Deep_histogramsSecond Generates histograms for magnitude and position differences (between the two plates) for all possible classification combinations of the matched objects “ “ Magnitude_histogramsSecond Plots histograms of positional differences as a function of magnitude bins and for all possible classifications cases “ “ Write_reportSecond Calculates and displays histograms of counts of stars, non stars, and defects as a function of magnitude for the two plates. “ “

QA_2Plates: Third level procedures Procedure nameLevelDescriptionStatus Make_trends Third Called by the routine TrendsOperational Make_histogram Third Called by Deep_histograms “ “ Make_vectors Third Called by Vectors “ “ Mag_make_histogram Third Called by Magnitude_histograms “ “ Mag _vectors Third Called by Vectors “ “ Write_deep_informations Third Called by Write_report “ “ Other ???…….Called by the routine Trends…………

Star counts

Magnitude equation

D(mag) vs mag

Positional error as function of plate position

Magnitude error as function of plate position

The sample of processed plates NUMBER OF SOURCE PLATES067 NUMBER OF PLATE PAIRS QAed 840 PAIRS OF GSC I-II/GSCII PLTS WITH RELIABLE RESULTS PAIRS OF GSC I-II /GSCII PLTS WITH SAME COL.DIFF.AREA PAIRS OF GSC I-II /GSCII PLTS WITH SAME AREA DIFF.COL PAIRS OF GSC I-II /GSCII PLTS WITH DIFF.COL.- DIFF.AREA PAIRS OF GSC I-II /GSCII WITH SAME COL. AND SAME AREA011000

GALACTIC REPRESENTATION OF THE GSCII PLATES AT OATO Source (+) Overlap ( )

Results from GSCII plate pairs STARS-STARS NON STARS - NON STARS      mag      mag  MEAN VAL.GSCII ALL DATA  GSCII ALL DATA MEAN VAL. GSCII SAME COL  OF GSCII SAME COL MEAN VAL.GSCII SAME AREA  OF GSCII SAME AREA MEAN VAL.GSCII DIFF.AREA - COL  OF GSCII DIFF. AREA - COL

Results of generic pair of plates  0 – 0  3 – 3  MEAN of ALL GSCII PAIRS  of ALL GSCII PAIRS MEAN of PAIRS WITH SAME COLOR  of PAIRS WITH SAME COLOR MEAN of PAIRS WITH SAME AREA  of PAIRS WITH SAME AREA MEAN of PAIRS WITH DIFF. AREA AND COLOR  of PLTS WITH DIFF. AREA AND COLOR

Percentage of outliers

Comparison GSCI + GSCII and GSCII plates (  case ) stars – stars

Comparison GSCI + GSCII and GSCII plates (  case ) stars – stars

Comparison GSCI + GSCII and GSCII plates (  case ) nostars – nostars

Comparison GSCII plates (  case ) stars/stars and non stars/non stars

Comparison GSCII (  ) star-star case

Comparison GSCII (  ) non star-non star case

Comparison GSCII (  ) star-star case, same color

Comparison GSCII (  ) star/star and non-star/non-star case same color

Comparison GSCII (  ) star/star case same area/diff. color and same color/diff. area

Comparison GSCII (  ) non-star/non-star case same area/diff. color and same color/diff. area

Comparison GSCII (  ) star/star and non-star/non-star same area/diff. color

Comparison GSCI + GSCII and GSCII plates (  magnitude) star–star

Comparison GSCI + GSCII and GSCII plates (  magnitude) non-star/non-star

Comparison GSCII plates (  magnitude) star/star and non-star/non-star

Comparison GSCII (  mag.) star/star case same color/diff. area and same area/diff. color

Comparison GSCII (  mag.) non-stars/non-stars case same color/diff. area and same area/diff. color

Comparison GSCII plates(  mag ) star/star and non-star/non-star same color – diff. area

Comparison GSCII plates(  mag ) star/star and non-star/non-star diff. color – same area

Comparison GSCII plates(  ) star/star and non-star/non-star

Comparison GSCII plates (  and  ) star/star

Comparison GSCII plates(  ) star/star and non-star/non-star same color and different area

Comparison GSCII plates(  ) star/star and non-star/non-star different color and same area

Comparison GSCII plates(  ) star/star diff. color/same area and same color/diff. area

Comparison GSCII plates(  ) non-star/non-star diff. color/same area and same color/diff. area

Comparison GSCII plates(  mag ) star/star and non-star/non-star

Comparison GSCII plates(  mag ) star/star same color/diff. area – diff. Color/same area

Comparison GSCII plates(  mag ) non-star/non-star same color/diff. area – diff. Color/same area

1.THIS IS A FIRST SYSTEMATIC ASSESSMENT OF GSCII DATA QUALITY BASED ON A LIMITED NUMBER OF PLATES. THESE ARE DISTRIBUTED AROUND THE GALACTIC PLANE AND THE GALACTIC POLES. 2.AS EXPECTED, THE ASTROMETRY IN BOTH COORDINATES IS BETTER FOR THE STAR/STAR CASES THAN FOR THE NON-STAR/NON-STAR ONES 3.THE  (  ) IS ON AVERAGE BETTER THAN  (  ) IRRESPECTIVE OF CLASSIFICATION 4.THE ASTROMETRY IS GENERALLY BETTER FOR PLATE PAIRS HAVING SAME AREA AND DIFFERENT COLOR IRRESPECTIVE OF OBJECT CLASSIFICATION 5.THE PHOTOMETRY APPEARS VERY CONSISTENT IRRESPECTIVE OF CLASSIFICATION. ON PAIRS OF EQUAL-BANDPASS PLATES THE AVERAGE ERROR (IN THE DIFFERENCE) IS ~0.3 MAG Summary Notes

Summary Notes (continues) 6.AS EXPECTED, THE MEAN VALUES IN ,  AND (  mag) ARE CENTERED AROUND THE NULL VALUE 7.MORE INTERESTING, THE DEVIATIONS OF ,  AND (  mag) FROM THEIR MEAN VALUES SHOW THE EXPECTED BEHAVIORS FOR THE DIFFRENT CLASSES OF PLATE PAIRS (SAME AREA, DIFFERENT AREA, SAME BANDPASS, DIFF. BANDPASS, ETC.) 8.THIS GLOBAL QA DOES ALLOW THE DETECTION OF ANOMALOUS PLATES, AS IT WAS THE CASE FOR G039 (S020) 9.THIS TYPE OF ANALYSIS NEEDS TO BE RE-RUN ON A REPRESENTATIVE SET OF PLATES IN THE PRODUCTION DB AT ST ScI

First comparison to 2Mass The following figure shows the results of matching GSC2.1.1 data to the 2MASS catalog. The area matched is approximately 30 arcmin in radius and corresponds to a region close to the lower edge of a second generation survey plate. The left panels show the one-dimensional residuals as function of magnitude for the two bandpasses J and F. The rightmost panels show the residuals in distance. Averaging over the whole magnitude range provided the following results: 0.3 +/- 0.5 in RA (on the sky) and 0.5 +/ in DEC.

First comparison to 2MASS data