ASPCAP Review Progress report and schedule Q2. SOFTWARE PACKAGES October 4-5, 2012 4/14/2015.

Slides:



Advertisements
Similar presentations
Introduction to Linux Recap Installing programs Introduction to Video Editing with Linux.
Advertisements

Automating Software Module Testing for FAA Certification Usha Santhanam The Boeing Company.
Copyright © 2008 SAS Institute Inc. All rights reserved. SAS and all other SAS Institute Inc. product or service names are registered trademarks or trademarks.
Page 1GlobColour CDR Meeting – July 10-11, 2006, ESRIN All rights reserved © 2006, ACRI-ST Resulting Technical Specification.
Copyright © The OWASP Foundation Permission is granted to copy, distribute and/or modify this document under the terms of the Creative Commons Attribution-ShareAlike.
Chemical Cartography with SDSS/APOGEE Michael Hayden (NMSU), Jo Bovy (IAS), Steve Majewski (UVa), Jennifer Johnson (OSU), Gail Zasowski (JHU), Leo Girardi.
Quick Review of Apr 10 material B+-Tree File Organization –similar to B+-tree index –leaf nodes store records, not pointers to records stored in an original.
Case Studies of Batch Processing Experiments Diane K. Michelson International Sematech Statistical Methods May 21, 2003 Quality and Productivity Research.
Silberschatz, Galvin and Gagne  2002 Modified for CSCI 399, Royden, Operating System Concepts Operating Systems Lecture 19 Scheduling IV.
Session 21-2 Session 23 Direct Loan Tools Session 21-3 Direct Loan Tools Version 1.0 n Introductions n Questions n Evaluations.
Object Oriented Design An object combines data and operations on that data (object is an instance of class) data: class variables operations: methods Three.
Using Metacomputing Tools to Facilitate Large Scale Analyses of Biological Databases Vinay D. Shet CMSC 838 Presentation Authors: Allison Waugh, Glenn.
Science Advisory Committee Meeting - 20 September 3, 2010 Stanford University 1 04_Parallel Processing Parallel Processing Majid AlMeshari John W. Conklin.
Deploying Visual Studio Team System 2008 Team Foundation Server at Microsoft Published: June 2008 Using Visual Studio 2008 to Improve Software Development.
Neural Network Tools. Neural Net Concepts The package provides a “standard” multi-layer perceptron –Composed of layers of neurons –All neurons in a layer.
APOGEE DR10 Everybody. Data taken from April 2011 through July 2012 – First year survey data all observed spectra, even if all visits not complete: summed.
Welcome to SasView Code Camp III Getting started: Where we are Some news about changes already before we start Work Packages Schedule of camp Planning.
Solutions Summit 2014 Discrepancy Processing & Resolution Terri Sullivan.
WorkPlace Pro Utilities.
13 ° COSMO General Meeting Rome VERSUS2 Priority Project Report and Plan Adriano Raspanti.
Rsv-control Marco Mambelli – Site Coordination meeting October 1, 2009.
Multimodal Interaction Dr. Mike Spann
Accessing APOGEE Data Jon Holtzman (NMSU) APOGEE team.
Database structure for the European Integrated Tokamak Modelling Task Force F. Imbeaux On behalf of the Data Coordination Project.
Scalable Systems Software Center Resource Management and Accounting Working Group Face-to-Face Meeting October 10-11, 2002.
SDSS Quasars Spectra Fitting N. Kuropatkin, C. Stoughton.
EÖTVÖS UNIVERSITY BUDAPEST Department of Physics of Complex Systems VO Spectroscopy Workshop, ESAC Spectrum Services 2007 László Dobos (ELTE)
Evaluating FERMI features for Data Mining Applications Masters Thesis Presentation Sinduja Muralidharan Advised by: Dr. Gagan Agrawal.
1998 PI System Users’ Conference PI 3.2 New Features Enhancements Product Support Plans for the next release.
Outline 3  PWA overview Computational challenges in Partial Wave Analysis Comparison of new and old PWA software design - performance issues Maciej Swat.
APOGEE-2 Data Infrastructure Jon Holtzman (NMSU) APOGEE team.
The european ITM Task Force data structure F. Imbeaux.
The Functions of Operating Systems Desktop PC Operating Systems.
APOGEE-2 and Data Infrastructure Jon Holtzman (NMSU) APOGEE team (Steve Majewski, PI)
APOGEE DR12 Status/Discussion. Schedule Nominal DR12 deadline is July 31, i.e. tomorrow SDSS-III upper level management was consulted about a small delay.
SONIC-3: Creating Large Scale Installations & Deployments Andrew S. Neumann Principal Engineer, Progress Sonic.
The Software Development Process
SONIC-3: Creating Large Scale Installations & Deployments Andrew S. Neumann Principal Engineer Progress Sonic.
EGEE is a project funded by the European Union under contract IST “Interfacing to the gLite Prototype” Andrew Maier / CERN LCG-SC2, 13 August.
Coevolutionary Automated Software Correction Josh Wilkerson PhD Candidate in Computer Science Missouri S&T.
Module: Software Engineering of Web Applications Chapter 2: Technologies 1.
Sked: Past, Present & Future John M. Gipson NVI, Inc./GSFC 3rd IVS General Meeting Ottawa, Ontario February 9-11, 2003.
Optimization Strategies for the NIRSpec MSA Planning Tool James Muzerolle.
Student Financial Assistance. Session 17-2 Session 17 Direct Loan Tools More Uses Than Duct Tape.
Chemical Compositions of Stars from IGRINS Spectra; the Good, the Risky, and the Ugly some comments on the uses and abuses of ordinary stellar abundance.
Lecture 3 With every passing hour our solar system comes forty-three thousand miles closer to globular cluster 13 in the constellation Hercules, and still.
APOGEE-2 SRD Mini-Review December 5, 2013 APOGEE-2 SRD Data and Pipeline Requirements Jon Holtzman New Mexico State.
Anders Nielsen Technical University of Denmark, DTU-Aqua Mark Maunder Inter-American Tropical Tuna Commission An Introduction.
WebScan: Implementing QueryServer 2.0 Karl Geiger, Amgen Inc. BRS NA UG August 1999.
Information Systems Design and Development Technical Implications (Software) Computing Science.
Geant4 GRID production Sangwan Kim, Vu Trong Hieu, AD At KISTI.
A Web Based Job Submission System for a Physics Computing Cluster David Jones IOP Particle Physics 2004 Birmingham 1.
Installing Windows 7 Lesson 2.
MECH 373 Instrumentation and Measurements
ITIL: Service Transition
Root I/O and the Gaudi Framework
Overview Modern chip designs have multiple IP components with different process, voltage, temperature sensitivities Optimizing mix to different customer.
OpenPBS – Distributed Workload Management System
Software Metrics 1.
The Use of AMET and Automated Scripts for Model Evaluation
Software Testing With Testopia
Hot subdwarfs from the SDSS/BOSS
Workflow Best Practices
Introduction of Week 3 Assignment Discussion
Skill Based Assessment
OPS235 PACKAGE MANAGEMENT
LO4 - Be Able to Update Websites to Meet Business Needs
Overview of Workflows: Why Use Them?
ASPCAP Review Progress report and schedule Software/data status
M. Kezunovic (P.I.) S. S. Luo D. Ristanovic Texas A&M University
Presentation transcript:

ASPCAP Review Progress report and schedule Q2. SOFTWARE PACKAGES October 4-5, /14/2015

Q2. SOFTWARE PACKAGES 4/14/2015 ASPCAP PRE-PROCESS AND CLASSIFY APOGEE STELLAR SPECTRA FOR STELLAR PARAMETERS DETERMINATIONS ESTIMATE STELLAR PARAMETERS ESTIMATE THE STELLAR CHEMICAL ABUNDANCES ORGANISE RESULTS PRE-PROCESS DATA FOR STELLAR ABUNDANCE DETERMINATIONS ORGANISE RESULTS in develop.

Q2. SOFTWARE PACKAGES 4/14/2015 FERRE and the IDL wrapper Two of the three main ASPCAP’s component. The third component is a multidimensional library of synthetic spectra. FERRE is a Fortran code that fits a set of input data (e.g., spectra) to a grid of models (e.g, synthetic spectra) through a chi-2 minimization and returns the model parameters. The code performs NRUN searches starting from random starting points (developed at IAC) and has several algorithms to find the minima.

Q2. SOFTWARE PACKAGES 4/14/2015 The code performs NRUN searches starting from random starting points (developed at IAC) and has several algorithms to find the minima. There are two tagged versions (v3.5.8 and v3.7.0). The last version has the possibility of evaluate the chi2 value either in the compressed or in the full flux space when using PCA compression.

Q2. S OFTWARE PACKAGES 4/14/2015 The IDL WRAPPER does pre- and post-processing, and produce FERRE jobs -Pre-processing: read data, resample (if necessary), normalize and remove bad points (several versions exists). -Create and submit FERRE jobs in a serial or queue mode (using PBS). -Post-processing: create plots and bundle ASPCAP results into FITS tables with parameters, spectra, best-fits etc.

The code has three branches: Carlos’ (qaspcap), Jon’s and Ana’s version. -qaspcap, only pre-processing and stellar parameter determination for experimental purposes (developed at IAC). -Jon’s, stellar parameter (developed at NMSU). -Ana’s, stellar parameters (developed at UVa). Ana’s covers many cases (different resampling options, different errors) and has been developed to have more functionality (both stellar parameter and abundances, avoid multiple pre-processing in the case of analysis of several classes), much of which is not in use at the moment. Q2. S OFTWARE PACKAGES 4/14/2015

Q2. S OFTWARE PACKAGES 4/14/2015 Jon’s pre-processing and pipeline structure has been simplified and optimized to work with stellar parameter in the actual setup. Multiple versions are very helpful for detailed comparisons of effects of minor differences in pre-processing, will converge shortly to a scheme: -continuum normalization (with/without masking) matters -handling of errors matters Jon’s and Ana’s are svn controlled and Ana’s has been tagged. Carlos exists as tar ball in the wiki.

Q2. Software packages 4/14/2015 Documentation: -A README file to install the code. -Manual describing the code (needs update). -Data model for apVisit files (needs update), missing for apStar. Pipeline status: -Easy to install with sdss3install (tested at NMSU, IAC had some issues installing ExtUPS). -Handles pipeline version. -Completely functional for stellar parameters and apVisit and recently with apStar files.

Analysis: original thought was to use combined files (apStar), which have higher S/N, however analysis started with individual visits (apVisit files), since they were available earlier. Control sample defined using a set of standard and Kepler stars, and globular clusters covering a range of metallicity (see q3). Analysis status: -First year of observations has been analyzed for apVisit data, ~ 684 observations sets (plate+MJD). Q2. Software packages 4/14/2015

Q2. Software packages 4/14/2015 -v0.3 processed at UVa (old linelist, 7 parameters, pre- and post-shutdown) (not strictly tagged, but can be tracked back) ( ates/results( ates/results) Problem: evaluate chi2 in PCA space (demonstrated to be less effective) -v0.4 processed at IAC (a more recent linelist, 6 parameters with vmicro fixed at 2 km/s, post-shutdown, not strictly tagged) Best results ( ts/( ts/)

Q2. Software packages 4/14/2015 -Test suite of data processed at IAC and NMSU with apStar (also at UVa) and apVisit files: M5, M13, M67 covering a range of metallicities, and Kepler stars (only at IAC and NMSU). Performance at UVa: 4 nodes, 4x16 processors (2x99 Gb, 2x49.4 Gb), INSERT SPEED, 60 IDL licenses -for 6 parameters and 270 spectra (a typical plate) with 2 processor takes ~ 4.5 hrs. -same but for 7 parameters takes ~ 2 days. One year survey 684 plates ~ 5 days 3x less for all the apStar files

Q2. Software packages 4/14/2015 Improvements -Update documentation, including data model. -Modify coarse characterization routines. -Complete the routines for a clever threading. -Test that works with multiple classes. -Update abundance modules and testing.