Key Performance Metrics and End-to-End Testing

Slides:

Advertisements

Similar presentations

SAS 9.3 Enterprise BI Audit & Performance Package

Advertisements

Introduction Build and impact metric data provided by the SGIG recipients convey the type and extent of technology deployment, as well as its effect on.

Active Method Management™ with Select Process Director David Piper Principal Consultant.

1 Parker Factory Display – The Next Generation Next Generation:

Jeliot 3 Producing an Educationally Effective and Usable Tool for Learning, the Case of Jeliot Family Andrés Moreno García Niko Myller Department of Computer.

© 2014 VMware Inc. All rights reserved. BlazeMeter Load Testing Solution with vCloud Air High-level Overview Jan 2015.

LSST Observing Cadences Workshop Feb 27, Workshop Series on Optimizing the LSST Deployment.

Incorporating Automation into an End-to-End Accessibility Program Thomas Logan, HiSoftware – VP Product Management 12 April 2010.

Image Analysis and Manipulation with Photoshop Computational Thinking Presentation of Information with Word & PowerPoint Making Information Available to.

Data-Intensive Science (eScience) Ed Lazowska Bill & Melinda Gates Chair in Computer Science & Engineering University of Washington August 2011.

FLUID IMAGES Being friendly to computers and mobiles, don’t discriminate.

Commissioning the NOAO Data Management System Howard H. Lanning, Rob Seaman, Chris Smith (National Optical Astronomy Observatory, Data Products Program)

Franchise Business Intelligence Feb 8, 2011 UNIT ECONOMICS The Franchisee’s Road to Profitability.

Why load testing? Application insights.

LSST Scheduler status Francisco Delgado Sr. Software Engineer Telescope & Site.

Introduction to World Wide Web Authoring © Directorate of Information Systems and Services University of Aberdeen, 1999 Part II.

1 Radio Astronomy in the LSST Era – NRAO, Charlottesville, VA – May 6-8 th LSST Survey Data Products Mario Juric LSST Data Management Project Scientist.

Restructuring the Library System Centralize functional services Reduce the number of library service points Eliminate duplicative collections and formats.

LSST Scheduler requirements

Committee of Sponsoring Organizations of The Treadway Commission Formed in 1985 to sponsor the National Commission on Fraudulent Financial Reporting “Internal.

A centre of expertise in digital information managementwww.ukoln.ac.uk Accessibility Testing Brian Kelly UKOLN University of Bath Bath, BA2 7AY

ENLARGEMENT Scale factors Centre of enlargement Scale factors Indicates how much to enlarge or reduce the original. Formula = image length divided by.

LSST Alert Management VOEvent Meeting Tucson, AZ December 5-6, 2005 Robyn Allsman,LSSTC/NOAO Maria Nieto-Santisteban, JHU Ray Plante, NCSA Tim Axelrod,

Course: Government Process Re-engineering Day 2 Session 5: Process Mapping Workshop and Exercise on Cause and Effect diagram.

Web software. Two types of web software Browser software – used to search for and view websites. Web development software – used to create webpages/websites.

Using the NSA Presentation to NOAO Users Committee October 5, 2005.

LSST: Preparing for the Data Avalanche through Partitioning, Parallelization, and Provenance Kirk Borne (Perot Systems Corporation / NASA GSFC and George.

APM Automation Solutions Ltd. Good Installation Practice Guidelines Eran Perlstein, Customer Support Director.

Gaining Quit Line Efficiencies Presented by Mary Kate Salley May 3, 2005 NAQC Annual Meeting.

DC2 Post-Mortem/DC3 Scoping February 5 - 6, 2008 DC3 Goals and Objectives Jeff Kantor DM System Manager Tim Axelrod DM System Scientist.

4/24/2017 © 2014 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks.

Quality Assurance Benchmark Datasets and Processing David Nidever SQuaRE Science Lead.

LSST VAO Meeting March 24, 2011 Tucson, AZ. Headquarters Site Headquarters Facility Observatory Management Science Operations Education and Public Outreach.

Your Page Name – Internet Web Browser Fundamental II: Inclusive Practice Giggle Search Search Apps for 21 st Century.

The Use of “Virtual Field Trips” in the Electronic Classroom by D. E. Longer & Randy Gottfried.

Outline Different channels used Website Reports Media Social media Etc. Lessons learned.

@Veeam How to do a backup wrong: Top mistakes Rick Vanover MCITP vExpert VCP Veeam Software.

Distributed Pipeline Programming for Mosaics Or Mario Tips’N’Tricks.

The LSST Data Processing Software Stack Tim Jenness (LSST Tucson) for the LSST Data Management Team Abstract The Large Synoptic Survey Telescope (LSST)

E-COMMERCE & MOBILE COMPUTING. On Technicals… Considerations for evaluating platform Ecommerce Applications Development Process Integration Options Middlewares.

US Department of State Jay Coplon. My Commitment You will get a sense for how we do C&A You will find value in being here All of your questions will be.

George Kola Computer Sciences Department University of Wisconsin-Madison Data Pipelines: Real Life Fully.

Using Classroom Data to Monitor Student Progress Lani Seikaly, Project Director School Improvement in Maryland Web Site.

Infrastructure as Code In real life Mantas Klasavičius.

Adventures and Computational Thinking By: Rachel Choi Overview During this quarter we have learned about Information Technology (IT) fluency, including.

EVLA Data Processing PDR Pipeline design Tim Cornwell, NRAO.

ENGINEERING PRACTICES FOR CONTINUOUS DELIVERY: From Metrics and Deployment Pipelines to Integration and Microservices By Neal Ford with Tim Brown Deployment.

Images were sourced from the following web sites: Slide 2:commons.wikimedia.org/wiki/File:BorromeanRing...commons.wikimedia.org/wiki/File:BorromeanRing...

1 SPIE Astronomical Telescopes + Instrumentation | 26 June - 1 July 2016 | Edinburgh, United Kingdom Investigating interoperability of the LSST Data Management.

1 Board Telescope & Site Tucson, Arizona July 18-20, 2011 LLST Control Software Review Resources Tucson, January

1 OBSERVATORY CONTROL SYSTEM (OCS) FRANCISCO DELGADO OCS CAM.

What to Expect at the LSST Archive: The LSST Science Platform Mario Juric, University of Washington LSST Data Management Subsystem Scientist for the.

Education and Public Outreach goals and priorities

From LSE-30: Observatory System Spec.

Observing Modes: Nominal and Degraded

Quality Control Overview

Optical Survey Astronomy DATA at NCSA

PeopleSoft Application Example: “This is my main dashboard

Current Resources LSST-DEV General Purpose Login/Compute Node. Supports developers and staff. Primary Linux Machine for this use.

Crowded Field Photometry Stars, Milky Way, Local Volume

DM Plans for Crowded Stellar Fields

12/5/2018 Customer Case Study SouthLaw, P.C. 1.

Business transformation and GDPR compliance platform

Overview of Science Verification Plan Keith Bechtol and Zeljko Ivezic LSST Commissioning Plan Review January 24-26, 2017.

Student Progress Inspiring Learning.

Unit 3 Review (Calculator)

WEB & HTML Background Info.

Calculate 9 x 81 = x 3 3 x 3 x 3 x 3 3 x 3 x 3 x 3 x 3 x 3 x =

' · · ,.-.., '' !'",. -,..._ ·-.·-...;.· -

Presentation transcript:

Key Performance Metrics and End-to-End Testing Tim Jenness

Key Performance Metrics LSST Science Requirements (LPM-17) and LSST System Requirements (LSE-29) specify the performance of LSST. Key Performance Metrics (KPM) are important metrics used to monitor pipeline development. They are monitored annually.

End-to-End Testing Raw data on disk to visualization of catalogs and images in a web browser. Does not have to be fully automated. Manual intervention is okay. What are we missing? Do we have enough of a system to calculate S15 KPMs? Which can’t we attempt?

End-to-End Testing Alert Production end-to-end requires OCS and other infrastructure. diffim performance only. Focus on Data Release Production Use HSC data Use NCSA systems Scale to LSST for performance metrics. Five sessions at this meeting.

Support Documents Confluence:https://confluence.lsstcorp.org/display/DM/Data+Processing+End+to+End+Testing