Simulations, Metrics and Merit Functions for Mini-surveys and Deep Drilling 1.

Slides:



Advertisements
Similar presentations
CMSC 2006 Orlando Active Alignment System for the LSST William J. Gressler LSST Project National Optical Astronomy Observatory (NOAO) Scott Sandwith New.
Advertisements

CHAPTER NO 2.  Everything in history which has been planned was done in a highly predictable manner  Whatever you do whether launching a new product,
Cadence Workshop Plenary 1 – Organizer’s Welcome and Introduction - Draft - - Sponsoring organizations: NOAO and LSST The Organizing committee: Richard.
LSST Observing Cadences Workshop Feb 27, Workshop Series on Optimizing the LSST Deployment.
– Cadence Workshop – Conclusions, Report, Recommendations and Plans Knut Olsen and Steve Ridgway August 15, 2014.
NGAO System Design Review Response Peter Wizinowich, Rich Dekany, Don Gavel, Claire Max for NGAO Team SSC Meeting June 18, 2008.
Science Team Management Claire Max Sept 14, 2006 NGAO Team Meeting.
Detection of Terrestrial Extra-Solar Planets via Gravitational Microlensing David Bennett University of Notre Dame.
LSST Scheduler status Francisco Delgado Sr. Software Engineer Telescope & Site.
1 New Frontiers with LSST: leveraging world facilities Tony Tyson Director, LSST Project University of California, Davis Science with the 8-10 m telescopes.
WGClimate John Bates NOAA SIT Workshop Agenda Item #8 WGClimate Work Plan progress & Issues CEOS SIT Technical Workshop CNES, Montpellier, France 17 th.
LSST Scheduler requirements
Observing Cadences Workshop Organized by NOAO and LSST w/
A goal of the LSST project is to capture the optical sky into a database so effectively that observing the database is a satisfactory, and even superior,
Search Engine Optimization © HiTech Institute. All rights reserved. Slide 1 What is Solution Assessment & Validation?
1 The DES Calibrations Effort Douglas L. Tucker (DES Calibrations Scientist) DES NSF/DOE Review, 8-9 June 2009 The DES Calibrations Effort has connections.
Project management Topic 7 Controls. What is a control? Decision making activities – Planning – Monitor progress – Compare achievement with plan – Detect.
Proposal: staged delivery of Scheduler and OpSim V1 (2016) meet most of the SRD requirements – Deliver a system that can be extended with an improved scheduler.
1 FINAL DESIGN REVIEW | TUCSON, AZ | OCTOBER 21-25, 2013 Name of Meeting Location Date - Change in Slide Master The LSST Opserations Simulator A. Saha.
QIBA DCE-MRI Analysis Algorithm Validation Specification and Testing Daniel Barboriak M.D. Duke University Medical Center
1 GMT Community Science Meeting Monterey, CA October 1 – 3, 2015 LSST – A Discovery Machine for ELT Era Science Beth Willman LSST Deputy Director GMT Community.
Research Design
Model of an Effective Program Review October 2008 Accrediting Commission for Community and Junior Colleges.
1 OBSERVATORY CONTROL SYSTEM (OCS) FRANCISCO DELGADO OCS CAM.
T. Axelrod, NASA Asteroid Grand Challenge, Houston, Oct 1, 2013 Improving NEO Discovery Efficiency With Citizen Science Tim Axelrod LSST EPO Scientist.
LSST Commissioning Overview and Data Plan Charles (Chuck) Claver Beth Willman LSST System Scientist LSST Deputy Director SAC Meeting.
A Design Process Introduction to Engineering Design
How to use your data science team: Becoming a data-driven organization
Highlighting key definitions, suggested SAC roles, and challenges
Purpose of this discussion
Masters and Doctorate – what are these?
Draft thoughts on selecting LSST DDFs
From LSE-30: Observatory System Spec.
A Design Process Introduction to Engineering Design
Question: Why does the moon appear to have phases (i.e. half moon, crescent moon or quarter moon)?
Background D/HSO Announcement of Opportunity (July 2011) in coordination with D/EOP soliciting scientific experiments for the International Space Station.
Consultant Log Data Entry Review
SOAR Observatory Strategic Planning Initial Concept Presentation
LSST Commissioning Overview and Data Plan Charles (Chuck) Claver Beth Willman LSST System Scientist LSST Deputy Director SAC Meeting.
MGT-491 QUANTITATIVE ANALYSIS AND RESEARCH FOR MANAGEMENT
Physics Analysis Summaries towards a proposal
OpSim4 vs OpSim3 Francisco Delgado
SOCS/Scheduler Development Plan Michael Reuter, Fransicso Delgado
Programme Board 6th Meeting May 2017 Craig Larlee
TechStambha PMP Certification Training
OCS Scheduler Status Francisco Delgado T&S Software Manager
Curriculum and Accreditation
OCS Scheduler Status Francisco Delgado T&S Software Manager
Middle States Update to President’s Cabinet October 8, 2018
Overview of working draft v. 29 January 2018
Scientific Inquiry Standard B – 1.7.
URBAN STREAM REHABILITATION
Click to add title Planning for LSST Verification George Angeli LSST All Hands Meeting Tucson August 15, 2016.
[Team Name] Monthly Technical Report [Safe Genes Program]
LSST Science: Supernova/Transients/variable stars
Overview of Science Verification Plan Keith Bechtol and Zeljko Ivezic LSST Commissioning Plan Review January 24-26, 2017.
Systems Engineering for Mission-Driven Modeling
Understanding and Planning Business Reports and Proposals
A Design Process Introduction to Engineering Design
Standardisation - What to expect from it?
CEO Update – October 2017 Dashboard
Report from the 9th Meeting of the Ozone Research Managers of the Parties to the Vienna Convention for the Protection of the Ozone Layer Michael J. Kurylo.
The Impact of Project Based Learning on High School Biology SOL Scores
Adult Education Survey Anonymisation Point 6
A Design Process.
Detecting Solar System Objects with Euclid
Face-to-Face IDT Meeting Session 1 Observation Strategies and EGRET Experience S. W. Digel March 19, 2002 SLAC.
Key Issues and Today’s Goals
Scientific Inquiry Standards B – 1.7 and B – 1.8.
Commissioning Data – Who and Why?
Presentation transcript:

Simulations, Metrics and Merit Functions for Mini-surveys and Deep Drilling 1

Operations Simulator Schedules a number of “proposals”, each with its field list and parameters Currently operating with V3 (obsolete, known problems) In development – V4 – 1.0 release in November – solves many problems and advances sophistication of scheduling options 2

Metrics vs Figures of Merit Which is needed? For a specific and well defined science objective, a figure of merit may be possible and essential. E.G. completeness of NEO detection in North Ecliptic Spur after N years. For a broad objective, general purpose metrics may be more appropriate. E.G. period determination for variables, rise time for transients Only specialists will really understand its basis.

Mini-Surveys Accepted Deep-drilling proposals Proposed Deep Drilling Mini-moons North Ecliptic Spur Meter-size impactors South Celestial Pole Short-exposure survey Galactic Plane GW sources

Metrics for Mini-Surveys Very few metrics are specific to mini-surveys However, most metrics are applicable to mini-surveys Except for DDF, mini-survey cadences are effectively random in current simulations

Some Metrics Useful for Mini-Surveys Area Fields Metric concept Merit Function concept Metrics implementation Merit Function Implementation AGN All X NEO, PHA Galactic novae, GP Galactic SN pre-detection Exo-planet microlensing Periodogram purity Max Phase Gap (several) Period Deviation Metric Variablility Depth ZZ Ceti count ExOr High State GRB (several) Event detection Strong lens time delay SN & Cosmology Observing Strategy Whitepaper Most metrics are general purpose, not narrowly mini-survey Gold standard is merit function implementation But the bar is at metric implementation

Max Inter Night Gap and Max Phase Gap

Temporal span of observations

Compare 2 Simulations opsim8.27 – with 4 deep drilling fields

Comparison – Median visits per Field/ Design visits u g r i z y Opsim8-27 (4 DD) 56/56 80/80 184/184 160/160 Opsim4-278 (10 DD) 63/80 140/184 141/184

How Much Mini-survey Time? Accepted Deep-drilling proposals Proposed Deep Drilling Mini-moons North Ecliptic Spur Meter-size impactors South Celestial Pole Short-exposure survey Galactic Plane ++++ GW Sources ~0??% ~10% ~??% ~10% ~0??% ~16%

How Much Time is Available? “We said 90% for the main survey, and we will use 90%” “We said we would accomplish the key science and we will accomplish the key science” Under discussion in the management committees

Visits/Field (median) Baseline Simulation Current “baseline” simulation: minion_1016 Proposal Number of fields Filters Visits/Field (median) Total Visits Fraction of Time Wide-Fast-Deep 2293 All 910 2,086,630 0.85 North Ecliptic Spur 523 g,r,i,z 304 158,992 0.06 Galactic Plane 230 180 41,400 0.017 Deep Drilling (4 approved + 1) 5 23,196 115,980 0.05 South Celestial Pole 293 52,740 0.022 Full survey 2,455,742

Visits/Field (median) Baseline Simulation Current “baseline” simulation: minion_1016 Proposal Number of fields Filters Visits/Field (median) Total Visits Fraction of Time Wide-Fast-Deep 2293 All 910 (design spec) 824 2,086,630 0.85 0.77 North Ecliptic Spur 523 g,r,i,z 304 158,992 0.06 Galactic Plane 230 180 41,400 0.017 Deep Drilling (4 approved + 1) 5 23,196 115,980 0.05 South Celestial Pole 293 52,740 0.022 Full survey 2,455,742

Visits/Field (median) Baseline Simulation Current “baseline” simulation: minion_1016 Proposal Number of fields Filters Visits/Field (median) Total Visits Fraction of Time Wide-Fast-Deep 2293 All 910 (design spec) 824 2,086,630 0.85 0.77 => 0.70 (if single images) North Ecliptic Spur 523 g,r,i,z 304 158,992 0.06 Galactic Plane 230 180 41,400 0.017 Deep Drilling (4 approved + 1) 5 23,196 115,980 0.05 South Celestial Pole 293 52,740 0.022 Full survey 2,455,742 Science in the bank, or at least in escrow.

Process for Deciding on Observing Schedule Steve Kahn in 2014 Cadence Workshop report: https://project.lsst.org/meetings/ocw/sites/lsst.org.meetings.ocw/f iles/2014CadenceWorkshopReport.pdf Excerpts in next 3 slides

Process Moving Forward (in brief) “define quantitative metrics” “experiment with different cadence strategies” - “develop a global metric for the survey” “construct a scheduler that can optimize that global metric” “define a process to evolve the cadence strategy with community input over the life of the mission”

How will we arrive at a concrete plan? “The Project will formally engage the community in making such policy decisions through its Science Advisory Committee” “The Project Science Team will provide the primary internal body within the LSST Project that will evaluate the trades “ “The Telescope & Site Team .. has formal responsibility for developing and implementing …they must respond to programmatic constraints in addition to the science guidance coming from the PST”

“Do not be concerned that crucial “cadence decisions” have already been made by LSST. This is not true. We have worked some strawman examples, but there is plenty of time for further iteration” (Kahn) (Editorial warning– the above remark is now 2 years old)

Looking ahead – What is Needed? Mini-survey/DDF Proposals Mini-survey science cases (for scientists) Well defined proposals (for simulation) Fields, filters, sequences, special conditions Metrics (may exist already), and maybe Merit Functions

Simulations, Metrics and Merit Functions for Mini-surveys and Deep Drilling Steve Ridgway 2121