LSST VAO Meeting March 24, 2011 Tucson, AZ

Headquarters Site Headquarters Facility Observatory Management Science Operations Education and Public Outreach Archive Site Archive Center Nightly Reprocessing Data Release Production Long-term Storage (copy 2) Data Access Center Data Access and User Services TFLOPS PB Disk PB Tape Base Site Base Facility Alert Production Long-term storage (copy 1) Data Access Center Data Access and User Services TFLOPS PB Disk PB Tape Summit Site Summit Facility Telescope and Camera Data Acquisition Crosstalk Correction Data Management System Sites and Centers

Data Management Presentation to LSSTC Board 3 Chile DAC Tucson La Serena Pachon Santiago Sao Paolo Miami NCSA Data 80Gbps TCS/OCS Control 20Gbps 10/100Gbps Reuna 10/100Gbps Lauren/Clara 10/100Gbps Amlight 10/100Gbps NLR/I2 TeraGrid (Telefonica&Telmex) DMS long-haul network design Mountain summit – Base is only new fiber, 100 Gbps capacity Inter - site Long-Haul links on existing fibers – Chile-US – Archive – HQ – DAC – End Users 1 Gbps 2011, 10 Gbps 2015, 100 Gbps 2025 Site End Equipment is available today Network Design Document-7354 Panama Los Angeles

Data Management Presentation to LSSTC Board 4 DMS cyber-security plan Threats –Denial of service attacks –Break-in attempts –Internal attacks –Code injection –Personal computer malware, viruses, etc. Best practices –Monitor infrastructure –Partition resources –Grant limited privileges –Simulate threats Cyber-security Plan-9733

LSST DM R&D Plan To Date

LSST DM R&D Plan To Be Done

DMS Data Challenge Infrastructure SPIE 2010 June 30, 2010 San Diego, CA

Data Management Presentation to LSSTC Board 8 DMS Middleware - Pipeline processing Middleware runs in full production mode as operational system will do Have executed in parallel on hundreds of processing cores Performance can be increased by adding more hardware, input/output remains most constraining Cross-project workshops conducted with DES, JWST, ODI, UWis Condor group to leverage lessons learned Provenance and Fault-Tolerance demonstrations by PDR

DMS Middleware – Database Architecture Current relational database technology cannot handle LSST data volumes Solution: make many databases look like one to users and applications Scale by adding database instances/servers without software changes Full prototype now implemented 9 Supercomputing 2010

NSF Review December 15-17, 2009 Tucson, AZ 10 Data Challenge Applications Scope DC3a DC2 DC3b DC4 DC1

Data Management Presentation to LSSTC Board 11 DMS Applications Status Since the start of R&D, spent on software development and integration –$8M (out of $10M total R&D spent) –90 FTE years (funded and in-kind, average 40% on project) By comparison –Terapix (unknown, 7 people, started in 1997) –2MASS (165 FTE years) –SDSS (145 FTE years low estimate, 215 FTE years high estimate) –Above estimates are from respective project managers/technical leads