Millennium Data Dissemination MPA institute seminar1 possible extensions how ambitious can/should we be?

Raw data: Particles FOF groups and Subhalos Density fields Subhalo merger trees Synthetic galaxies (SAM) Mock catalogues Mock images Millennium Workshop2

SUBFIND Tree Builder Halo Merger Trees SAM SSP FOF Group Finder (Sub-)HalosFOF Groups Simulation Particles Gadget MoMaF’ SAM Galaxies Light-cone Galaxies SkyMaker’SExtractor Synthetic Images SExtractor Catalogues PSF, Noise, Background Scaling IGM MRObs Millennium Workshop3

Raw data Serve particles from Millennium simulations –10 billion/snapshot, ~25TB from database? –with spatial queries –links to halos/FOF groups through JobRunner services –cutout –gridding + FFTs etc MPA institute seminar4

Other simulations? Hydro Example: – –online visualisation: garching.mpg.de/phoxybrowser garching.mpg.de/phoxybrowser Others –Millennium+gas? –Eagle –… How? –In DB ok for objects –Visualisation support for “fluffy things” MPA institute seminar5

6

SUBFIND Tree Builder Halo Merger Trees SAM SSP FOF Group Finder (Sub-)HalosFOF Groups Simulation Particles Gadget MoMaF’ SAM Galaxies Light-cone Galaxies SkyMaker’SExtractor Synthetic Images SExtractor Catalogues PSF, Noise, Background Scaling IGM MRObs Millennium Workshop7

Group catalogs Have –FOF –SUBFIND subhalos –Mhalo merger trees –Dhalo merger trees More properties –shapes, density profiles (ala AIP, or ala MR-XXL): good for lensing –others? More? –BDM, NEXUS, ORIGAMI, … –All of Knebe etal LSS objects? –Voids, filaments, walls in the DB –“more precise” environmental queries possible –per grid cell or as object (“stacking voids”) MPA institute seminar8

SUBFIND Tree Builder Halo Merger Trees SAM SSP FOF Group Finder (Sub-)HalosFOF Groups Simulation Particles Gadget MoMaF’ SAM Galaxies Light-cone Galaxies SkyMaker’SExtractor Synthetic Images SExtractor Catalogues PSF, Noise, Background Scaling IGM MRObs Millennium Workshop9

SAM catalogues More models –Durham, MPA Complete MR-XXL? –~200x Millennium, 80TB Extensions MPA institute seminar10

SFH-s Allows SEDs from post-processing how to store? –rows vs arrays (in SQLServer) –functions (easy in SQLServer): create spectra –“exact” observer frame bands PCA amplitudes in the database –find nearby galaxies for given observed spectrum MPA institute seminar11

SAM online GALFORM online !!! – –on millimil Do we want others? –Galacticus? Need constraints, validated models. –How afraid should we be of “bad science”? SAM online on Millennium? –input to MRObs pipeline MPA institute seminar12

SUBFIND Tree Builder Halo Merger Trees SAM SSP FOF Group Finder (Sub-)HalosFOF Groups Simulation Particles Gadget MoMaF’ SAM Galaxies Light-cone Galaxies SkyMaker’ SExtractor Synthetic Images SExtractor Catalogues PSF, Noise, Background Scaling IGM MRObs Millennium Workshop13

Light cones In Database: not just from MPA! –common model –linked to SAMs More –deep: new code for Millennium-II –all sky: MR-XXL –with scaling! What properties needed? –who wants them? –what for (lensing?)? Light cone building online –Will soon make our MoMaF available on JobRunner –new code in preparation (for MR-II etc) MPA institute seminar14

SUBFIND Tree Builder Halo Merger Trees SAM SSP FOF Group Finder (Sub-)HalosFOF Groups Simulation Particles Gadget MoMaF’ SAM Galaxies Light-cone Galaxies SkyMaker’ SExtractor Synthetic Images SExtractor Catalogues PSF, Noise, Background Scaling IGM MRObs Millennium Workshop15

MRObs Store of images will keep growing –Overzier! Create images on demand –telescope models custom? Post processing as well? –Sextractor –other? Improvement galaxy images –realistic structure (weak lensing systematics, strong lensing structure) –from simulations ? –form observations? MPA institute seminar16

SUBFIND Tree Builder Halo Merger Trees SAM SSP FOF Group Finder (Sub-)HalosFOF Groups Simulation Particles Gadget MoMaF’ SAM Galaxies Light-cone Galaxies SkyMaker’ SExtractor Synthetic Images SExtractor Catalogues PSF, Noise, Background Scaling IGM MRObs Millennium Workshop17 Lensing

Under construction –with Ben Metcalf Online? –Why not, JobRunner will handle it. How much? –what is required for weak lensing? MPA institute seminar18

Even more L-Galaxies online++ –updating physics modules? –MCMC mode? Dark matter light cones? –for lensing –what do we need? particles, fields? Interface –dashboard (M.Egger) –improve SQL interface (Roys talk) MPA institute seminar19

Galformod infrastructure Currently – core nodes –180 TB raw storage –20TB DB storage What do others have? –AIP ~500TB –JHU ~5PB (?) What do we want? MPA institute seminar20

What do we want need? Depends on answers to all previous questions What can we afford? –Where can we get the money? Where do we put “it”? –RZG? Pool our resources together? –beyond mirror –distributed over Virgo nodes? Larger scale collaborations (EUDat)? –see Hermann’s talk MPA institute seminar21