SIMCODE-DS PI: Marco Baldi

Slides:



Advertisements
Similar presentations
1 SLAC National Accelerator Laboratory Amber Boehnlein October 18, 2011.
Advertisements

Building a Framework for Data Preservation of Large-Scale Astronomical Data ADASS London, UK September 23-26, 2007 Jeffrey Kantor (LSST Corporation), Ray.
Data-Intensive Computing in the Science Community Alex Szalay, JHU.
Planning for the Virtual Observatory Tara Murphy … with input from other Aus-VO members …
Regional Computing Centre for Particle Physics Institute of Physics AS CR (FZU) TIER2 of LCG (LHC Computing Grid) 1M. Lokajicek Dell Presentation.
Assessment of Core Services provided to USLHC by OSG.
Scientific Data Infrastructure in CAS Dr. Jianhui Scientific Data Center Computer Network Information Center Chinese Academy of Sciences.
P olarized R adiation I maging and S pectroscopy M ission Probing cosmic structures and radiation with the ultimate polarimetric spectro-imaging of the.
National Center for Supercomputing Applications Observational Astronomy NCSA projects radio astronomy: CARMA & SKA optical astronomy: DES & LSST access:
14 Aug 08DOE Review John Huth ATLAS Computing at Harvard John Huth.
E-Science Research Councils awarded e-Science funds ” science increasingly done through distributed global collaborations enabled by the Internet, using.
A Data Centre for Science and Industry Roadmap. INNOVATION NETWORKING DATA PROCESSING DATA REPOSITORY.
DiRAC-3 – The future Jeremy Yates, STFC DiRAC HPC Facility.
TurbaseDNS: a database of direct numerical simulations of complex flows F. Bonaccorso 1, L. Biferale 1, A. Lanotte 2 and M. Sbragaglia 1 1 University of.
EUDAT receives funding from the European Union's Horizon 2020 programme - DG CONNECT e-Infrastructures. Contract No EUDAT- Towards.
Sensors and Instrumentation Computational and Data Challenges in Environmental Modelling Dr Peter M Allan Director, Hartree Centre, STFC.
The Mapper project receives funding from the EC's Seventh Framework Programme (FP7/ ) under grant agreement n° RI Requirements for Multiscale.
Storage, an infrastructure component TERENA storage collaboration meeting Amsterdam, Jan Meijer uninett.no.
Meeting with University of Malta| CERN, May 18, 2015 | Predrag Buncic ALICE Computing in Run 2+ P. Buncic 1.
EUDAT receives funding from the European Union's Horizon 2020 programme - DG CONNECT e-Infrastructures. Contract No EPOS and EUDAT.
ICOS To collect high-quality observational data relevant to the greenhouse gas budget of Europe To make the ICOS data freely available to all interested.
RI EGI-InSPIRE RI Astronomy and Astrophysics Dr. Giuliano Taffoni Dr. Claudio Vuerli.
Get Data to Computation eudat.eu/b2stage B2STAGE How to shift large amounts of data Version 4 February 2016 This work is licensed under the.
CMB & LSS Virtual Research Community Marcos López-Caniego Enrique Martínez Isabel Campos Jesús Marco Instituto de Física de Cantabria (CSIC-UC) EGI Community.
EUDAT receives funding from the European Union's Horizon 2020 programme - DG CONNECT e-Infrastructures. Contract No Public access.
European Perspective on Distributed Computing Luis C. Busquets Pérez European Commission - DG CONNECT eInfrastructures 17 September 2013.
Euclid Big Data Opportunities Tom Kitching (UCL MSSL) – Euclid Science Lead.
Astronomy toolkits and data structures Andrew Jenkins Durham University.
PLANCK TEAM of the DISCOVERY Center. The most mysterious problems.
EUDAT receives funding from the European Union's Horizon 2020 programme - DG CONNECT e-Infrastructures. Contract No Collaboration.
EUDAT receives funding from the European Union's Horizon 2020 programme - DG CONNECT e-Infrastructures. Contract No Support to scientific.
EUDAT receives funding from the European Union's Horizon 2020 programme - DG CONNECT e-Infrastructures. Contract No TURBASE-DNS: A.
EUDAT receives funding from the European Union's Horizon 2020 programme - DG CONNECT e-Infrastructures. Contract No Aalto Data Repository.
Exploring Strategies For Optimizing Knowledge Derivation From Imagery
overview of activities on High Performance Computing
EUDAT’s engagement with the Earth Sciences
MIRACLE Cloud-based reproducible data analysis and visualization for outputs of agent-based models Xiongbing Jin, Kirsten Robinson, Allen Lee, Gary Polhill,
Alessandro Spinuso, Andreas Rietbrock, Andrè Gemuend,
Tools and Services Workshop
Community Science Updates
Joslynn Lee – Data Science Educator
Scientific Computing Department
INFN Computing Outlook The Bologna Initiative
LAM and Short Range NWP Some thoughts from Brussels
ICOS on-demand atmospheric transport computation A use case for interoperability of EGI and EUDAT services Ute Karstens, André Bjärby, Oleg Mirzov, Roger.
Data Ingestion in ENES and collaboration with RDA
John Womersley Super-B Workshop Oxford May 2011
Cosmology from the Moon?
UK Status and Plans Scientific Computing Forum 27th Oct 2017
Steve Brewer EGI.eu Chief Community Officer
Research objectives of Thales R&T in embedded HPC and MPC domains
Exploitation of ISS Scientific data - sustainability
Vision for CERN IT Department
University of Cyprus UCY
Computing Infrastructure for DAQ, DM and SC
University of Modena and Reggio Emilia
Data Issues Julian Borrill
DATA SPHINX & EUDAT Collaboration
By Peter Kettig Supervisor: Antoine Basset, CNES
SDM workshop Strawman report History and Progress and Goal.
EGI Webinar - Introduction -
An EUDAT-based FAIR Data Approach for Data Interoperability
TeraScale Supernova Initiative
European Research Data Services, Expertise & Technology Solutions
Comparison to existing state of security experimentation
DATATURB Direct simulation data of turbulent flows
The Barcelona Supercomputing Center
Emulator of Cosmological Simulation for Initial Parameters Study
Stakeholders R. Dimper 15 January 2019
Fabio Pasian, Marco Molinaro, Giuliano Taffoni
Presentation transcript:

SIMCODE-DS PI: Marco Baldi (marco.baldi5@unibo.it) Presenter: Matteo Nori (matteo.nori3@unibo.it) Physics and Astronomy Department Bologna University

Simulations for Precision Cosmology We are about to enter the epoch of “Precision Cosmology” (testing the cosmological model at ~1% precision) In the next decade, costly space missions such as the Euclid satellite will map the Universe with unprecedented accuracy Precision Cosmology NEEDS large computer simulations: cDE-CDM f(R) gravity fNL(k) mν ≠ 0 Last decade: Planck Next decade: Euclid ΛCDM

We need large storage facilities! In the next few years we will need to develop simulations with more than a trillion (i.e. 1012!!!) particles: Euclid Full Scale Runs One snapshot of a Euclid Full Scale simulation: ~180-200 TB The complete simulation: a few PB Data can have a variety of formats, including HDF5 and FITS Data should be used for scientific exploitation by a broad community and for an extended period of time (~5-10 yrs) PROBLEMS: - Where to preserve such big data for such a long time? - How to distribute/transfer/manage efficiently these data? - How to allow a full scientific exploitation of the simulations? NEED of a dedicated infrastructure with cutting-edge technologies!

The SIMCODE project SIMCODE is a computational cosmology project funded by the Italian government through the High-Qualification programme SIR with a 1/2 Million Euro grant for a period of 3 years. SIMCODE will perform large cosmological simulations and investigate their observational footprints. SIMCODE therefore represents an intermediate step towards the development of pipelines and tools that will be employed in a few years for the next generation of simulations. The present SIMCODE-DS (Data Storage) pilot aims at testing possible strategies and tools for data preservation and distribution in view of these long term needs of the computational cosmology community.

The SIMCODE work flow Data Sharing and distribution Level 0: raw data (within the collaboration) Level 1: processed data (external collaborators) Level 3: science-ready data (anyone) Data production Large HPC facilities Long-term data storage EUDAT facilities raw data: snapshots processed data: maps and catalogs Data Analysis & Benchmarking access raw data Additional data analysis data subset recover

Please visit www.marcobaldi.it/SIMCODE