Preservation e-Infrastructures, Certification & ADMP IGs DPHEP Status and Outlook RDA Plenary 6 Paris, September 2016 International.

Slides:



Advertisements
Similar presentations
Ian Bird LHCC Referees’ meeting; CERN, 18 th November 2014.
Advertisements

Co-funded by the European Union under FP7-ICT Co-ordinated by aparsen.eu #APARSEN Welcome to the Conference !! Juan Bicarregui Chair, APA Executive.
Content Management Activities at Pacific Northwest National Laboratory Interlab 2003 Nancy Stratton Annanaomi Sams Genevieve Millsap Pam Novak.
Digital preservation Hydra Europe, LSE 24 April 2015 Anders Conrad.
32 nd Session of SIO Thessaloniki Milovan Misic Tuesday, September 26, 2006 Standards for digital archives and electronic records management.
Ian Bird WLCG Management Board CERN, 17 th February 2015.
Exa-Scale Data Preservation in HEP
Review of recent studies on PSI re-use and related markets in the EU Estimating the market value of PSI Graham Vickery Information Economics Open Government.
ECFA European Committee for Future Accelerators ECFA ACTIVITIES Lenny Rivkin, EPFL & PSI CHIPP Plenary meeting Fribourg, 30 June – 2 July, 2014.
Presenter: Karla Strieb Assistant Executive Director Transforming Research Libraries June 3, 2010 Supporting E-science: Progress at Research Institutions.
Long-Term Data Preservation in HEP Challenges, Opportunities and Solutions(?) Workshop on Best Practices for Data Management & Sharing.
Long-Term Data Preservation in HEP Challenges, Opportunities and Solutions(?) Joint Data Preservation RDA-3 International Collaboration.
Data Preservation at the Exa-Scale and Beyond Challenges of the Next Decade(s) APARSEN Webinar, November 2014.
ICSTI Annual Members’ Meeting & Workshop Dr. Stefan Winkler-Nees; Paris, 5. March 2012 The Alliance of German Science Organisations - Recommendations on.
Long-Term Data Preservation: Debriefing Following RDA-4 WLCG GDB, October 2014
Overview & Status of the Middleware & EGI Core Proposals Steven Newhouse Interim EGI Director EGEE Technical Director 26/05/2016 Status of EGI & Middleware.
Digital Preservation MetaArchive Cooperative.  9:00-9:45 - Session 1: Digital Preservation Overview  9:45-11:00 - Session 2: Policy & Planning Overview.
European Organization for Nuclear Research Organisation Européenne pour la Recherche Nucléaire High-Energy Physics Data Delivering Data in Science ICSTI.
Data Preservation in High Energy Physics Towards a Global Effort for Sustainable Long-Term Data Preservation in HEP
The DPHEP Collaboration & Project(s) Services, Common Projects, Business Model(s) PH/SFT Group Meeting December 2013 International.
2004 Annual Report Summary. 2 Summary of Responses.
Johannes Gutleber CERN Directorate of Accelerators & Technology September 22, 2015 H2020 EUCard3 Reliability & Availability Task RAMS Training Topic.
Ian Bird GDB; CERN, 8 th May 2013 March 6, 2013
APT Trustworthy Digital Repository / Certification Working Group Progress Report, October 2015 Stephen Paul Davis, Columbia University Libraries.
Activities and news Last meeting: 2015 CERN budget allocations as expected, now distributed on accounts Annual report done, and MTP (Medium Term Plan)
Millman—Nov 04—1 An Update on Digital Libraries David Millman Director of Research & Development Academic Information Systems Columbia University
ARL Workshop on New Collaborative Relationships: The Role of Academic Libraries in the Digital Data Universe September 26-27, 2006 ARL Prue.
Future computing strategy Some considerations Ian Bird WLCG Overview Board CERN, 28 th September 2012.
Lucie Linssen, CLICdp, bi-monthly meeting, 3 Aug General news CLICdp monthly meeting August 3 rd 2015.
Long Term Data Preservation LTDP = Data Sharing – In Time and Space Big Data, Open Data Workshop, May 2014 International Collaboration.
Data Preservation in HEP Use Cases, Business Cases, Costs & Cost Models Grid Deployment Board International Collaboration for Data.
Data Archive Ingest WG Report to MOIMS Plenary May 14, 2004.
#DPHEP: Status and Outlook Sustainable Strategies for Long-Term DP at the Exa-scale LHCC Referees Meeting International Collaboration.
Advances in Bit Preservation (since DPHEP’2015) 3/2/2016 DPHEP / WLCG Workshop1 Germán Cancio IT Storage Group CERN DPHEP / WLCG Workshop Lisbon, 3/2/2016.
Preservation of Digital Data by Christian Wellner Based on: Howard Besser. Digital longevity. In: Maxine Sitts (ed.) Handbook for Digital Projects: A Management.
Data Preservation at Rutherford Lab David Corney 9 th July 2010 KEK.
Ian Bird Overview Board; CERN, 8 th March 2013 March 6, 2013
Digital Archiving Without Preservation is Just Storage: Education is the First Step to Achieving Preservation Goals Sue Kriegsman Lee Mandell Harvard University.
International Collaboration for Data Preservation and Long Term Analysis in High Energy Physics RECODE - Final Workshop - January.
Library Efforts and IT Infrastructure Services Paul Conway & Mike Pickett Duke University
DPHEP7 / DASPOS Introduction DPHEP7, March 2013 International Collaboration for Data Preservation and Long Term Analysis in High Energy.
WLCG/DPHEP workshops in Lisbon Andrea Sciabà On behalf of the workshop organisers WLCG GDB December 9, 2015.
APA’s Virtual Centre of Excellence (VCOE) and its Vision APARSEN-EGI-Community-Forum Training on Data Preservation 22 nd of May 2014 Helsinki Matthias.
DPHEP – International Perspectives
The DPHEP Collaboration & Project(s) Services, Common Projects, Business Model(s) EGI “towards H2020” Workshop December 2013 International.
Preparing Data Management Plans for WLCG and HNISciCloud IT International Collaboration for Data Preservation and Long Term.
DPHEP Update LTDP = Data Sharing – In Time and Space WLCG Overview Board, May 2014 International Collaboration for Data Preservation.
Preservation e-Infrastructure IG Description: help ensure preservation of needed data succeeds Goals: foster worldwide collaboration; ensure consistency.
Data Preservation in HEP Use Cases, Business Cases, Costs & Cost Models Grid Deployment Board International Collaboration for Data.
Usecases: 1.ISIS Neutron Source 2.DP for HEP Matthew Viljoen STFC, UK APARSEN-EGI workshop: preserving big data for research Amsterdam Science Park 4-6.
Update on Data Preservation (CERN / WLCG Scope) WLCG OB June 2016 International Collaboration for Data Preservation and Long Term.
1 Active Data Management Plans (ADMP) Interest Group -
LHCbComputing Update of LHC experiments Computing & Software Models Selection of slides from last week’s GDB
School on Grid & Cloud Computing International Collaboration for Data Preservation and Long Term Analysis in High Energy Physics.
Co-funded by the European Union under FP7-ICT Alliance Permanent Access to the Records of Science in Europe Network aparsen.eu #APARSEN Options.
Ian Bird, CERN WLCG Project Leader Amsterdam, 24 th January 2012.
Co-ordinated by aparsen.eu #APARSEN Co-funded by the European Union under FP7-ICT Business Development activities after project completion Ruben.
Long-Term Sustainability A User (Support) View
Long-Term Sustainability: Services & Data A User (Support) View
HEP LTDP Use Case & EOSC Pilot
Long Term Data Preservation meets the European Open Science Cloud
Certification of CERN as a Trusted Digital Repository
iPRES 2016, CH
EOSCpilot WP4: Use Case 5 Material for
APARSEN Webinar, November 2014
2. ISO Certification Discussed already at 2015 PoW and several WLCG OB meetings Proposed approach: An Operational Circular that describes the organisation's.
Data Management and Access Policies: CERN, HEP (and beyond)
Data Preservation Update Data Preservation, Curation & Stewardship
What does DPHEP do? DPHEP has become a Collaboration with signatures from the main HEP laboratories and some funding agencies worldwide. It has established.
Co-Chairs: Mike Hildreth (Notre Dame), Ruth Duerr (Ronin Inst.) + ?
Presentation transcript:

Preservation e-Infrastructures, Certification & ADMP IGs DPHEP Status and Outlook RDA Plenary 6 Paris, September 2016 International Collaboration for Data Preservation and Long Term Analysis in High Energy Physics

Preservation e-Infrastructures – Bit preservation “in good shape” with regular media scrubbing / replacement / migration – “Dust sensors” recently introduced – will become increasingly important for very large archives / high capacity mediaDust sensors – Digital Libraries, CVMFS etc. all supported and widely used with ~20 year outlook – Growth: from O(100PB) to O(10EB) with decreasing costs & increasing realibility  A budgeted plan with outlook to 2035 (2050+?)

Certification Training for key (European) WLCG Tier0+Tier1 sites Training Plan for self-audit early 2016 (ISO 16363) Plan Significant overlap between these sites and partners in H2020 HNISciCloud  re-use experience also wrt ADMPs DPHEP experience (many labs at different stages of the data lifecycle) allows us to “see into the future” – LEP versus LHC – Laboratories moving away from HEP to other sciences – Different strategies wrt LTDP  Certification believed to be part of a long-term sustained implementation of LTDP

Outlook Part of the approval chain for Experiments at CERN is the Research BoardExperiments at CERN – Also committees for each accelerator, e.g. SPSC, LEPC, LHCC, etc Foresee a review of Data Management Plans – for data taking, production and analysis and LTDP – as part of this process – (+ updates during regular reporting…) Why have only large, collider experiments been successful in LTDP in HEP? Need to provide recommendations, tools, support etc – most “experiments” shorter lived and/or much smaller in terms of man- power But still quite different compared to many research projects – No separation of “archive” vs “active data store” – Close collaboration between producers, consumers (often the same) and repository managers

CERN Circular Colliders + FCC 5 Constr.Physics LEP ConstructionPhysicsProtoDesign LHC ConstructionPhysicsDesign HL-LHC PhysicsConstructionProtoDesign Future Collider years