RDSI: changing the face of research data storage in Australia

Slides:



Advertisements
Similar presentations
Some thoughts on data, software and tools and who knows how to do what Rhys Francis Executive Director The Australian eResearch Infrastructure Council.
Advertisements

Jackson Architecture award winning national design practice institutional project focus excellence in complex highly serviced projects: a focus in getting.
TERN Eco-informatics – Overview for DCRG Craig Walker Eco-informatics Facility Director.
Information on the National Server Program September 2013 Audience: Service Desk staff Developed as part of the Australian eResearch Organisations’ User.
How can the ALA help BIGnet? Citizen Science at work Piers Higgs Citizen Science Team Lead Sydney, 3 rd April, 2011 The Atlas.
QCloud Queensland Cloud Data Storage and Services 27Mar2012 QCloud1.
Research Infrastructure Policy and Priorities in Australia David de Carvalho Head of Higher Education Group 5 November 2013.
Funding Collaborative Research—ARC Perspective 19 February 2015 Denise Meredyth Australian Research Council.
EResearch – isn’t that just “research”? Derek Whitehead Vice President, ALIA.
1 Cyberinfrastructure Framework for 21st Century Science & Engineering (CF21) IRNC Kick-Off Workshop July 13,
Dr Joe Young ITS-HPC and Research Support.
E-Research Coordinating Committee report to CAUL April 2006 Cathrine Harboe-Ree.
EU Wetland conservation policy. Communication on the Wise Use and Conservation of Wetlands (1995) => first European document dedicated exclusively.
An Overview of eResearch Activities in Australia Paul Davis, GrangeNet Jane Hunter, Uni of Qld.
Research Infrastructure and the Open Access Agenda Dr Alexander Cooke Australian Research Council.
U.S. Department of Energy’s Office of Science Dr. Raymond Orbach February 25, 2003 Briefing for the Basic Energy Sciences Advisory Committee FY04 Budget.
1 The Australian Partnership for Sustainable Repositories Margaret Henty Digital Futures Industry Briefing November 8, 2006.
Office of Science Office of Biological and Environmental Research J Michael Kuperberg, Ph.D. Dan Stover, Ph.D. Terrestrial Ecosystem Science AmeriFlux.
Australian Partnership for Sustainable Repositories AUSTRALIAN PARTNERSHIP FOR SUSTAINABLE REPOSITORIES Caul Meeting 2005/2 Brisbane 15.
1 SAFETEA: Transportation System Management, Operations and ITS Jeffrey F. Paniati Associate Administrator, Office of Operations Federal Highway Administration.
VU’s Research Survey and eResearch training (an early look) Dr Lyle Winton Associate Director, Office for Research.
Dr Stewart Hay, CEO | | (03) www.therapeuticinnovation.com.au.
ISBE An infrastructure for European (systems) biology Martijn J. Moné Seqahead meeting “ICT needs and challenges for Big Data in the Life Sciences” Pula,
The International Higher Education University Research Performance Forum April 2013 – Pan Pacific Orchard, Singapore Case Study – 2.00pm – 2.45pm.
23 rd CEOS Plenary I Phuket, Thailand I 3-5 November 2009 OVERVIEW OF THE NEW AUSTRALIAN SPACE SCIENCE PROGRAM Alex Held (CSIRO) On behalf of the Australian.
The TARDIS Framework A Federated Repository Solution For Raw Diffraction Datasets Steve Androulakis, Monash University, Melbourne Australia I2S2 Workshop.
Australian Access Federation and other Middleware Initiatives Presented at TF-EMC2, Prague 4 Sep 2007 Patty McMillan, The University of Queensland.
Research Data Management Victoria University Context Lyle Winton Adrian Gallagher Julie Gardner.
The TARDIS Framework A Federated Repository Solution For Raw Diffraction Datasets Steve Androulakis, Monash University, Melbourne Australia International.
Problem Raw imagery -> Quantitative information Courtesy of SeaGIS Courtesy of UWA Various organisations (Commonwealth and State Govt, universities, Private.
National Spatial Data Infrastructure The Spatial Information Services Stack Dr Robert Woodcock.
Crystal25 Hunter Valley, Australia, 11 April 2007 Crystal25 Hunter Valley, Australia, 11 April 2007 JAINIS (JCU and Indiana Instrument Services): A Grid.
The Australian Research Landscape Dr Fiona Cameron Australian Research Council.
National Biotechnology Strategy Implementation and Developments Ben Durham Biotechnology Strategy Unit Department of Science and Technology.
Cyberinfrastructure What is it? Russ Hobby Internet2 Joint Techs, 18 July 2007.
The Australian Research Landscape 14 October 2015 Presented by Dr Fiona Cameron Executive Director Australian Research Council.
| nectar.org.au NECTAR TRAINING Module 2 Virtual Laboratories and eResearch Tools.
EResearch Coordinating Committee CAUL presentation September 2005 Cathrine Harboe-Ree.
3May20111QCIF ENABLING RESEARCH HIGH PERFORMANCE INFRASTRUCTURE & SERVICES QUESTnet ARCS Tools Workshop 3May2011.
EResearch Coordinating Committee CAUL presentation September 2005 Cathrine Harboe-Ree.
Expanding the knowledge base for policy implementation and long-term transitions Dr Hans Bruyninckx Executive Director, European Environment Agency (EEA)
Department of Employment, Economic Development and Innovation Harnessing the Digital Economy “Setting the Strategic Context” 9 December 2011 Malcolm Letts.
ANDS Projects: The University of Western Australia 16 May, 2011 Toby Burrows, Manager (eResearch Support)
EResearch Director, AARNet Guido Aben AARNet update.
European Life Sciences Infrastructure for Biological Information ELIXIR’s needs from the EOSC Steven Newhouse, EMBL-EBI Part of the.
NSW Government Agencies Supporting Clinical Trials Strategic Planning, Policy Advice & Funding for Medical Research Economic Development & Support for.
Driving Innovation Technology Strategy Board The UK’s agency for business innovation –Business benefit –Economic growth –Quality of life.
JCU Australian Marine Science Data Network.
Delivering order-of-magnitude improvements to research data throughput David Wilde Network Architect, AARNet David Wilde Network Architect, AARNet TNC.
OFFICE OF INNOVATION & TECHNOLOGY CITY OF PHILADELPHIA Innovation & Technology Status Update Adel W. EbeidCity of Philadelphia, Office of Innovation &
Using Analysis and Tools to Inform Adaptation and Resilience Decisions -- the U.S. national experiences Jia Li Climate Change Division U.S. Environmental.
Publish your Data on the Tropical Data Hub Seeding the Commons Project Australian National Data Service e-Research Centre James Cook University This work.
Dr. Tony Peacock, Chief Executive Officer, CRC Association
RDS / AAF / ANDS / NeCTAR / AARNET Data Lifecycle framework
E-Research Coordinating Committee report to CAUL
FP7 – ICT Theme a motor for growth, competiveness and social inclusion
The NSRC cultivates collaboration among a community of peers to build and improve a global Internet that benefits all parties. We facilitate the growth.
TEIN update – APAN44 Douglas Harré Chief Engagement Officer
Introduction to the EEA and the EIONET
CSIRO Agency Update Dr. Robert Woodcock.
Oceans and Society: Blue Planet
Exploitation Platforms and Common Reference Architecture
EGI Webinar - Introduction -
Cloudstor: Glamming up the ecosystem
Australia's National Information Infrastructure for Research Markus Buchhorn Director, ICT Environments, The Australian National University (and APAC,
DLCF Enabling technologies
Scotland’s Digital Health and Care Strategy
National data services for South African research
What will you get from this talk?
Atlas of Living Australia Sharing Biodiversity Knowledge
Presentation transcript:

RDSI: changing the face of research data storage in Australia Viviani Paz, Project Manager 16 June 2015

Project Update Landscape pre-RDSI RDSI Project Objectives Programmes Outcomes Transitioning Future

Research infrastructure Landscape (1) Federal government Initiatives A decade of Strategic Investment From 1997 : High Performance Computing Committee Report………. To 2006: eResearch Coordinating Committee Report 2007-2011 - $540M Platforms for Collaboration Research infrastructure

Landscape (2) Digital Certificates

Landscape (3) Research data Backup? Share? Accessible? Secure? Grants? Lost? Reusable? 7 April 2019

2011 100PB = 102,400TB = 104,857,600GB = 107,374,182,400MB

RDSI Project Objectives (from ABP) Develop a national network of data stores Create and develop a data storage infrastructure accessed through an infrastructure provided by agencies within the sector Connect the data storage infrastructure to the Australian Research and Education Network (AREN) by a high bandwidth connection, funded and constructed under the National Research Networks (NRN) Project. Dedicated high speed connections between major Nodes. Support meritorious data collections through the Research Data Service Programme (ReDS). Encourage economies of scale through the Vendor Panel Programme (VePa)

RDSI Programmes

ReDS Research Data Service NoDe Node Development Identify, strengthen and develop research data centres able to hold and process high data volumes ReDS Research Data Service Identify research data holdings of lasting value and importance and contribute funding to their development at the most appropriate Node(s) DaSh Data Sharing Build capability to support the sharing and re-use of research data VePa Vendor Panel Establish a panel of vendors for RDSI Nodes and sector RDSI Programmes

Node Development (NoDe) Funded research data centres able to hold and process high data volumes 6 Primary Nodes 2 Additional Nodes Townsville Brisbane Sydney Canberra Perth Adelaide Melbourne Hobart

Research Data Services Programme (ReDS) Identified research data holdings of lasting value and importance Funded storage at Nodes (MAC) Funded staff at nodes to facilitate data ingest of collections, and the development of Node infrastructure

Data Sharing Programme (DaSh) DaSh Collaboration Network: High performance network between RDSI Nodes DaSh Technical Architecture SPIN ARMS Science DMZ

DaShNet Redundant AARNet4 connections at each node to provide connectivity to the node from AARNet customers and Internet. Slide courtesy of AARNet

DaSh Programme Outcomes Mediaflux Monitoring

VePa Programme RDSI/CAUDIT Vendor Panel Current vendors on the panel

RDSI Project Outcome Facilitated the creation of a robust, innovative and collaborative network of Nodes to support better managed and more accessible world-class research data in Australia.

Node Statuses (1) Updated 9 June 2015

Node Statuses (2) Updated 9 June 2015

22 Fields of Research at RDSI funded storage Updated 19 May 2015 Updated 9 June 2015

RDSI Project Transitioning RDSI Project outcomes will be efficiently and successfully preserved moving into the future RDSI Project Outcomes Nodes DaShNet AARNet Vendor Panel CAUDIT Research Federated Identity Nodes/AAF 7 April 2019

Pathway to the future Previously my thinking was limited by the small amount of storage and computing that was available to me. I always had to summarise down and minimise the data. I don’t have to do that now. I don’t have to worry about the live disk limitation or the compute resources. Now I can keep doing the research as I’d like to see it done. – Dr Jeremy VanDerWal Centre for Tropical Biodiversity and Climate Change, James Cook University

www.rdsi.edu.au 7 April 2019

RDSI

National Collaborative Research Infrastructure Strategy (NCRIS) 2015-2017 - $300M Australian Animal Health Laboratory (AAHL) Astronomy Australia (AAL) Atlas of Living Australia (ALA) Australian Microscopy and Microanalysis Facility (AMMRF) Australian National Data Service (ANDS) Australian National Fabrication Facility (ANFF) ANSTO Nuclear Science Facilities Australian Phenomics Network (APN) Australian Plant Phenomics Network (APPF) Australian Plasma Fusion Research Facility (APFRF) Australian Urban Research Infrastructure Network (AURIN) AuScope Biofuels Bioplatforms Australia (BPA) EMBL Australia Groundwater (GIROS) Heavy Ion Accelerators (HIA) Integrated Marine Observing System (IMOS) National Computational Infrastructure (NCI) National Deuteration Facility (NDF) National eResearch Collaboration Tools and Resources (NeCTAR) National Imaging Facility (NIF) Pawsey High Performance Computing Centre Population Health Research Network (PHRN) Research Data Service (RDS) Terrestrial Ecosystem Research Network (TERN) Translating Health Discovery into Clinical Applications (THD)

Infrastructure & Foundation www.rds.edu.au Services www.rdsi.edu.au

Q & A Viviani Paz Project Manager, RDSI v.paz@uq.edu.au 7 April 2019