TPAC Tasmanian Partnership for Advanced Computing Partner in APAC (Australian Partnership for Advanced Computing) Expertise centre for Earth Systems Science.

Slides:



Advertisements
Similar presentations
Australian Partnership for Advanced Computing Partners: Australian Centre for Advanced Computing and Communications (ac3) in New South Wales CSIRO Queensland.
Advertisements

PRAGMA BioSciences Portal Raj Chhabra Susumu Date Junya Seo Yohei Sawai.
The Australian Virtual Observatory e-Science Meeting School of Physics, March 2003 David Barnes.
Abstraction Layers Why do we need them? –Protection against change Where in the hourglass do we put them? –Computer Scientist perspective Expose low-level.
Research Councils ICT Conference Welcome Malcolm Atkinson Director 17 th May 2004.
QCloud Queensland Cloud Data Storage and Services 27Mar2012 QCloud1.
APAC Grid Geosciences Project: Linking Academia, Industry and Government to HPC Robert Woodcock, CSIRO and pmd*CRC Ryan Fraser, IVEC and Curtin.
An Overview of eResearch Activities in Australia Paul Davis, GrangeNet Jane Hunter, Uni of Qld.
Australian Partnership for Advanced Computing “providing advanced computing and grid infrastructure for eResearch” Rhys Francis Manager, APAC grid program.
1 VALA The Metadata Coal Face for Digital Repositories Australian Partnership for Sustainable Repositories (APSR) Adrian Burton,
NERC Data Grid Helen Snaith and the NDG consortium …
1 e Research Presented by: Mohsen Kahani Computer Engineering Department Ferdowsi University of Mashhad هفته پژوهش – آذر.
Large-Scale Data Collection Metadata Management at the National Computational Infrastructure (NCI) Jingbo Wang 1, Irina Bastrakova.
Aus-VO: Progress in the Australian Virtual Observatory Tara Murphy Australia Telescope National Facility.
TPAC Digital Library Talk Overview Presenter:Glenn Hyland Tasmanian Partnership for Advanced Computing & Australian Antarctic Division Outline: TPAC Overview.
1 Deployment of an LCG Infrastructure in Australia How-To Setup the LCG Grid Middleware – A beginner's perspective Marco La Rosa
October 16-18, Research Data Set Archives Steven Worley Scientific Computing Division Data Support Section.
AIRNow-International The future of the United States real-time air quality reporting and forecasting program and GEOSS participation John E. White U.S.
Interoperability ERRA System.
Presented by The Earth System Grid: Turning Climate Datasets into Community Resources David E. Bernholdt, ORNL on behalf of the Earth System Grid team.
Bringing it All Together: NODC’s Geoportal Server as an Integration Tool for Interoperable Data Services Kenneth S. Casey, Ph.D. YuanJie Li NOAA National.
Long Term Ecological Research Network Information System LTER Grid Pilot Study LTER Information Manager’s Meeting Montreal, Canada 4-7 August 2005 Mark.
AUKEGGS 3 rd Workshop - 29 November 2006 Australian Marine data, AODCJF and BlueNet Kate Roberts, Director BlueNet Project.
Australian Oceans Distributed Active Archive Center Peter Turner, CSIRO/CAWCR IMOS is an initiative of the Australian Government being conducted as part.
Unidata TDS Workshop TDS Overview – Part I XX-XX October 2014.
Australian Access Federation and other Middleware Initiatives Presented at TF-EMC2, Prague 4 Sep 2007 Patty McMillan, The University of Queensland.
Oceans Portal Workshop 30 th March 2004 Healthy oceans: cared for, understood and used wisely for the benefit of all, now and in the future healthy oceans:
National Spatial Data Infrastructure The Spatial Information Services Stack Dr Robert Woodcock.
IODE Ocean Data Portal - technological framework of new IODE system Dr. Sergey Belov, et al. Partnership Centre for the IODE Ocean Data Portal MINCyT,
Neil Witheridge APAN29 Sydney February 2010 ARCS Authorisation Services Neil Witheridge Manager, ARCS Authorisation Services APAN29, Sydney, February 2010.
1PeopleDocumentsData Catalog Generation Tools Analysis and Visualization Tools Data Services Discovery and Publication Tools Discovery and Publication.
IODE Ocean Data Portal – from data access to integration platform Sergey Belov, Tobias Spears, Nikolai Mikhailov International Oceanographic Data and Information.
Glenn MoloneyThe Australian National Grid ProgramEGEE'06, Geneva, The Australian National Grid Program “providing advanced computing, information.
Grid Architecture William E. Johnston Lawrence Berkeley National Lab and NASA Ames Research Center (These slides are available at grid.lbl.gov/~wej/Grids)
TPAC Tasmanian Partnership for Advanced Computing Partner in APAC (Australian Partnership for Advanced Computing) Expertise centre for Earth Systems Science.
Developing Marine Research Data Management Infrastructure in WA Luke Edwards WALIS Forum 11th Nov 09.
1 Grid Portal for VN-Grid Cu Nguyen Phuong Ha. 2 Outline Some words about portals in principle Overview of OGCE GridPortlets.
Holding slide prior to starting show. A Portlet Interface for Computational Electromagnetics on the Grid Maria Lin and David Walker Cardiff University.
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
IODE Ocean Data Portal - ODP  The objective of the IODE Ocean Data Portal (ODP) is to facilitate and promote the exchange and dissemination of marine.
Infrastructures for Social Simulation Rob Procter National e-Infrastructure for Social Simulation ISGC 2010 Social Simulation Tutorial.
GRID Overview Internet2 Member Meeting Spring 2003 Sandra Redman Information Technology and Systems Center and Information Technology Research Center National.
ISERVOGrid Architecture Working Group Brisbane Australia June Geoffrey Fox Community Grids Lab Indiana University
OGC and Grid in AU Dr Robert Woodcock Executive Manager, e-Science Stream Leader, Exploration and Mining.
Interoperability from the e-Science Perspective Yannis Ioannidis Univ. Of Athens and ATHENA Research Center
TCS-ICS interactions Kuvvet Atakan 1 and the WP6 and WP7 Teams 1 University of Bergen / Department of Earth Science.
1 Accomplishments. 2 Overview of Accomplishments  Sustaining the Production Earth System Grid Serving the current needs of the climate modeling community.
| nectar.org.au NECTAR TRAINING Module 2 Virtual Laboratories and eResearch Tools.
Development of e-Science Application Portal on GAP WeiLong Ueng Academia Sinica Grid Computing
3May20111QCIF ENABLING RESEARCH HIGH PERFORMANCE INFRASTRUCTURE & SERVICES QUESTnet ARCS Tools Workshop 3May2011.
CUAHSI HIS: Science Challenges Linking small integrated research sites (
GRID ANATOMY Advanced Computing Concepts – Dr. Emmanuel Pilli.
AN ORGANISATION FOR A NATIONAL EARTH SCIENCE INFRASTRUCTURE PROGRAM “Building Clients for the AuScope Spatial Information Services Stack (SiSS)” AuScope.
Partnerships in Innovation: Serving a Networked Nation Grid Technologies: Foundations for Preservation Environments Portals for managing user interactions.
NESC Worshop – 07 September 2005 Development of a Marine Metadata Standard Greg Reed Executive Officer Australian Ocean Data Centre Joint Facility.
1 SIMDAT Simdat Project –GTD. Meteo Activity – SIMDAT Meteo Activity OGF June 2008 Barcelona Marta Gutierrez, Baudouin Raoult, Cristina.
MAPS Middleware Action Plan & Strategy Project Middleware Action Plan & Strategy Project (MAPS) Patricia McMillan, Project Manager.
Distributed Data Servers and Web Interface in the Climate Data Portal Willa H. Zhu Joint Institute for the Study of Ocean and Atmosphere University of.
1 2.5 DISTRIBUTED DATA INTEGRATION WTF-CEOP (WGISS Test Facility for CEOP) May 2007 Yonsook Enloe (NASA/SGT) Chris Lynnes (NASA)
5-7 May 2003 SCD Exec_Retr 1 Research Data, May Archive Content New Archive Developments Archive Access and Provision.
Interoperability Day Introduction Standards-based Web Services Interfaces to Existing Atmospheric/Oceanographic Data Systems Ben Domenico Unidata Program.
JCU Australian Marine Science Data Network.
IODE Ocean Data Portal - technological framework of new IODE system Dr. Sergey Belov, et al. Partnership Centre for the IODE Ocean Data Portal.
ARCHER Building data and information management tools for the complete research life-cycle July 2006.
Advanced Computing and Grid Infrastructure in Australia ISGC April 2005 Taiwan John O’Callaghan Executive Director Australian Partnership for.
Accessing the VI-SEEM infrastructure
Australia's National Information Infrastructure for Research Markus Buchhorn Director, ICT Environments, The Australian National University (and APAC,
Research Data Archives at NCAR
RDSI: changing the face of research data storage in Australia
Data Management Components for a Research Data Archive
Presentation transcript:

TPAC Tasmanian Partnership for Advanced Computing Partner in APAC (Australian Partnership for Advanced Computing) Expertise centre for Earth Systems Science (ESS) Provides expertise & educational programs, as well as HPC facilities Located at University of Tasmania, Hobart Partnership between: Bureau of Met. Research Centre Antarctic Climate & Ecosystems CRCAustralian Antarctic Division Australian Maritime CollegeCSIRO Marine Research CSIRO Atmospheric ResearchUniversity of Tasmania Who is TPAC?

TPAC TPAC OPeNDAP Network APAC NF (Canberra) International IPCC model results (10-50Tb) TPAC 1/8 degree ocean simulations (7Tb) Met Bureau Research Centre (Melbourne) Near real-time LAPS analyses products (<1Gb) Sea- and sub-surface temperature products University of Tasmania (Hobart) NCEP2 (150Gb), WOCE3 Global (90Gb) Antarctic AWS (150Gb), Climate modelling (4Gb) ASPeCT sea-ice data (<1Gb) CSIRO Marine Research (Hobart) Ocean colour products & climatologies (1Tb) Satellite altimetry data (<1Gb) Argo float data (<1Gb), MSLA data (5Gb) CSIRO HPSC (Melbourne) IPCC CSIRO Mk3 model results (6Tb) AC3 Facility (Sydney) Land surface datasets

TPAC Global Search Documentation

TPAC  Rolling out THREDDS network (for Earth Systems Science)  OpenDAP, WCS, and gridftp, http, ftp  Metadata discovery search engine (with administration)  Adoption by Alexandria Digital Library  AO DAAC (with enhanced capabilities)  Web Map Services  Plugin for LAS (adopted by LAS)  Client portal in gridsphere  WMS functionality in THREDDS  A workflow for reading OpenDAP repositories (or catalogs) and augmenting the metadata to be conformal with marine profile Current relevant project

TPAC Foundation Services: AREN and AAF Data Tools & Discipline Services ANDS Platforms for Collaboration Compute Tools & Discipline Services NCI Interoperation & Collaboration Infrastructure ICI Researchers and research communities Resource owners and operators Users and User-Builders New tools, services & expertise Rolling out THREDDS

TPAC Interoperation Collaboration Infrastructure QPSF ANU VPAC ac3 TPAC CSIRO Network: GrangeNet APAC VPN (AARNet) Security: APAC CA MyProxy VOMRS Portal Tools: GridSphere Workflow Tools: Kepler? IVEC SAPAC APAC National Facility A virtual system of computing, data storage and visualisation facilities Systems: Gateways Partners’ Facilities QPSF (JCU)

TPAC ICI activities Operational aspect - Information, Portals & Collaboration Services Data management and Data Transport Services Job submission, Gateway VMs, AAA Help desk Development aspect - Next generation tools and services NEAT determined

TPAC Opportunities with ICI and ANDS PfC must support NCRIS streams (ie IMOS) ICI is operational (and funded June 2007, UJV) –ICI infrastructure (TPAC, IVEC, QCIF hosting data) –Affiliation with ICI partners NEAT –Approximately 56 EFT’s to deliver applications to solve problems eg related to MEST’s, portals, servlets, inclusion of legacy data, federations and virtual file systems, ontologies. –Projects, carried out by ANDS and ICI staff with durations of 1, 2 years, and with ~2-4 eft’s –6 monthly milestones

TPAC Analysis / Models  Discovery   Visualisation  Digital Repository  OPeNDAP  Crawler  APAC NF VPAC AC3 SAPAC IVEC Job/Data Management Grid Project: The Plan APAC National Grid Infrastructure

TPAC Visualisation Portlet Get Data Portlet Analysis/Model Portlet Web Map Service Web Processing Service Web Coverage Service OAI Library Search API (Java) Live Access Server (LAS) OPeNDAP Server Processing App./Models Meta data Crawler Digital Repository Gridsphere Portal Web Services Application Layer Data Layer Hardware Layer Compute Engine Config Meta data Discovery Portlet Grid Project: Current Status Grid Users GIS Users Traditional Users

TPAC ICI – goal is greater reach Lead Agency Exec DirAeRIC Support Agency NCRIS Agreement ICI Partners sign JV ICI Affiliates sign affiliate agreement

TPAC ICI activities Operational aspect - Information, Portals & Collaboration Services Data management and Data Transport Services Job submission, Gateway VMs, AAA Help desk Development aspect - Next generation tools and services NEAT determined

TPAC Platforms for Collaboration Data access and discovery, storage and management Grid enabled technologies and infrastructures Technical expertise High performance computing High capacity communication networks

TPAC Lots of demand… NCRIS 5.1 Bio Mol Platforms 5.2 Int Bio Systems 5.3 Characterisation 5.12 Marine Obs Sys 5.10 Astronomy 5.5 Biotech Products 5.4 Fabrication 5.8 Bio Security 5.13 Str & Evol Continent 5.16 Platforms for Collab data QoS collab dataQoScollab grid QoS data hpc virt.p collab hpc QoS d.sys

TPAC Foundation Services: AREN, AAF … User Tools & Discipline Services BuildersExperts Computing Infrastructure Data Collections Interactions Users Interoperation & Collaboration Infrastructure Early component structure

TPAC “Data and Collaboration” opportunities (TPAC+partners) Australian Model simulations and related data (ICI) accessible to researchers Development of tools related to data (ICI+ANDS) Free movement of data nationally and internationally (ICI) –Eg IPCC, ECCO, SODA, SOPHOCLES, NCASS, Cape Grim, other simulations (ENACT) Analysis Tools (on ICI infrastructure) Other NCRIS platforms –IMOS (eg data, and data discovery and access) –TERN + BLUENET Collaboration services (Wiki’s, code repositories, data repositories, visualisation)