19 May 2006 NCSA CIP Status Meeting 1 HDF5/SRB Integration Peter Cao & Mike Folk, NCSA Mike Wan & Reagan Moore, SDSC.

Slides:

Advertisements

Similar presentations

Digital Preservation Lifecycle Management Building a demonstration prototype for the preservation of large-scale multi-media collections Arcot Rajasekar.

Advertisements

Beatriz Martinez - SAT CFA Team 2 nd CFA Implementation Review ESAC, Madrid, 06 Jun 2013 CLUSTER FINAL ARCHIVE (CFA) Future developments.

HDF and HDF-EOS Workshop VII, September 23-25, This work is supported in part by a Cooperative Agreement with the National Aeronautics and Space.

Data Grid: Storage Resource Broker Mike Smorul. SRB Overview Developed at San Diego Supercomputing Center. Provides the abstraction mechanisms needed.

NATIONAL PARTNERSHIP FOR ADVANCED COMPUTATIONAL INFRASTRUCTURE SAN DIEGO SUPERCOMPUTER CENTER Particle Physics Data Grid PPDG Data Handling System Reagan.

SAN DIEGO SUPERCOMPUTER CENTER HDF5/SRB Integration July 10, 2006 Mike Wan SRB, SDSC Peter Cao

October 15-17, 2008HDF and HDF-EOS Workshop XII, Denver, CO1 HDF5-iRODS Peter Cao The HDF Group Mike Wan San Diego Supercomputer Center HDF and HDF-EOS.

PARTNER-Grid Teleconference, CERN , Prototype architecture Tools, implementation & services Conclusions (& demo) Faustin.

Create New feature Approved Change request Create User Stories for the feature Add User stories to Target Process backlog User Stories – 1.Create Story.

OPEN RESEARCH DATA, EPFL, 28 October 2014, M. Töwe, M. Bärlocher docuteam packer: viewer and editor for file structures and metadata.

iRODS: Interoperability in Data Management

ARCS Data Analysis Software An overview of the ARCS software management plan Michael Aivazis California Institute of Technology ARCS Baseline Review March.

Robust Tools for Archiving and Preserving Digital Data Joseph JaJa, Mike Smorul, and Mike McGann Institute for Advanced Computer Studies Department of.

Track the different events in which individuals have participated in throughout the year Track the amount of credits any member has and their eligibility.

Improving long-term preservation of EOS data by independently mapping HDF4 data objects The HDF Group.

© , Michael Aivazis DANSE Software Issues Michael Aivazis California Institute of Technology DANSE Software Workshop September 3-8, 2003.

Complete and Present Prototype Project 6 Status report: Tuesday, October 5 th Due: Saturday, October 9 th Presentation: Tuesday, October 12 th.

University of Illinois at Urbana-ChampaignHDF Mike Folk HDF-EOS Workshop IV Sept , 2000 HDF Update HDF.

HDF 1 NCSA HDF XML Activities Robert E. McGrath Mike Folk National Center for Supercomputing Applications.

METS-Based Cataloging Toolkit for Digital Library Management System Dong, Li Tsinghua University Library

SC Websites Training of webmasters end of March/ beginning of April Validation of content in April Launching in May/ June (at the end of March, the hosting.

SAN DIEGO SUPERCOMPUTER CENTER HDF5/SRB Integration August 28, 2006 Mike Wan SRB, SDSC Peter Cao

Exploring the Applicability of Scientific Data Management Tools and Techniques on the Records Management Requirements for the National Archives and Records.

February 2-3, 2006SRB Workshop, San Diego P eter Cao, NCSA Mike Wan, SDSC Sponsored by NLADR, NFS PACI Project in Support of NCSA-SDSC Collaboration Object-level.

1 1 Vulnerability Assessment of Grid Software Jim Kupsch Associate Researcher, Dept. of Computer Sciences University of Wisconsin-Madison Condor Week 2006.

PCWG Analysis Tool Peter Stuart September 15, 2015.

Relationships July 9, Producers and Consumers SERI - Relationships Session 1.

December 1, 2005HDF & HDF-EOS Workshop IX P eter Cao, NCSA December 1, 2005 Sponsored by NLADR, NFS PACI Project in Support of NCSA-SDSC Collaboration.

HDF Converting between HDF4 and HDF5 MuQun Yang, Robert E. McGrath, Mike Folk National Center for Supercomputing Applications University of Illinois,

1/14/200925th IIPS Conference 1 Challenges to Archive and Access NASA HDF-EOS Data in the long Term MuQun Yang (The HDF Group) Choonghwan Lee (The HDF.

Jaws Digital Courier Justin Coombes Product Manager Jaws Product Line / Global Graphics.

Towards Long-Term Archiving of NASA HDF-EOS and HDF Data Data Maps and the Use of Mark-Up Language Ruth Duerr, Mike Folk, Muqun Yang, Chris Lynnes, Peter.

Creating Archive Information Packages for Data Sets: Early Experiments with Digital Library Standards Ruth Duerr, NSIDC MiQun Yang, THG Azhar Sikander,

Integrating HDF5 with SRB The HDF5-SRB Architecture Peter Cao, HDF, NCSA February 24, 2005.

DC2 Post-Mortem/DC3 Scoping February 5 - 6, 2008 DC3 Goals and Objectives Jeff Kantor DM System Manager Tim Axelrod DM System Scientist.

SAN DIEGO SUPERCOMPUTER CENTER HDF5/SRB Integration June 14, 2006 Mike Wan SRB, SDSC Peter Cao

March 17, 2006CIP Status Meeting March 17, 2006 Sponsored by NLADR, NFS PACI Project in Support of NCSA-SDSC Collaboration Project Report at CIP AG Meeting.

Rule-Based Preservation Systems Reagan W. Moore Wayne Schroeder Mike Wan Arcot Rajasekar Richard Marciano {moore, schroede, mwan, sekar,

National Partnership for Advanced Computational Infrastructure San Diego Supercomputer Center Persistent Archive for the NSDL Reagan W. Moore Charlie Cowart.

1 These materials are prepared only for the students enrolled in the course Distributed Software Development (DSD) at the Department of Computer Science.

INFSO-RI Enabling Grids for E-sciencE SA1 and gLite: Test, Certification and Pre-production Nick Thackray SA1, CERN.

15/06/2006 The Future of Visual DCT EPICS Collaboration 2006 Argonne National Laboratory

Policy Based Data Management Data-Intensive Computing Distributed Collections Grid-Enabled Storage iRODS Reagan W. Moore 1.

LHCb Software Week November 2003 Gennady Kuznetsov Production Manager Tools (New Architecture)

CCSDS Meeting CNES Report, 2/11/2004 CNES 1 CCSDS - MOIMS Area Data Archive ingestion WG Information Packaging and Registry WG CNES Report on activity.

Page 1 TOOLKIT / HDF-EOS Status and Development Abe Taaheri, Raytheon IIS Aura DSWG meeting October 2007.

The HDF Group Support for NPP/NPOESS by The HDF Group Mike Folk, Elena Pourmal, Peter Cao The HDF Group November 5, 2009 November 3-5,

Chatter Box Daniel Dunham Mike Nelson Nick Noack.

Owen SyngeTitle of TalkSlide 1 Storage Management Owen Synge – Developer, Packager, and first line support to System Administrators. Talks Scope –GridPP.

Experiment Management System CSE 423 Aaron Kloc Jordan Harstad Robert Sorensen Robert Trevino Nicolas Tjioe Status Report Presentation Industry Mentor:

HDF and HDF-EOS Workshop VIII, October 26-28, /12 Peter Cao, National Center for Supercomputing Applications Ray Milnurn, Dave Buto, L-3 Communications.

CS 490 Software Testing Fall 2009 Implement Unit Test Framework for Application running on a Pocket PC 2003 device 09/18/091 Framework for Unit-testing.

CSC 4700 Software Engineering

HDF-EOS Workshop IV September 19-21, 2000 Richard E. Ullman ESDIS Information Architect NASA/ GSFC, Code 423.

Improving long-term preservation EOS data by independently mapping HDF4 data objects Mike Folk, Ruth Aydt, Peter Cao, Kent Yang Ruth Duerr Christopher.

A Road Map for PODS Utilizing ArcGIS Location Reference for Pipelines (ALRP)

National Archives and Records Administration1 Integrated Rules Ordered Data System (“IRODS”) Technology Research: Digital Preservation Technology in a.

TargetProcess - AGILE Project tracking tool Shashwat Gupta CS

Status of Globus activities Massimo Sgaravatto INFN Padova for the INFN Globus group

Rights Management for Shared Collections Storage Resource Broker Reagan W. Moore

Engineering John DeHart and Jon Turner Applied Research Lab, Washington University SPP Deployment Plan.

NARA Report: NARA Persistent Archives Prototype Bill Underwood GTRI, Atlanta CCSDS, MOIMS DAI / IPR WGs Toulouse, 2 Nov-5 Nov 2004.

PRAGMA 25 Working Group Updates Resources Working Group Yoshio Tanaka (AIST) Phil Papadopoulos (UCSD) Most slides by courtesy of Peter, Nadya, Luca, and.

SPECTO IT TRAINING Contact us: INDIA: , USA : ,

Oracle HFM Implementation Boot Camp Presented by Saravanan Singaravadivelan Developed by Saravanan Singaravadivelan Senior Consultant Qubix International.

INFSOM-RI WP3: WP3: Software configuration tools and methodologies Status Report ETICS All-Hands – 23 May 2007 E. Ronchieri.

Data Grids, Digital Libraries and Persistent Archives: An Integrated Approach to Publishing, Sharing and Archiving Data. Written By: R. Moore, A. Rajasekar,

Constructing Deploying and Maintaining Enterprise Systems

Mike Folk, Peter Cao, Kent Yang Ruth Duerr Christopher Lynnes

Policy-Based Data Management integrated Rule Oriented Data System

Presentation transcript:

19 May 2006 NCSA CIP Status Meeting 1 HDF5/SRB Integration Peter Cao & Mike Folk, NCSA Mike Wan & Reagan Moore, SDSC

19 May 2006 NCSA CIP Status Meeting 2 Work Being Done Identify two SAP applications –SDSC ENZO project (have talked to Robert Harkness) –NCSA FLASH project –What support for these applications Work with Federico Bassetti (NCSA) –Give detailed instruction on HDF5/SRB installation –Work on Performance test tool –Port HDF5/SRB to the Grid system

19 May 2006 NCSA CIP Status Meeting 3 Work Being Done Work with NARA –Help NARA to install HDF5/SRB system –NARA highlighted HDF-SRB work and HDFView in the NARA Virtual Archives Lab (MD) and the Lab/Demo Center at the main Archives Building (D.C) –NARA gave demo to members of Congress and the President's staff well received

19 May 2006 NCSA CIP Status Meeting 4 Work Being Done Development in HDF5 AIP –Finish the draft of the HDF5 AIP white paper Metadata Encoding & Transmission Standard (METS) METS document for HDF5 AIP h5ingest – a tool to generate metadata for HDF5 AIP –Work on h5ingest (tool to view, edit and validate HDF5 METS file)

19 May 2006 NCSA CIP Status Meeting 5 Work Plan 04/30/06 -- Complete prototype implementation of HDF5 AIP (NCSA and SDSC) 05/31/06 -- Write test suite and fix bugs (NCSA and SDSC) 06/30/06 -- Improve performance for transferring raw data (NCSA and SDSC) 07/31/06 -- Add more features to HDFView for SRB support (NCSA) -- integrate the software into the SRB configuration and distribution (SDSC) 09/30/06 -- Support primitive writing capabilities for HDF5 files in SRB (NCSA and SDSC) 11/30/06 -- Write documentation and extensive testing (NCSA and SDSC) 12/30/06 -- Release the production system and publish documentation