Steven Worley, NSF/NCAR/SCD

Slides:



Advertisements
Similar presentations
Data management in SCD Steven Worley General Categories –The Mass Storage System –NCAR user file services (home directories) –Computer attached storage.
Advertisements

TCP/IP Protocol Suite 1 Copyright © The McGraw-Hill Companies, Inc. Permission required for reproduction or display. Chapter 22 World Wide Web and HTTP.
SCD Research Data For UCAR Data Management Working Group January 10, 2001 Steven Worley Scientific Computing Division Data Support Section.
ICOADS Archive Practices at NCAR JCOMM ETMC-III 9-12 February 2010 Steven Worley.
Copyright 2004 Monash University IMS5401 Web-based Systems Development Topic 2: Elements of the Web (g) Interactivity.
Design of Web-based Systems IS Development: lecture 10.
TC2-Computer Literacy Mr. Sencer February 4, 2010.
World Wide Web1 Applications World Wide Web. 2 Introduction What is hypertext model? Use of hypertext in World Wide Web (WWW) – HTML. WWW client-server.
The International Surface Pressure Databank (ISPD) and Twentieth Century Reanalysis at NCAR Thomas Cram - NCAR, Boulder, CO Gilbert Compo & Chesley McColl.
A content management system (CMS) is a computer program that allows publishing, editing and modifying content on a web site as well as maintenance from.
By: Marcus Owens. Essential Components Your computer depends on two things: hardware and software. Hardware are physical components that make up your.
Scientific Investigations; Support from Research Data Archives for Computing in Atmospheric Sciences October, 2001 Steven Worley National Center.
Computer Concepts 2014 Chapter 7 The Web and .
October 16-18, Research Data Set Archives Steven Worley Scientific Computing Division Data Support Section.
CPS120: Introduction to Computer Science The World Wide Web Nell Dale John Lewis.
Research Data at NCAR 1 August, 2002 Steven Worley Scientific Computing Division Data Support Section.
15 Maintaining a Web Site Section 15.1 Identify Webmastering tasks Identify Web server maintenance techniques Describe the importance of backups Section.
Section 15.1 Identify Webmastering tasks Identify Web server maintenance techniques Describe the importance of backups Section 15.2 Identify guidelines.
WEB TERMINOLOGIES. Page or web page: a file that can be read over the world wide web Pages or web pages: the global collection of documents associated.
Growing and Future Datasets in the SCD Research Data Archives for NSF SCD Review Panel 16 October 2001 Steven Worley Scientific Computing Division Data.
Data for Climate and Energy Studies Steven Worley Computational and Information Systems Laboratory NCAR.
UNIT 12 SERVER SIDE OF A WEBSITE Cambridge Technicals.
UWG 2013 Meeting PO.DAAC Web Services Demo. What are PO.DAAC Web Services?
Scientific Investigations; Support from Research Data Archives for Joint Office for Science Support 26 February, 2002 Steven Worley SCD/DSS.
Case study: Connecting data to the Data Provider Sergey Sukhonosov National Oceanographic Data Centre, Russia Expert training on the Ocean Data Portal.
Climate reanalysis at ECMWF Reanalysis is based on analysis methods developed to provide initial states for numerical weather prediction It applies a fixed,
Analyzed Data Products Available from NCAR that Support Marine Climate Research JCOMM ETMC-III 9-12 February 2010 Steven Worley Doug Schuster.
Web Design (1) Terminology. Coding ‘languages’ (1) HTML - Hypertext Markup Language - describes the content of a web page CSS - Cascading Style Sheets.
Opportunities and constraints for development and translation of digital learning resources How difficult is it to translate or adjust existing digital.
Content, Discovery, and Accessibility Enhancements to the NCAR Research Data Archive Doug Schuster and Steve Worley NCAR.
GO-ESSP Workshop, LLNL, Livermore, CA, Jun 19-21, 2006, Center for ATmosphere sciences and Earthquake Researches Construction of e-science Environment.
RUBRIC IP1 Ruben Botero Web Design III. The different approaches to accessing data in a database through client-side scripting languages. – On the client.
Chapter 29 World Wide Web & Browsing World Wide Web (WWW) is a distributed hypermedia (hypertext & graphics) on-line repository of information that users.
Dataset registration process Sergey Sukhonosov, Dr. Sergey Belov National Oceanographic Data Centre, Russia Training course on establishment of the ODP.
29 March 2004 Steven Worley, NSF/NCAR/SCD 1 Research Data Stewardship and Access Steven Worley, CISL/SCD Cyberinfrastructure meeting with Priscilla Nelson.
SCD Research Data Archives; Availability Through the CDP About 500 distinct datasets, 12 TB Diverse in type, size, and format Serving 900 different investigators.
The Research Data Archive at NCAR: A System Designed to Handle Diverse Datasets Bob Dattore and Steven Worley National Center for Atmospheric Research.
Global Change Master Directory (GCMD) Mission “To assist the scientific community in the discovery of Earth science data, related services, and ancillary.
1 SIMDAT Simdat Project –GTD. Meteo Activity – SIMDAT Meteo Activity OGF June 2008 Barcelona Marta Gutierrez, Baudouin Raoult, Cristina.
Data Discovery and Access to The International Surface Pressure Databank (ISPD) 1 Thomas Cram Gilbert P. Compo* Doug Schuster Chesley McColl* Steven Worley.
 A content management system ( CMS ) is a system providing a collection of procedures used to manage work flow in a collaborative environment. These.
SCD Research Data for Ocean Observatories Steering Committee June 18, 2001 Steven Worley Scientific Computing Division Data Support Section.
5-7 May 2003 SCD Exec_Retr 1 Research Data, May Archive Content New Archive Developments Archive Access and Provision.
1. Gridded Data Sub-setting Services through the RDA at NCAR Doug Schuster, Steve Worley, Bob Dattore, Dave Stepaniak.
2013 GSICS Joint Meeting, Williamsburg VA, USA, March GSICS Collaboration Servers Status: 2013 Peter Miu (EUMETSAT) CMA, CNES, EUMETSAT, ISRO,
WWW and HTTP King Fahd University of Petroleum & Minerals
What is WWW? The term WWW refers to the World Wide Web or simply the Web. The World Wide Web consists of all the public Web sites connected to the Internet.
Warm Handshake with Websites, Servers and Web Servers:
MERRA Data Access and Services
DWQ Web Transformation
Publishing and Maintaining a Website
Section 15.1 Section 15.2 Identify Webmastering tasks
PHP / MySQL Introduction
Web page a hypertext document connected to the World Wide Web.
Web Site Development.
Google Apps for Education
Operational Dataset Update Functionality Included in the NCAR Research Data Archive Management System Zaihua Ji Doug Schuster Steven Worley Computational.
Development and Futures of Research Data Archives
Research Data Archives at NCAR
Empowerment through knowledge and the sharing of knowledge
CISL’s Research Data Archive (RDA) : Description and Methods
Exploring Web Page Design
Comeaux and Worley, NSF/NCAR/SCD
Long-Lived Data Collections
JADDS- Jülich Atmospheric Data Distribution Service
Data Management Components for a Research Data Archive
Robert Dattore and Steven Worley
Successful Data Curation for Large Data Archives
Data Curation in Climate and Weather
Comeaux and Worley, NSF/NCAR/SCD
Presentation transcript:

Steven Worley, NSF/NCAR/SCD Research Data Archives Archiving, Maintenance, Access Steven Worley, Scientific Computing Division 23 February 2019 Steven Worley, NSF/NCAR/SCD

Steven Worley, NSF/NCAR/SCD Data Archiving Definition: Research data archive Meteorological and physical oceanographic data Built over 35+ years 500+ datasets, 25 TB Eight data stewards (grad. degrees in met./ocn.) 23 February 2019 Steven Worley, NSF/NCAR/SCD

Steven Worley, NSF/NCAR/SCD 23 February 2019 Steven Worley, NSF/NCAR/SCD

Steven Worley, NSF/NCAR/SCD Data Maintenance Practices Track lineage - Use change control system Creation File additions, fixes, replacement Metadata updates The data and metadata remain tightly linked Keep user information current Changes trigger web page updates 23 February 2019 Steven Worley, NSF/NCAR/SCD

Steven Worley, NSF/NCAR/SCD Data Maintenance Concerns Fact: Huge collections of web based documentation. Text, Images, Links Embedded scripting (e.g. java script …) HOW DO WE ARCHIVE WEB SITES? Access content 20 years from now? Data in DBMS’s Software dependent Not viable for long-term archive, technology trap 23 February 2019 Steven Worley, NSF/NCAR/SCD

Steven Worley, NSF/NCAR/SCD Data Access Discovery Community Data Portal (NCAR/UCAR wide) Standardized metadata Divisional Section Server Detailed metadata, all documentation Four access modes MSS Only for users with MSS connection (NCAR/UCAR) By individual request Handled by data stewards CDROM Section Data Server Popular data only, metadata (open to the public) 23 February 2019 Steven Worley, NSF/NCAR/SCD

Steven Worley, NSF/NCAR/SCD 23 February 2019 Steven Worley, NSF/NCAR/SCD

Steven Worley, NSF/NCAR/SCD ERA-40 Data Basic Facts Global atmospheric reanalysis T159, 60 level, 4x/day, ( 1.1° resolution) 1958  2002 (45 years) 23 February 2019 Steven Worley, NSF/NCAR/SCD

Steven Worley, NSF/NCAR/SCD ERA-40 23 February 2019 Steven Worley, NSF/NCAR/SCD

Steven Worley, NSF/NCAR/SCD ERA-40 Monthly Mean Air Temperature at 2m Odds and ends 2 to 3 FTE’s focused on ERA-40 SCD is ERA-40 archive backup for ECMWF Primary U.S. source NASA collaboration CCSP Contribution, NASA Global Reanalysis, at GMAO/GSFC Modern Era Reanalyses for Research and Applications (MERRA) We will provide input data used in ERA-40 MERRA output at NCAR/UCAR? 23 February 2019 Steven Worley, NSF/NCAR/SCD

Feedback: Privacy Policy Feedback
Do Not Sell My Personal Information
About project: SlidePlayer Terms of Service

© 2025 SlidePlayer.com. Inc. All rights reserved.