Data Files Conventions (Discussion) May 2006 Peter Schroeder UC-Berkeley

Slides:



Advertisements
Similar presentations
웹 서비스 개요.
Advertisements

Chapter 11 Direct Data Collection: Surveys and Interviews Zina OLeary.
Microsoft Excel 2003 Illustrated Complete Excel Files and Incorporating Web Information Sharing.
Session A Wrap Up. He Abundance J. Kasper Helium abundance variation over the solar cycle, latitude and with solar wind speed Slow solar wind appears.
OPEN ACCESS Your Publisher of Choice DE GRUYTER OPEN Society-Pays Publishing Program.
10/27/2004VxO Workshop1 Joining Subfield Data Repositories VHO Design Philosophy Adam Szabo NASA Goddard Space Flight Center.
STEREO Science Center Status Report William Thompson NASA Goddard Space Flight Center Phase E Kickoff Meeting February 23, 2007.
Further Study of Ion Pickup. Turbulent Alfven waves and magnetic field lines Turbulent waves represent enhanced random fluctuations. Fluctuations vitiate.
The Virtual Heliospheric Observatory VHO Adam Szabo, Tom Narock, Jan Merka, Aaron Roberts, Jon Vandegriff, George Ho, Jim Raines, Peter Schroeder, Andrew.
Random-coefficient Models 1. Markov-switching model (MRS) 2. Threshold model 3. Quantile Regression model (QR)
1 Lecture 13: Database Heterogeneity Debriefing Project Phase 2.
Queries and query design What are queries? Questions that can be asked of the data in the tables. Questions can draw on one or more tables and can have.
Online Analysis for STEREO's IMPACT Investigation: Lessons Learned P. Schroeder, J.G. Luhmann, W. Marchant and V. Toy (University of California – Berkeley),
Solar system science using X-Rays Magnetosheath dynamics Shock – shock interactions Auroral X-ray emissions Solar X-rays Comets Other planets Not discussed.
CHAPTER 3&4 ZHONGWEI LI TouchDevelop Book. What are we covering Review of Chapter 1-2 TouchDevelop as a scripting language: actions, events, table and.
Watershed Data System: Overview Jean L. Steiner, E. John Sadler, Jin-Song Chen Greg Wilson, David James, Bruce Vandenberg John Ross, Teri Oster, Kevin.
Web-based Portal for Discovery, Retrieval and Visualization of Earth Science Datasets in Grid Environment Zhenping (Jane) Liu.
What is Where? Getting Started With Geographic Information Systems Chapter 5.
ACCESS TO QUALITY RESOURCES ON RUSSIA Tanja Pursiainen, University of Helsinki, Aleksanteri institute. EVA 2004 Moscow, 29 November 2004.
Accuracy of spacecraft measurements of solar wind plasma: Past, Present and Future John Podesta & John Steinberg Organizers Shine Workshop, July 6-10,
ISI Web of Knowledge – Update Jan 2009 New features of ISI Web of Knowledge.
Online real-time tweets extraction, mapping and dissemination Xiannian Chen and Gregory Elmes West Virginia University Chen & West Virginia University2014.
STEREO Science Center SWG – May 2005 William Thompson NASA Goddard SFC Code Greenbelt, MD
STEREO Science Center William Thompson NASA Goddard SFC Code Greenbelt, MD
Inter-American Workshop on Environmental Data Access Panel discussion on scientific and technical issues Merilyn Gentry, LBA-ECO Data Coordinator NASA.
AMDA and CLweb Two complementary web-based services for spacecraft data exploitation with help from LESIA and support from CNES and CNRS Benoit Lavraud,
Introduction to Apache OODT Yang Li Mar 9, What is OODT Object Oriented Data Technology Science data management Archiving Systems that span scientific.
What is the Sun like? Chapter The Sun is the largest object in the solar system The Sun is the largest object in the solar system It’s diameter.
College of Natural and Applied Sciences Master of Science in Biology Master of Science in Biology Degree 8 Faculty: From CNAS, WERI & Marine Lab 8 Faculty:
A/WWW Enterprises 28 Sept 1995 AstroBrowse: Survey of Current Technology A. Warnock A/WWW Enterprises
WSL Workshop The Long and Winding Road to MODIS Data.
Marlo Maddox Code 587 Advanced Data Management & Analysis Branch HDF/HDF-EOS Workshop VII - Silver Spring, MD September 23 – 25, 2003 An Evaluation of.
Living With a Star (LWS) and the Vision for Exploration LWS Mission Goal: Develop the scientific understanding necessary to effectively address those aspects.
M.Benno Blumenthal and John del Corral International Research Institute for Climate and Society OpenDAP 2007
THEMIS Workshop 1 UC Berkeley, 18 December 2004 Data Products and Access Tim Quinn UC Berkeley.
S. Belogurov, ITEP, Moscow CBM Collaboration meeting, Split, CBM beam pipe and integration inside the Magnet Status report Sergey Belogurov,
Sam and Soul.  Solenoid is a long straight coil of wire that can be used to generate a nearly uniform magnetic field which is similar to the bar magnet.
IMPACT SWG Status Report – December 11, Early IMPACT Timeline Status Day 3,410-28, 10-29IDPU/MAG/SWEA and STE turned on Day 711-1Booms deployed.
SPASE and the VxOs Jim Thieman Todd King Aaron Roberts.
IMPACT Data Plans May 2006 Peter Schroeder UC-Berkeley
William Thompson L-3 Communications NASA Goddard Space Flight Center STERE The STEREO Science Center.
STEREO Science Center Status Report William Thompson NASA Goddard Space Flight Center STEREO SWG March 27-28, 2007.
Database Basics BCIS 3680 Enterprise Programming.
Michael L. Kaiser STEREO Project Scientist NASA/Goddard Space Flight Center STEREO May 2, 2008 STEREO at 1.25 years.
11/20/0711 Group Four Brian CurtisImran Shah Byeonghwa ParkFrancis Kanyugi CSI 710 Project 11/20/07.
STEREO Science Center Status Report William Thompson NASA Goddard Space Flight Center STEREO SWG November 2007 Pasadena, California.
Mission Description Well-designed spacecraft and instruments using high energy launches and gravity assists to escape quickly Could be accomplished by.
DE GRUYTER OPEN PUBLISHING PROPOSAL 2January 2016Publishing Proposal.
Global Change Master Directory (GCMD) Mission “To assist the scientific community in the discovery of Earth science data, related services, and ancillary.
STEREO and the Virtual Heliospheric Observatory Tom Narock 1,2 Adam Szabo 1 Jan Merka 2 (1) NASA/Goddard Space Flight Center (2) L3 Communications, GSI.
Maria Gunnarsson SCB Mikael Nordberg SCB PX-Web 2015 December.
PDS M/C November 2012 PPI MAVEN Report PDS4 Mission Report: MAVEN PDS Management Council November 28, 2012 J. Mafi.
STEREO Science Center SWG – November 2005 William Thompson NASA Goddard SFC Code Greenbelt, MD
Mars Atmosphere and Volatile Evolution mission MAVEN The mission’s goal is to explore the planet’s upper atmosphere, ionosphere, and interactions with.
Advanced Composition Explorer Measuring the Solar Wind and Solar Flares Oscar Puente Mentor: Dr. Paul Marchese.
LOGO Student: Michael Rodov Student: Alex Kouslik
Introduction to BODC and GEOTRACES data office Edward Mawji British Oceanographic Data Centre
PLASTIC Post Launch Data Flow Lynn Kistler & Lorna Ellis May 2006.
Using EduStat © Software Classical Items Analysis Computing.
NASA Endeavour Program North Pocono Middle School
Designing Cross-Language Information Retrieval System using various Techniques of Query Expansion and Indexing for Improved Performance  Hello everyone,
Introduction to Atmospheric Science at Arecibo Observatory
Website URL
Metadata Quality: Learning from Open Data Portalwatch
ISI Web of Knowledge Early updates
STEREO Michael L. Kaiser STEREO Project Scientist
Web archives as a research subject
*metrics Project Introduction
Austin Karingada, Jacob Handy, Adviser : Dr
Presentation transcript:

Data Files Conventions (Discussion) May 2006 Peter Schroeder UC-Berkeley

Metadata Why we are using the ISTP-compliance standard – –Constitute minimum acceptable metadata standard Global Attributes –"Project" { "ISTP>International " - "Solar-Terrestrial Physics" }."Project" –"Source_name" { "GEOTAIL>Geomagnetic Tail" }."Source_name" –"Discipline" { "Space Physics>Magnetospheric Science" }."Discipline" –"Data_type" { "K0>Key Parameter" }."Data_type" –"Descriptor" { "EPI>Energetic Particles" - " and Ion Composition" }."Descriptor" –"Data_version" { "1" }."Data_version" –"Logical_file_id" { "GE_K0_EPI_ _V01" }."Logical_file_id" –"PI_name" { "D. Williams" }."PI_name" –"PI_affiliation" { "JHU/APL" }."PI_affiliation" –"TEXT" { "reference to journal article, URL address" }."TEXT" –"Instrument_type" { "Magnetic Fields (space)" }."Instrument_type" –"Mission_group" { "Geotail" }."Mission_group" –"Logical_source" { "GE_K0_EPI" }."Logical_source" –"Logical_source_description" { "Geotail Magnetic Field Key Parameters" }."Logical_source_description"

More on the ISTP Standard Variable Attributes –"SW_P_Den” –"CATDESC" CDF_CHAR { "Ion number density (Solar Wind " - "Analyzer), scalar" } –"DEPEND_0" CDF_CHAR { "Epoch" } –"DICT_KEY" CDF_CHAR { "density>ion_number“ } –"DISPLAY_TYPE" CDF_CHAR { "time_series" } –"FIELDNAM" CDF_CHAR { "Ion Number Density (CPI/SWA)" } –"FILLVAL" CDF_REAL4 { -1.0e+31 } –"FORMAT" CDF_CHAR { "f8.3" } –"LABLAXIS" CDF_CHAR { "Ion N" } –"UNITS" CDF_CHAR { "#/cc" } –"VALIDMIN" CDF_REAL4 { 0.01 } –"VALIDMAX" CDF_REAL4 { } –"VAR_NOTES" CDF_CHAR { "Assuming no helium (0.3 - several " - "hundred) if the density is less than " - "0.3/cc the higher moments (VEL,TEMP) " - "shall not be used because of the poor " - "counting statistics." } –"VAR_TYPE" CDF_CHAR { "data" }.

Metadata Status for STEREO Data Products PLASTIC and IMPACT have both committed to providing ISTP-compliant CDF’s for basic science products S/WAVES? Will there be higher level products? How will metadata be captured? SECCHI products? What kinds of metadata make sense?

Mapping to SPASE Basis for VHO API “The SPASE data system is a model for scientific data systems. It is based on the latest web-based technologies and is designed to be a distributed data systems with a heterogenous mix of platforms and systems.” SPASE website: ACE Example: Essentially, a dictionary for constructing search queries so that everyone is “talking the same language” Work ongoing to improve SPASE for particle data

More on File Conventions ssc.nascom.nasa.gov/intranet/software_telecon/ /telecon_2005_04_20.txthttp://stereo- ssc.nascom.nasa.gov/intranet/software_telecon/ /telecon_2005_04_20.txt Do we want uniform file naming conventions? Standard convention doesn’t really seem to work for IMPACT: STA_L01_PLASTIC_ _V02.CDF Need ability to reflect subproducts for IMPACT: STB_L1_SWEA_DISB_ _V01.cdf