Page 1 of 18 2005 European Geosciences Union Assembly Session US5: The International Polar Year 2007-2008 April 27, 2005Vienna, Austria Vladimir Papitashvili,

Slides:



Advertisements
Similar presentations
Developing the ICSU World Data System (WDS) Mustapha Mokrane ICSU Secretariat Science and Information Technology Officer.
Advertisements

1 NASA CEOP Status & Demo CEOS WGISS-25 Sanya, China February 27, 2008 Yonsook Enloe.
Solar and STP Physics with AstroGrid 1. Mullard Space Science Laboratory, University College London. 2. School of Physics and Astronomy, University of.
Richard A. Harrison Rutherford Appleton Laboratory United Kingdom IHY – The International Heliophysical Year.
IPY Dr Eduard Sarukhanian, Special Adviser to Secretary–General on IPY International Polar Year Status of preparation and the role.
Web-based Portal for Discovery, Retrieval and Visualization of Earth Science Datasets in Grid Environment Zhenping (Jane) Liu.
TPAC Digital Library Talk Overview Presenter:Glenn Hyland Tasmanian Partnership for Advanced Computing & Australian Antarctic Division Outline: TPAC Overview.
Jordan G. Powers Mesoscale and Microscale Meteorology Division NCAR Earth System Laboratory National Center for Atmospheric Research Space Weather Workshop.
PLANS FOR THE INTERNATIONAL HELIOPHYSICAL YEAR (IHY) Sept 2005 An international program of scientific research Joseph Davila, Barbara Thompson, Nat Gopalswamy.
US NITRD LSN-MAGIC Coordinating Team – Organization and Goals Richard Carlson NGNS Program Manager, Research Division, Office of Advanced Scientific Computing.
Japanese Activities for eGY * T. Iyemori and Japanese eGY committee * Graduate School of Science, Kyoto University CODATA-20, Beijing Contents:
VGMO.NET Vladimir Papitashvili Anshuman Saxena Valeriy Petrov umich.edu Robert Clauer
The Electronic Geophysical Year (eGY) Emily CoBabe-Ammann 1, W.K. Peterson 1, Daniel Baker 1, Peter Fox 2 and Charles Barton 3 1 Laboratory for Atmospheric.
EGY BASICS The Electronic Geophysical Year,
ILWS and Data Services D. G. Sibeck, Aaron Roberts NASA/GSFC Ray Walker UCLA.
Introduction to the Electronic Geophysical Year, (eGY)
Moving Beyond IGY: An electronic Geophysical Year (eGY) Concept D.N. Baker Laboratory for Atmospheric and Space Physics University of Colorado - Boulder.
SAON is a process to support and strengthen the development of multinational engagement for sustained and coordinated pan-Arctic observing and data sharing.
EGY Meeting March Page 1 The Data Policy for NASA's Heliophysics Science Missions & the eGY Geoscience Information Commons D. A. Roberts.
EGY - an opportunity to improve access to Earth and space science data
EGY Description based on eGY presentations and discussions at Paris & Boulder 23 July & 3 September 2004 by
1 Collaborations and Partnerships John Broome CODATA-International.
EGY BASICS The Electronic Geophysical Year,
Volodya Papitashvili Anshuman Saxena Valeriy Petrov Robert Clauer Page 1 of 16 VGMO NET NASA/LWS Workshop: Virtual Observatories in Space and Solar Physics.
IGY+50, The IPY, and The electronic Geophysical Year (eGY) D.N. Baker Laboratory for Atmospheric and Space Physics University of Colorado, Boulder C. Barton.
Page 1 of Joint Assembly: AGU, SEG, NABS & SPD/AAS Session U08: eGY: e-Science for Geoscience May 24, 2005New Orleans, LA Volodya Papitashvili,
Page 1 of 18 NASA/LWS Workshop: Virtual Observatories in Space and Solar Physics October 27-29, 2004; Greenbelt, Maryland Dan Baker, Charlie Barton, Brian.
Summary of distributed tools of potential use for JRA3 Dugan Witherick HPC Programmer for the Miracle Consortium University College.
WDCs and GSDI David M. Clark World Data Center Panel Global Data Access and Integration Workshop May 8-9, 2000, Canberra, Australia.
What is Cyberinfrastructure? Russ Hobby, Internet2 Clemson University CI Days 20 May 2008.
EGY, Polar Research Board Meeting 5 May 2005 The eGY Opportunity eGY_Team members.
Page 1 Pacific THORPEX Predictability, 6-7 June 2005© Crown copyright 2005 The THORPEX Interactive Grand Global Ensemble David Richardson Met Office, Exeter.
Realizing the research library - data center alliance 8 October 2008 T198. Libraries in Transformation: Exploring Topics of Changing Practices and New.
The interoperability era 2005 Joint Assembly AGU, NABS, SEG, SPD/AAS U22A eGY: e-Science for Geoscience I Introduction by
The IHY continues the tradition of previous international years through synoptic observation of universal physical processes in the solar system. Historical.
Linking Tasks, Data, and Architecture Doug Nebert AR-09-01A May 2010.
Bob Jones Technical Director CERN - August 2003 EGEE is proposed as a project to be funded by the European Union under contract IST
What is GEO? launched in response to calls for action by the 2002 World Summit on Sustainable Development, Earth Observation Summits, and by the G8 (Group.
Draft GEO Framework, Chapter 6 “Architecture” Architecture Subgroup / Group on Earth Observations Presented by Ivan DeLoatch (US) Subgroup Co-Chair Earth.
National Center for Supercomputing Applications Barbara S. Minsker, Ph.D. Associate Professor National Center for Supercomputing Applications and Department.
EGY BASICS The Electronic Geophysical Year,
IPY Data Management Mark A. Parsons co-chair IPY Data Policy and Management Subcommittee eGY Meeting Boulder, Colorado, USA 13 March 2006 World Data Center.
1 GRID Based Federated Digital Library K. Maly, M. Zubair, V. Chilukamarri, and P. Kothari Department of Computer Science Old Dominion University February,
Cyberinfrastructure What is it? Russ Hobby Internet2 Joint Techs, 18 July 2007.
IPY Education and Outreach 21 July 2005 The eGY Opportunity: Education and Outreach Emily CoBabe-Ammann eGY_Team.
GRID Overview Internet2 Member Meeting Spring 2003 Sandra Redman Information Technology and Systems Center and Information Technology Research Center National.
Introduction to the Electronic Geophysical Year, INFSO-eGY meeting, 14 September 2006, Brussels Charles BartonAlan Rodger Mauro MesserottiEliot.
The International Science Year Programs - eGY, IPY, IHY, Planet Earth - and GEOSS AOGS-3, Singapore, 10 July 2006
NOAA Report WGISS 19 Climate and Meteorology Status Glenn K. Rutledge NOAA Cordoba, Argentina March 7,2005.
EGY General Meeting report The Electronic Geophysical Year,
NOAA Report David Clark NOAA/NESDIS/NGDC CEOS/WGISS 18 Beijing, China September 9, 2004.
The eGY Legacy: A framework for e-Discovery and e-Access (eDeA) to Scientific Data Vladimir Papitashvili, AOSS, University of Michigan The eGY General.
The Electronic Geophysical Year, an e-Geoscience Opportunity” David Clark CEOS/WGISS – 21 Budapest, Hungary May 11, 2006.
OOI-CYBERINFRASTRUCTURE OOI Cyberinfrastructure Education and Public Awareness Plan Cyberinfrastructure Design Workshop October 17-19, 2007 University.
The Electronic Geophysical Year (eGY) D.N. Baker, C. Barton, B. Fraser, V. Papitashvili, A. Rodger, B. Thompson, J.H. Allen, B. Arora, D. Kerridge,
Cyberinfrastructure Overview Russ Hobby, Internet2 ECSU CI Days 4 January 2008.
EGY The Electronic Geophysical Year Generic Power Point slides for use by eGY participants in developing presentations
Introduction to the VO ESAVO ESA/ESAC – Madrid, Spain.
EGY Meeting March Page 1 NASA's Space Science (mostly Heliophysics) Virtual Observatories and Informatics D. A. Roberts C. P. Holmes J. H.
World Data Centers David Clark Assistant Secretary, WDC Panel eGY Steering Committee Meeting Boulder, Colorado Feb 14, 2005.
ICSU- Strengthening international science for the benefit of society Carthage Smith Deputy Executive Director.
The NOAA Operational Model Archive and Distribution System NOMADS CEOS-Grid Application Status Report Glenn K. Rutledge NOAA NCDC CEOS WGISS-19 Cordoba,
CEOS Working Group on Information System and Services (WGISS) Data Access Infrastructure and Interoperability Standards Andrew Mitchell - NASA Goddard.
Accessing the VI-SEEM infrastructure
Russian Academy of Sciences
eGY - the Electronic Geophysical Year,
Geospatial Data Use and sharing Concepts
WGISS Connected Data Assets Oct 24, 2018 Yonsook Enloe
eGY Planning Meeting Boulder, February 2005
The Electronic Geophysical Year (eGY)
Presentation transcript:

Page 1 of European Geosciences Union Assembly Session US5: The International Polar Year April 27, 2005Vienna, Austria Vladimir Papitashvili, Daniel Baker, Charles Barton, William Peterson, and the eGY Team e-Science for Geoscience: Preparing for the International Polar Year ( ) with the “Electronic Geophysical Year” Initiative

Page 2 of 18 IGY Legacies: Allowed scientists from different countries to participate in global observations of geophysical phenomena using similar instruments and data processing methodologies Gathered unprecedented volume of geophysical data from around the World Launched first Earth artificial satellites and established the World Data Center System Our Motivation: An overwhelming success of the International Geophysical Year,

Page 3 of 18 International Year of Planet Earth, 2007: International Union of Geosciences is leading the Planet Earth Program. Sponsored by the UN and UNESCO, this program will be interpreting Earth’s history as a basis for forecasting likely future events. International Heliophysical Year, 2007: IHY, endorsed by a number of international scientific organizations, is a grass-root effort with the goals of fostering international cooperation in the study of Universal Physical Processes across the Solar System, and preserving the history of the IGY. International Polar Year, 2007 – 2008: IPY is sponsored by ICSU and WMO, and it will expand understanding of the key roles of the polar regions in the globally-linked environment. Electronic Geophysical Year, 2007 – 2008: Sponsored by the International Union of Geodesy and Geophysics and endorsed by ICSU, the e GY is to promote a revolution in geoscientific data availability and access worldwide. This coordinated international initiative will make full use of the capabilities offered by the Internet and Web-based information management and digital communications. People Reaction: IGY + 50 Planning New International Years

Page 4 of 18 Data Collection Paradigm since IGY: To get scientific data from various, mostly physically distributed sources, a scientist had to: Ever Increasing Requirements: Geospace and Earth Systems Science Higher resolution in space and time Assimilation into models 5.Finally, do some real science with the collected data! 4.Process collected data using mostly proprietary codes, run models… and then… 3.Then ingest retrieved data into a personal (local) database… 2.Get data via snail-mail and air-mail, but only recently via and World Wide Web… 1.Search through a number of World Data Centers, various research institutions, physical observatories, contact colleagues...

Page 5 of 18 Current Paradigm of Sharing Geoscience Data: Data Must be Submitted to Data Centers Require continuous support for the data acquisition, storage, and distribution Submission of data remains voluntary Collected data are often not suitable for submission; e.g., the WDCs only accept absolute geomagnetic measurements “Push Data” Concept Centralized distribution schemes – World Data Centers System (WDC,  ): Courtesy of the RAND Corporation

Page 6 of 18 A New Paradigm: Sharing Distributed Geoscience Data via Virtual Observatories Now Deployed in Cyberspace Publishing and sharing geoscience data through World Wide Web: Allows to avoid additional steps in data preparation for submission to WDCs - to where data are now pulled from providers Data providers achieve greater visibility amongst scientific and user communities A Grid (or Fabric) of interconnected data nodes is a new vision of distributed, self- populating data repositories and centers World Data Centers  become an integral and important part of the World Wide Data Fabric, serving as “clearing houses” for preserving data permanently in the Fabric “Pull Data” Concept Courtesy of the RAND Corporation

Page 7 of 18 Main Elements of a Virtual Observatory Distributed data bases are accessed through the World Wide Web Data Portals and VO nodes Data Visualization Format Conversion Data Acquisition Location Discovery This is a basic concept of the Electronic Geophysical Year initiative we offer to IPY, IHY, IYPE, and World Data Centers

Page 8 of 18 The proposed IPYVO.NET is a middleware that provides a new way for the worldwide polar communities to share data and functionality in a platform-independent and location-neutral environment Design Goals Identify prospective IPY data repositories and provide transparent access to the remote databases through the common interface(s) - data portals Perform online acquisition and processing of remote datasets and construct self-populated databases on the portal(s) and individual user nodes These self-populating databases can then be made easily available to other users through future requests, thus building Data GRID-type (Data Fabric) access and computing International Polar Year Virtual Observatories Network

Page 9 of 18 A four-tier architecture of the proposed IPYVO.NET LOCATION DISCOVERY Web Crawler Data Acquisition via World Wide Web and Internet DATA ACQUISITION via FTP, SSL, XML, HTTP, OPeNDAP… FORMAT CONVERSION (A2F) International Polar Year Virtual Observatories Network (cont’d) Flat File Manager IDL MATLAB Simulink Integrated Visualization Layer Highest Level of Data Analysis “ASCII to Flat File Format” for ingestion of downloaded data into the Web-based Portal or GRID-node databases Lowest layer - Location Discovery Module

Page 10 of 18 VGMO: Virtual Global Magnetic Observatory An IPYVO.NET Prototype with Architecture Unleashed Web-based Portal – runs at the Web site  A secure, scalable, platform independent, and user-friendly software framework for remote access to the VGMO Flat File Manager  The Flat File Manager Client is written to a Java 2 platform that requires a Java Web Start (Java Network Launching Protocol) Standalone Self-Populating Data Node – get from  An alternate version to create, manage, and populate local geomagnetic databases from INTERNET; aims on building geomagnetic GRID access and computing

Page 11 of 18 VGMO.NET: Lookup Tables and Java Interfaces AOSS, University of Michigan Remote Site Info Format Info Conversion Pointer ftp.iki.rssi.ru--- ftp.abs.xyz.edu---. Remote Site InfoFormat Information Conver- sion Pointer ftp.dmi.dk /pub/wdcc1/obsdata/ 1minval/ YYYY/ dmi.exe ftp.ngdc. noaa.gov /STP/GEOMAGNETIC_DA TA/ONE_ MINUTE_VALUES/YYYY/ ngdc.exe …………………………………………………………………… Prospective Sites Geo Magnetic Crawler (GeoMaC) A2F - Any Format to Flat File Conversion Module FFMN Flat File Manager INTERNET Active Sites

Page 12 of 18  Climatology model for designing satellites  Nowcasts/forecasts that provide situational awareness for satellite operators  Long term archives of simulated and observed data for testing scientific theory User Interface and Displays Near Real Time Data Long Term Archival Data Gateway to distributed data Climatology Models Nowcast/ Forecast Models GOES POES POES CISM End-to-End Models Assimilation of Extreme-Event Data VRBO: Virtual Radiation Belt Observatory Another Example of the VO Architecture Data system that meets engineering, operational, and scientific needs for: LASP U. Colorado

Page 13 of 18 eGY Objectives oEmbrace and extend the IGY principles of data sharing and scientific involvement oMake existing and newly accrued datasets available – “free access to all” oDigitize or convert to digital images analog geoscience records making these data available electronically oDevelop a World Wide System of Virtual Geoscience and Geospace Observatories The eGY charter sets out the principles of geoscience data stewardship for accomplishing a 21 st Century vision of an “Information Society”, in which all of humanity may share the benefits of free and open access to data and information. These principles are enunciated here in a geoscience context, but are applicable across all of the sciences and beyond.

Page 14 of 18 eGY Characteristics  Timeliness: Virtual Observatories middleware is becoming widely available  Interdisciplinary: Data sharing and data accessibility are common issues in all fields of geosciences  Affordable: Simple networking technology  Cost Effective: More/better science for money  Inclusive: Opportunities for developed and developing countries  Capacity Building: Provides relevant research experience for young scientists  Complementary to IPY, IHY, IYPE, and other international initiatives like CAWSES, ILWS, etc.

Page 15 of 18 International Bodies: AOGS CODATA FAGS ICSU IUGG IAGA IUGS/IYPE PAA Data & Information SCOSTEP / CAWSES SCAR / IPY SEG WDC Panel … eGY Participants and Potential Components Virtual Observatories ASTROGRID Virtual Observatory NVO – US National Astronomy Virtual Observatory VCSO – Virtual Carbon Cycle Observatory VGMO – Virtual Global Magnetic Observatory VHO – Virtual Heliophysical Observatory VRBO – Virtual Radiation Belt Observatory VMSO – Virtual Magnetospheric Observatory VOO - Virtual Ocean Observatory VSN – Virtual Seismic Network VSO – Virtual Solar Observatory National Organizations Australia – ANU, UNSW Canada – SSDP Russia – IZMIRAN UK - BAS USA: AGU Augsburg College NASA / IHY NOAA / NGDC NOAA / SEC NSF / NCAR U. Colorado - LASP U. Michigan – AOSS …

Page 16 of 18 eGY Timeline 2003 July: IUGG General Assembly, Sapporo, endorsed eGY December: eGY planning discussion at AGU 2004 March: Paper describing eGY published in Eos April – May: Presentations at EGU and AGU July: eGY at IAGA Executive Meeting (Paris) September: eGY at IUGG Executive Meeting (Boulder) Web site: February: eGY Planning Workshop (Boulder) April – May: Presentations at EGU and AGU 2005 – 2006 eGY Presentations at various IUGG Associations assemblies and other international conferences 2007 – 2008 eGY coordinates networks of Virtual Observatories for CAWSES, ICESTAR, IHY, and IPY (?)

Page 17 of 18 What does eGY mean for me? How do I get involved? Data Integration and Knowledge Discovery  With the microprocessors, software, and Internet of today – access to scientific data has become effectively infinite and instantaneous  The challenges for the future go beyond the data access but towards the objective integration of distributed data based on user- defined criteria to discover new knowledge  This knowledge facilitates meaningful interpretations and decision- making for the benefit society at global to local scales Virtual Observatories  Stimulate, facilitate, and promote the establishment of Virtual Observatories in Geosciences - and for IPY ?  Promote sharing of the VO “know-how” and standards, inform the science (IPY) community, funding agencies, students, and the public about available Virtual Observatories  Use as a portal - to IPYVO.NET ?

Page 18 of 18 oThe eGY is an “umbrella” initiative which envisions the massive deployment of Virtual Geoscience Observatories in cyberspace oThe eGY major themes: - data access and release - data discovery - data preservation and rescue - common data standards and interoperability + capacity building and outreach oThe eGY promotes the “Pull Data” concept as illustrated here by the proposed IPYVO.NET oThe eGY offers a forum to discuss, evaluate, and promote all of the various VO concepts including IPYVO.NET oThe eGY invites the IPY and other geoscience communities to join in making international and interdisciplinary data exchange easier using the Virtual Observatories concept Summary: How is eGY going to help me and my science?