Australian Bureau of Meteorology Station Metadata “SitesDb” Karl Monnik Technical & Field Support Observations & Engineering Program.

Slides:



Advertisements
Similar presentations
Drybridge Consulting Party Identification Directory Installing the Microsoft Research Service IDEAlliance and Drybridge Consulting – collaborating to deliver.
Advertisements

STIWG Meeting Austin Texas May 7, 2014 Brian Reece Richard Pardee
Condition Monitoring Roles in Asset Reliability and Regulatory Compliance Dave Haerle, Los Angeles Department of Water and Power Scott Kunze, DataSplice.
Accel Computerized Maintenance Management System.
DIGIDOC A web based tool to Manage Documents. System Overview DigiDoc is a web-based customizable, integrated solution for Business Process Management.
Information Resources Management January 23, 2001.
Chapter 2. Slide 1 CULTURAL SUBJECT GATEWAYS CULTURAL SUBJECT GATEWAYS Subject Gateways  Started as links of lists  Continued as Web directories  Culminated.
Dr Gordon Russell, Napier University Unit Data Dictionary 1 Data Dictionary Unit 5.3.
Managing Data Resources
Oct 31, 2000Database Management -- Fall R. Larson Database Management: Introduction to Terms and Concepts University of California, Berkeley School.
Database Management An Introduction.
Organizing Data Chapter 5. Data Hierachy Table = Entities X Attributes Entities = Records Attributes = Fields.
Managing Data Resources. File Organization Terms and Concepts Bit: Smallest unit of data; binary digit (0,1) Byte: Group of bits that represents a single.
Complete Weekly Timesheets Select work. Add hours and comments Tell Mgr if ETC=0 and need more time. Tell Mgr if using someone else’s ETC. End week, change.
Structure Commander Technical Presentation. Copyright (C) MCS 2013, All rights reserved. 2 STRUCTURE COMMANDER Introduction Product Overview.
CERN – European Laboratory for Particle Physics Administrative Information Services Implementing Oracle Workflow Derek Mathieson CERN - Switzerland.
Tango Asset Management Capabilities Presentation 1.Desktop & Web Architecture 2.Equipment Management 3.Condition Management 4.Data Mining 5.Parameter Trending.
MDC Open Information Model West Virginia University CS486 Presentation Feb 18, 2000 Lijian Liu (OIM:
ViciDocs for BPO Companies Creating Info repositories from documents.
Process, Tools, Evaluation
Systems Analysis – Analyzing Requirements.  Analyzing requirement stage identifies user information needs and new systems requirements  IS dev team.
Computers & Employment By Andrew Attard and Stephen Calleja.
Term 2, 2011 Week 3. CONTENTS The physical design of a network Network diagrams People who develop and support networks Developing a network Supporting.
Copyright © 2003 by Prentice Hall Module 4 Database Management Systems 1.What is a database? Data hierarchy and data organization Field, record, file,
The Utilization of GIS Technology at Northeastern REMC Presented By: Steven Weber, GISP Northeastern REMC (260)
Configuration Management T3 Webinar Feb 21, 2008 Chuck Larsen ITS Program Coordinator Oregon Department of Transportation.
BoM data and visualisation assets February Overview Introduction Linked Data Hydrologic Reference Stations WDTF Visualisation Tool Water Storages.
Eric Westfall – Indiana University Jeremy Hanson – Iowa State University Building Applications with the KNS.
MEDARE Workshop, Tarragona, Spain Rescue and Digitization of Climate Records of Cyprus 28 – 30 November 2007 Stelios Pashiardis Meteorological Service.
Objectives Overview Identify the qualities of valuable information Describe various information systems used in an enterprise Identify the components of.
1 Adapted from Pearson Prentice Hall Adapted form James A. Senn’s Information Technology, 3 rd Edition Chapter 7 Enterprise Databases and Data Warehouses.
6 Chapter Databases and Information Management. File Organization Terms and Concepts Bit: Smallest unit of data; binary digit (0,1) Byte: Group of bits.
I Information Systems Technology Ross Malaga 4 "Part I Understanding Information Systems Technology" Copyright © 2005 Prentice Hall, Inc. 4-1 DATABASE.
Real-time Observation Monitoring and Analysis Network Haihe LIANG, etc. TECO-2008.
Professor Michael J. Losacco CIS 1110 – Using Computers Database Management Chapter 9.
Building Applications with the KNS. The History of the KNS KFS spent a large amount of development time up front, using the best talent from each of the.
1 Schema Registries Steven Hughes, Lou Reich, Dan Crichton NASA 21 October 2015.
C6 Databases. 2 Traditional file environment Data Redundancy and Inconsistency: –Data redundancy: The presence of duplicate data in multiple data files.
5 - 1 Copyright © 2006, The McGraw-Hill Companies, Inc. All rights reserved.
Dashboard: has been completely overhauled – View your completion status, number of total records, and the latest Crop Monitor at a glance – Help files.
Guidelines to Port Meteorological Officers By S P Joshi Assistant Meteorologist.
Management Information Systems, 4 th Edition 1 Chapter 8 Data and Knowledge Management.
Database Concepts Track 3: Managing Information using Database.
Building Dashboards SharePoint and Business Intelligence.
Review of Meteorological Data Sharing Project in China Anyuan XIONG (National Meteorological Information Center, CMA, CHINA)
LEADS/EMS DATA VALIDATION IPS MeteoStar December 11, 2006 WHAT IS VALIDATION? From The Dictionary: 1a. To Make Legally Valid 1b. To Grant Official.
Best of Breed Project Two goals: –Compare a wide variety of HRIS products –Collect and share this information in a database Each individual will collect.
NIWA Water Resources Archive and Climate Database - An Overview David Wratt & Charles Pearson.
© Crown copyright Met Office Upgrading VOS to VOSClim Sarah North.
Accounting Events.
The Research Data Archive at NCAR: A System Designed to Handle Diverse Datasets Bob Dattore and Steven Worley National Center for Atmospheric Research.
State of Georgia Release Management Training
1 Copyright © 2008, Oracle. All rights reserved. Repository Basics.
1 One-stop shopping for time series data David Williams (London), Thomas Araujo (Houston) & Stuart Reed (London)
Managing Data Resources File Organization and databases for business information systems.
ICAO Seminar on Aeronautical spectrum management (Cairo, 7 – 17 June 2006) SAFIRE Spectrum and Frequency Information Resource (presented by Eurocontrol)
DBMS & TPS Barbara Russell MBA 624.
Chapter 2: Database System Concepts and Architecture - Outline
Appendix – Integration with Assets, Locations, and Organizations
TPF-5(181) Research Management Database Business Analysis
Basic Concepts in Data Management
ICAO Seminar on Aeronautical spectrum management (Cairo, 7 – 17 June 2006) SAFIRE Spectrum and Frequency Information Resource (presented by Eurocontrol)
Database.
Database Environment Transparencies
MANAGING DATA RESOURCES
LO2 - Be Able to Design IT Systems to Meet Business Needs
Overview of Oracle Site Hub
AWS Network Requirements Analysis and Network Planning
Robert Dattore and Steven Worley
Presentation transcript:

Australian Bureau of Meteorology Station Metadata “SitesDb” Karl Monnik Technical & Field Support Observations & Engineering Program

What is SitesDb ? The Bureau’s Corporate Database of Site Specific Information (Metadata). Lat, Long, Name, Environment, Photos, Identifiers … etc Equip type/make, S/N, Replacements, Last check, Faults … etc What SitesDb provides Network Definitions and Structures – eg Basic Observing System hierarchy Network Costing – eg Cooperative Observer funds management Network Performance – eg AWS, EFB, Upper Air performance Auditing Information – location and history of major equipment assets Fault Reporting & Notification – web and integration Maintenance Management - Maintenance Scheduling, Configuration info etc. Quality Monitoring – eg performance checks, inspection & maintenance frequency Asset Management – eg Age Profiles etc.

Why was it developed? Bureau’s corporate repository of station specific metadata and directly supports a variety of station and network management processes. Developed out of necessity - number of disparate sources of station information - paper files, databases, spreadsheets, diaries, knowledge held by individuals, etc Operational since 1997 – integrated into the Bureau’s daily operations and underpins management reporting and strategy. Integral part of the Bureau’s Data Management and end-to-end information flow. Not just historical station metadata - many station and network management functions.

SitesDb Project Objectives Provide an accurate and unified database of current and historical information (metadata) relating to Bureau Observation Sites. Directly support the Climate Archive and assist with Observations, Engineering and Hydrology program functions. Provide an accurate source of data from which other systems can update common information (AIFS dictionaries etc). Replace many of the functions of paper Station Files, (registration of new stations, station inspections etc.) Integrate information across: Station details Equipment Observation program Satisfy both operational needs and historical record keeping

Oracle Database What are the SitesDb System Components ? Facts Table Approx 200 users maintaining data Approx 200K entries last 12 months Storing 60K documents (objects) 30K to 60K hits per month Access to over 150 dynamic reports Many forums - help /discuss /resolve Client Server Front End Tools Maintain WEB Server Oracle Application Server Forums Discuss / Resolve Browse SitesDb Web Browser Report Query Store

How is SitesDb Used ? SitesDb Maintain Data (200) Observations Engineering Hydrology Specialist HO users Front End Tools ADAM Climate Archive Station Details Obs / Eng Marine & Hydro Programs Network Management Fault Reporting Annual Reports International Reports Audits Performance Indicators Planning Quality Control Spares Management Annual Stationery Climate Products Metadata Station History Sensor Types/Replacements Performance Checks Faults Climate data Data Records CMSS CMSS Monitoring AWS Reporting Research Activities Hydro Met & BMRC Rainfall Ground truth Radar Metadata NMOC Dictionary Australian Stations Regional AIFS International Stations Financial & Asset Manage Reference Info to assist FMS Financial and Asset Reports OTHER Databases ROCS etc

Initial interface

SitesDB Basic Structure Station Details Systems Equipment Equip_type Sub-Equip Perf Check ActionsProgramsComms Contacts Comments Stationery Actions Objects Inspections

SitesDb Table Relationships

Station details

Station objects/image

Station siting

SitesDb components

Parent & child relationship Hierarchical relationship where the child equipment requires any parent equipment to operate.

Equipment and sub-equipment Equipment sub- equipment describes components of equipment based on four requirements; 1. Fault reporting 2. Configuration management 3. Equipment tracking 4. Spares management Sub-equipment moves with equipment.

SitesDb components Field Performance checks

16/02/ INSTALL - (bbeggs) Barometer (Type Kew pattern mercury S/N ) Surface Observations 16/02/ INSTALL - (bbeggs) Barometer (Type Kew pattern mercury S/N ) Surface Observations 07/05/ INSTALL - (akn) Barometer (Type Vaisala PA11A S/N ) Surface Observations 01/07/ REMOVE - (bbeggs) Barometer (Type Kew pattern mercury S/N ) Surface Observations 01/12/ REMOVE - (bbeggs) Barometer (Type Kew pattern mercury S/N ) Surface Observations 16/12/ REMOVE - (akn) Barometer (Type Vaisala PA11A S/N ) Surface Observations 17/12/ INSTALL - (akn) Barometer (Type Vaisala PTB220B S/N - W ) Surface Observations System & Equipment

Inspections record

What is an Action? An ‘Action’ is anything that is either done or requires doing at the station. (including investigation of questionable data) It is attributed to either the Station or to a specific piece of equipment. It is cleared once completed. A significant amount of information (metadata) is entered on clearing. This detail is historically stored & able to be queried. Actions are ended when an ‘end-date’ is entered

Actions Entered/Registered by officers with Data Entry Privileges only.

Actions

Comments

Keeping SitesDb updated: Typical Technician Workflow

How does SitesDb assist Climate? Sources of inhomogeneity: 1. Changes in location 2. Changes in instrumentation 3. Changes in exposure or environment 4. Changes in observation practice 5. Changes in data processing All are recorded in SitesDb

Conclusion Station metadata – broad range of operational information Historical record of all aspects of station environment & equipment Combines disparate sources of information Provides tools for managers and staff to manage daily program, prioritise, record, report