Best Practices NMFS EDM June 18, 2013M. Brady. Context June 18, 2013M. Brady.

Slides:



Advertisements
Similar presentations
Test Design and Documentation. Test Design Test design is to ensure that all requirements are met through a series of test procedures, increasing the.
Advertisements

Overview of IS Controls, Auditing, and Security Fall 2005.
Modeling the Process and Life Cycle CSCI 411 Advanced Database and Project Management Monday, February 2, 2015.
Describing Process Specifications and Structured Decisions Systems Analysis and Design, 7e Kendall & Kendall 9 © 2008 Pearson Prentice Hall.
Konstanz, Jens Gerken ZuiScat An Overview of data quality problems and data cleaning solution approaches Data Cleaning Seminarvortrag: Digital.
System integrity The term system integrity has the following meanings: That condition of a system where in its specified operational and technical parameters.
Dr Gordon Russell, Napier University Unit Data Dictionary 1 Data Dictionary Unit 5.3.
1 The IIPC Web Curator Tool: Steve Knight The National Library of New Zealand Philip Beresford and Arun Persad The British Library An Open Source Solution.
Copyright © 2011 Pearson Education, Inc. Publishing as Prentice Hall Process Specifications and Structured Decisions Systems Analysis and Design, 8e Kendall.
Chapter 3 Database Management
Agenda Overview Why TransCAD Challenges/tips Initiatives Applications.
Databases and Processing Modes. Fundamental Data Storage Concepts and Definitions What is an entity? An entity is something about which information is.
Database Design Concepts INFO1408 Term 2 week 1 Data validation and Referential integrity.
Chapter 3: Data Modeling
Supplement 02CASE Tools1 Supplement 02 - Case Tools And Franchise Colleges By MANSHA NAWAZ.
With Microsoft Access 2010 © 2011 Pearson Education, Inc. Publishing as Prentice Hall1 PowerPoint Presentation to Accompany GO! with Microsoft ® Access.
Implementation. We we came from… Planning Analysis Design Implementation Identify Problem/Value. Feasibility Analysis. Project Management. Understand.
1 Assuring the Quality of your COSF Data. 2 What factors work to improve the quality of your data? What factors work to lessen the quality of your data?
Professor Michael J. Losacco CIS 1150 – Introduction to Computer Information Systems Databases Chapter 11.
Vulnerability Assessments
Trns*port Data Model Unification Joe Pugh Virginia Department of Transportation Peggy Leight Info Tech Inc 11/06/05.
Equivalence Class Testing
Chapter © 2012 Pearson Education, Inc. Publishing as Prentice Hall.
Microsoft Access II Information Technology Services User Services User Training & Support.
Databases. Objectives Define what a database is. Understand the difference between a flat and relational database Design and create a relational database.
Chapter 5 UNDERSTANDING AND DESIGNING ACCOUNTING DATA.
Entity Relationship Diagram Farrokh Alemi Ph.D. Francesco Loaiza, Ph.D. J.D. Vikas Arya.
Relational Database Need to Knows. What is a database? Data - is just a pile of numbers or stats. A business "organises" the data to be meaningful and.
Topics Covered: Data preparation Data preparation Data capturing Data capturing Data verification and validation Data verification and validation Data.
Microsoft Access 2000 Creating Tables and Relationships.
GCSE Computing: A451 Computer Systems & Programming Relational Databases Databases.
CHAPTER 8: MANAGING DATA RESOURCES. File Organization Terms Field: group of characters that represent something Record: group of related fields File:
Discussion of the main data management or database building issues that may be involved in the early stages of designing a new multicentre, clinical trial.
QA/QC and QUALIFIERS LOU ANN FISHER CITY OF STILLWATER, OK
System Analysis and Design
Data entry: Validation
Describing Process Specifications and Structured Decisions Systems Analysis and Design, 7e Kendall & Kendall 9 © 2008 Pearson Prentice Hall.
Moving into Implementation SYSTEMS ANALYSIS AND DESIGN, 6 TH EDITION DENNIS, WIXOM, AND ROTH © 2015 JOHN WILEY & SONS. ALL RIGHTS RESERVED.Roberta M. Roth.
Module 6. Data Management Plans  Definitions ◦ Quality assurance ◦ Quality control ◦ Data contamination ◦ Error Types ◦ Error Handling  QA/QC best practices.
MIS 327 Database Management system 1 MIS 327: DBMS Dr. Monther Tarawneh Dr. Monther Tarawneh Week 2: Basic Concepts.
Setting the scene World Resources Institute Overview of Registries Concepts, Lessons, and Guiding Design Principles Presented by: Pankaj Bhatia, Director,
Enhancing Forms with OLE Fields, Hyperlinks, and Subforms – Project 5.
FILES AND DATABASES. A FILE is a collection of records with similar characteristics, e.g: A Sales Ledger Stock Records A Price List Customer Records Files.
Controls design Controls are “the plan of organization and all the methods and measures to safeguard its assets, check the accuracy and reliability of.
Pilot Census in Poland Some Quality Aspects Geneva, 7-9 July 2010 Janusz Dygaszewicz Central Statistical Office POLAND.
Database Management Systems (DBMS)
Lesson 4.  After a table has been created, you may need to modify it. You can make many changes to a table—or other database object—using its property.
Flat Files Relational Databases
Automated Testing on Agile Teams Aimee DeWitt Tina Lockwood.
1 Experience from Studies of Software Maintenance and Evolution Parastoo Mohagheghi Post doc, NTNU-IDI SEVO Seminar, 16 March 2006.
Session 1 Module 1: Introduction to Data Integrity
© 2003 Prentice Hall, Inc.3-1 Chapter 3 Database Management Information Systems Today Leonard Jessup and Joseph Valacich.
Copyright (c) 2014 Pearson Education, Inc. Introduction to DBMS.
24 Nov 2007Data Management and Exploratory Data Analysis 1 Yongyuth Chaiyapong Ph.D. (Mathematical Statistics) Department of Statistics Faculty of Science.
Advances In Software Inspection
Description and exemplification use of a Data Dictionary. A data dictionary is a catalogue of all data items in a system. The data dictionary stores details.
Information Resource Stewardship A suggested approach for managing the critical information assets of the organization.
SWRCBSWRCBSWRCBSWRCB AB2886 Implementation San Jose Training San Jose Training July 30, 2001 Marilyn R. Arsenault ArsenaultLegg, Inc.
Instance Discovery and Schema Matching With Applications to Biological Deep Web Data Integration Tantan Liu, Fan Wang, Gagan Agrawal {liut, wangfa,
Copyright © 2011 Pearson Education Process Specifications and Structured Decisions Systems Analysis and Design, 8e Kendall & Kendall Global Edition 9.
SQL Basics Review Reviewing what we’ve learned so far…….
Modern Systems Analysis and Design Third Edition
Microsoft Office Access 2010 Lab 2
ICT Database Lesson 1 What is a Database?.
مدیریت داده ها و اطلاعات آزمایشگاه پزشکی
Modern Systems Analysis and Design Third Edition
Relational Database Model
Modern Systems Analysis and Design Third Edition
OBSERVER DATA MANAGEMENT PRINCIPLES AND BEST PRACTICE (Agenda Item 4)
Database Design Chapter 7.
Presentation transcript:

Best Practices NMFS EDM June 18, 2013M. Brady

Context June 18, 2013M. Brady

EDM Scope June 18, 2013M. Brady

EDM Goals Capability Speed Efficiency Accuracy Confidence June 18, 2013M. Brady

Best Practice Concepts Integration & Consistency – All parts have to work together. Access – Data only has value if you can get to it. Understanding – Data only has value if you understand it. QA/QC – It’s only worth something if it’s right. Design & Modernization (other than integration) – Everything works better with a great design. June 18, 2013M. Brady

Integration & Consistency Controlled vocabularies Proper use of database keys Design of super-systems precedes subsystems All observations of a single event share a single report (e.g. multistream fishing reporting) June 18, 2013M. Brady

Integration & Consistency Data collection – Eliminate redundant reporting – Don’t collect data unless used – Automation: reduction of human data entry or processing eliminates errors and speeds the process June 18, 2013M. Brady

Integration & Consistency Data collection – Better ergonomics Prefill electronic forms Provide only appropriate choices. Reject initial invalid entries. Provide immediate feedback for invalid entries. Accept, quarantine, and report all persistent invalid entries. June 18, 2013M. Brady

Integration & Consistency Consistency between regulations and data (e.g. trip definitions by regulation are not the same as by VMS) Use a master data store. – Data is discoverable – Repeatable and consistent analyses – System is carefully designed and data Qced. Use calibration factors when combining data into a meta-analysis. June 18, 2013M. Brady

Integration & Consistency Standardize use of data types – Dates – Numeric vs. strings June 18, 2013M. Brady

Access Permissions – All NOAA Analysts & Managers should have read access to all fisheries data. Discoverable – Metadata – Controlled vocabularies – Master data store – Effective search engines June 18, 2013M. Brady

Access Protection – Security – Archiving June 18, 2013M. Brady

QA/QC All detected errors must be corrected! Automatically check all records for validity. Automatically detect duplicates. Automatically check for orphans in potentially integrated data. Other errors are primarily human detectable – Provide immediately accessible reporting mechanism (suggestion box) – Follow up assurance mechanism June 18, 2013M. Brady

Understanding Documentation – Description of process – Down to the columns Streamline processes (see Design) June 18, 2013M. Brady

Design Use state of the art communication systems at sea or buffer data and transmit from shore. Single use columns in tables – avoid kludgy codings June 18, 2013M. Brady

Design For bulk data, such as acoustic, store data on a server and provide analysis service at the same location. This allows collaboration of multiple investigators on a shared data set. Streamline processes - use the simplest possible design. Automate repetitive analyses June 18, 2013M. Brady