Download presentation
Presentation is loading. Please wait.
1
ArcGIS Data Reviewer: An Introduction
Jay Cary and Chandan Banerjee
2
Workshop Agenda Importance of Data Quality
What is ArcGIS Data Reviewer Automated Review Visual Review Managing Errors and Reporting Data Quality Summary/Resources ArcGIS Data Reviewer: An Introduction
3
Importance of data quality
ArcGIS Data Reviewer: An Introduction
4
Defining quality Executive Confidently make decisions
A business perspective Executive Confidently make decisions Reduce financial risk Optimize organizational performance ArcGIS Data Reviewer: An Introduction
5
Defining quality Executive Manager Confidently make decisions
A business perspective Executive Confidently make decisions Reduce financial risk Optimize organizational performance Manager Effective data stewardship Drive increased usage Maximize productivity ArcGIS Data Reviewer: An Introduction
6
Defining quality Executive Manager Knowledge worker
A business perspective Executive Confidently make decisions Reduce financial risk Optimize organizational performance Manager Effective data stewardship Drive increased usage Maximize productivity Knowledge worker Increased efficiencies Confidence in GIS ArcGIS Data Reviewer: An Introduction
7
ISO-19157:2013 Geographic Information – Data Quality
Defining Quality A Technical Perspective Spatial Accuracy Thematic Accuracy Completeness Logical Consistency Temporal Quality Usability ISO-19157:2013 Geographic Information – Data Quality ArcGIS Data Reviewer: An Introduction
8
What is ArcGIS Data Reviewer?
Data Quality Management for ArcGIS Provides Rule-based validation Interactive tools Track errors For individuals and enterprise Saves time/money Less rework For multiple domains Configurable Extendable Enterprise Workflow Validate Review Summarize ArcGIS Data Reviewer: An Introduction
9
Managing Quality Control
Visual Review Quality Control Processes Automated Review Quality Reporting Reviewer Results ArcGIS Data Reviewer: An Introduction
10
Types of quality control
Fast Consistent and repeatable Objective 100% coverage Automated review ArcGIS Data Reviewer: An Introduction
11
Types of quality control
Fast Consistent and repeatable Objective 100% coverage Automated review Visual review As subjective as needed Better for finding patterns and missing elements ArcGIS Data Reviewer: An Introduction
12
Automated Review ArcGIS Data Reviewer: An Introduction
13
Managing Quality Control
Visual Review Quality Control Processes Automated Review Quality Reporting Reviewer Results ArcGIS Data Reviewer: An Introduction
14
Industry standards / Specifications
Defining Quality Sources of data quality requirements Industry standards / Specifications ArcGIS Data Reviewer: An Introduction
15
Defining Quality Sources of data quality requirements
Industry standards / Specifications Subject matter experts ArcGIS Data Reviewer: An Introduction
16
Defining Quality Sources of data quality requirements
Industry standards / Specifications Subject matter experts Training and experience ArcGIS Data Reviewer: An Introduction
17
Defining Quality Sources of data quality requirements
Industry standards / Specifications Subject matter experts Training and experience Quality assurance plans ArcGIS Data Reviewer: An Introduction
18
Automating Data Validation
Implementing quality requirements 40+ configurable checks Attribute Feature and table values Spatial Spatial relationships Feature integrity Collection rules Metadata Completeness/Content ArcGIS Data Reviewer: An Introduction
19
Demo: Getting Started with Automated Review
ArcGIS Data Reviewer for Desktop Demo: Getting Started with Automated Review ArcGIS Data Reviewer: An Introduction
20
Demo Scenario Department plans to use student interns with field data collection devices to map road- related features (signs, street furniture). Business Requirement Features should be positionally accurate based on siting criteria Key attributes are populated and have the correct values All features should be collected within the survey area ArcGIS Data Reviewer: An Introduction
21
Authoring Data Quality Rules
ArcGIS Data Reviewer: An Introduction
22
Batch Validation Reviewer Batch Jobs Encapsulate QC model
Implementing Cumulative Review Industry standards / Specifications Subject matter experts Training and experience Quality assurance plans Reviewer Batch Jobs Encapsulate QC model Designed once and executed many times Complete specification check Configure as rule-based checks Build Reviewer Batch Job ArcGIS Data Reviewer: An Introduction
23
ArcGIS Resource Center
Leveraging Templates for QC Requirements Data Reviewer Templates for Address Management Electrical Utilities Roads & Highways Tax Parcel Editing Water Utilities Based on Esri industry models Use as Starting point ArcGIS Data Reviewer: An Introduction
24
Demo: Authoring Data Quality Rules ArcGIS for Desktop
ArcGIS Data Reviewer: An Introduction
25
Authoring Batch Jobs When authoring new checks
Tips and Tricks When authoring new checks Configure and execute from Reviewer Toolbar Leverage Mini-Browser to quickly assess results Try validating a pilot area first where known issues are located ArcGIS Data Reviewer: An Introduction
26
Executing Automated Validation
ArcGIS Data Reviewer: An Introduction
27
Methods for executing data validation
Execute data validation using ArcMap ArcGIS Data Reviewer: An Introduction
28
Methods for executing data validation
Execute data validation using ArcMap ArcGIS Pro Coming Soon ArcGIS Data Reviewer: An Introduction
29
Methods for executing data validation
Execute data validation using ArcMap ArcGIS Pro Model/Python script ArcGIS Data Reviewer: An Introduction
30
Methods for executing data validation
Execute data validation using ArcMap ArcGIS Pro Model/Python script ArcGIS Workflow Manager Updated ArcGIS Data Reviewer: An Introduction
31
Methods for executing data validation
Execute data validation using ArcMap ArcGIS Pro Model/Python script ArcGIS Workflow Manager ArcGIS for Server New App ArcGIS Data Reviewer: An Introduction
32
Demo: Executing Automated Validation ArcGIS for Desktop
ArcGIS Data Reviewer: An Introduction
33
Batch Validation Before data loading During editing
A Workflow Perspective Before data loading During editing Prior to publishing services/maps Prior to rolling-out new applications ArcGIS Data Reviewer: An Introduction
34
Visual Review ArcGIS Data Reviewer: An Introduction
35
Managing Quality Control
Visual Review Quality Control Processes Automated Review Quality Reporting Reviewer Results ArcGIS Data Reviewer: An Introduction
36
Automated vs visual review
Limitations of automated review Data must exist Not possible to detect all types of errors ArcGIS Data Reviewer: An Introduction
37
Value of Performing Visual Review
Discover Patterns Compare to trusted sources Find missing features ArcGIS Data Reviewer: An Introduction
38
Visual Review Tools supporting Selecting/browsing features
Leveraging ArcGIS for Desktop Tools supporting Selecting/browsing features Redlining missing features Flagging features in error Generating random samples Assessing positional accuracy Comparing GDB versions ArcGIS Data Reviewer: An Introduction
39
Visual Review Leveraging ArcGIS for Server Extending quality control workflows into other communities QC review across ArcGIS platform Simple to use tools for error identification Manual QC workflow “automation” ArcGIS Data Reviewer: An Introduction
40
Demo: Visual Data Review ArcGIS API for JavaScript
ArcGIS Data Reviewer: An Introduction
41
Reporting Quality ArcGIS Data Reviewer: An Introduction
42
Managing Quality Control
Visual Review Quality Control Processes Automated Review Quality Reporting Reviewer Results ArcGIS Data Reviewer: An Introduction
43
Data Quality Reporting
ArcGIS for Desktop Automated reporting of quality control results Available Reports Automated Check (Origin Table, Subtype, Check Group) Total Record Count Sampling ArcGIS Data Reviewer: An Introduction
44
Data Quality Reporting
ArcGIS for Server Enabling transparency in data quality Better decision making by communicating data quality across stakeholders Open quality reporting Shared across ArcGIS system Tools and methods to communicate quality ArcGIS Data Reviewer: An Introduction
45
Demo: Reporting Quality ArcGIS for Desktop
ArcGIS Data Reviewer: An Introduction
46
Scenario As a GIS manager, I need to manage the quality of the GIS database to ensure that it can support existing and new staff operations. Business Requirements Features should be positionally accurate based on siting criteria (95% accuracy) Key attributes are populated and have the correct values (95% accuracy) ArcGIS Data Reviewer: An Introduction
47
Managing Quality Results
ArcGIS Data Reviewer: An Introduction
48
Managing Quality Control
QC lifecycle management REVIEW CORRECT VERIFY Perform Edits or Note Exceptions Acceptable or Unacceptable Find & Record Errors ArcGIS Data Reviewer: An Introduction
49
Demo: Managing Quality Results ArcGIS for Desktop
ArcGIS Data Reviewer: An Introduction
50
Workshop Review Importance of data quality Components of data quality
Forms of data quality control Automated review Visual/Manual review ArcGIS Data Reviewer Automated validation Visual QC tools Reporting Error lifecycle management ArcGIS Data Reviewer: An Introduction
51
Resources Product page Resource Center Training Questions & comments
Resource Center Training Questions & comments ArcGIS Data Reviewer: An Introduction
52
Other Data Reviewer Sessions
Day and Description Type Time Location Tuesday July 15 ArcGIS Data Reviewer: Extending the Validation Framework Demo Theater 9:30 – 10:00am Geodata Mgmt Theater ArcGIS Data Reviewer: Leveraging Geoprocessing for Data Validation 10:30 – 11:00am ArcGIS Data Reviewer: Assessing Positional Accuracy 1:00 – 1:30pm ArcGIS Data Reviewer: Plans for Quality Assessment of Raster Datasets 5:30 – 6:00pm Wednesday July 16 ArcGIS Data Reviewer: An Introduction Technical Workshop 8:30 – 9:45am Room 14A ArcGIS Data Reviewer: Integrating ArcGIS Data Reviewer and ArcGIS Workflow Manager to Automate Data Quality Control Workflows 11:30 – 12:00am ArcGIS Data Reviewer: Special Interest Group Meeting SIG 12:00 – 1:00pm Room 15B ArcGIS Data Reviewer: Planning and Deploying Data Quality Services 3:15 – 4:30pm Thursday July 17 ArcGIS Data Reviewer: Integrating Data Validation Capabilities Into Web Applications Web & Server Theater ArcGIS Data Reviewer: Implementing Data Quality Reporting in Web Clients ArcGIS Data Reviewer: An Introduction
53
Offering ID: 1169 Please fill out the session survey:
Thank you… Please fill out the session survey: Offering ID: 1169 Online – Paper – pick up and put in drop box ArcGIS Data Reviewer: An Introduction
54
Offering ID: 1287 Please fill out the session survey:
Thank you… Please fill out the session survey: Offering ID: 1287 Online – Paper – pick up and put in drop box ArcGIS Data Reviewer: An Introduction
55
ArcGIS Data Reviewer: An Introduction
Similar presentations
