Pembrokeshire - A PAI example for others Pete Roberts GI Consultant 03-07-2003.

Slides:



Advertisements
Similar presentations
Testing Relational Database
Advertisements

Software change management
Configuration management
Softricity LLC Advance slides with arrow keys. Without PDMLynx Informal processes based upon excel, access, paper files No consistency across organization.
“The Honeywell Web-based Corrective Action Solution”
Copyright Hub Software Engineering Ltd 2010All rights reserved Hub Workflow Product Overview.
Requirements Specification and Management
Oracle Hyperion Financial Data Quality Management Considerations for a scaled, expedited and integrated approach on data quality NCOAUG – Aug 15, 2008.
P3, M2,M3,M4.
P G CPG C A Unique Opportunity Peter Roper PROPER GIS Consultancy Ltd. GIS Consultant for East Staffordshire Borough Council.
Damian Gordon.  Static Testing is the testing of a component or system at a specification or implementation level without execution of the software.
Copyright 2002: LIIF Technology Architecture Review Database Application Architecture Database Application Architecture Collaborative Workgroup Architecture.
ICASAS305A Provide Advice to Clients
Validata Release Coordinator Accelerated application delivery through automated end-to-end release management.
SOFTWARE PRESENTATION ODMS (OPEN SOURCE DOCUMENT MANAGEMENT SYSTEM)
Cadle & Yeates Ch 5 Revised by Ivor Perry Sept Detailed Planning - 1.
16 months…. The Visibility Information Exchange Web System is a database system and set of online tools originally designed to support the Regional Haze.
Brief Overview of Data Processing of Afghanistan Household Listing, Pilot Census Results, Population and Housing Census and NRVA Survey Brief Overview.
Address register: HM Land Registry’s experience Jon Atkey Head of International Unit, HM Land Registry England and Wales.
NH GFOA Annual Conference 5/7/ This presentation is intended for informational purposes only, and is not a substitute for seeking professional.
Chapter 7 Database Auditing Models
UPDATING TABLE DRIVEN CODE FORMS 18 April 2006 (Joël Martellet, WMO, World Weather Watch, Data Processing and Forecasting Systems)
System Design/Implementation and Support for Build 2 PDS Management Council Face-to-Face Mountain View, CA Nov 30 - Dec 1, 2011 Sean Hardman.
High-Speed, High Volume Document Storage, Retrieval, and Manipulation with Documentum and Snowbound March 8, 2007.
GOODWILL OF NORTHWEST NORTH CAROLINA, INC. EMPLOYEE TRAINING DATABASE PROTOTYPE.
© Grant Thornton UK LLP. All rights reserved. Review of Partnership Working Vale of Glamorgan Council Final Report- July 2008.
SanGIS (San Diego Geographic Information Source) A Joint Powers Authority of the City and County of San Diego.
Schema Translation – OS Mastermap, but not as we know it Eddie Curtis, Snowflake Software, Greg Byrom, Richie Fyall GeoData Management Group Ordnance Survey.
Sep , 2006 v FME Worldwide User Conference - Vancouver David Eagle – Consultant / Trainer Dotted Eyes Ltd, UK Production.
Associate ® Typist – Transcription Module Starting Associate Transcription: To start Associate typist module, double click the Associate dictation icon.
National Infrastructure Tina Yule Technical Assurance Co-ordinator 21 st Century Government Unit.
 To explain the importance of software configuration management (CM)  To describe key CM activities namely CM planning, change management, version management.
What You Need before You Deploy Master Data Management Presented by Malcolm Chisholm Ph.D. Telephone – Fax
Copyright © 2007, Oracle. All rights reserved. Managing Concurrent Requests.
OHT 11.1 © Marketing Insights Limited 2004 Chapter 9 Analysis and Design EC Security.
Instant Messaging for the Workplace A pure collaborative communication tool that does not distract users from their normal activities.
Usability Issues Documentation J. Apostolakis for Geant4 16 January 2009.
State Records Office of Western Australia.NET Proof of Concept Project Slideshow: Prototype Online Disposal Authority/Recordkeeping Plan System Project.
Configuration Management (CM)
POPULATION AND HOUSING CENSUSES IN SLOVAKIA ON THE WEBSITE Miroslav Hudec Pavol Büchler INFOSTAT – Bratislava MSIS Geneva
Atlanta Oracle Application User’s Group August 18, 2000.
Database Security and Auditing: Protecting Data Integrity and Accessibility Chapter 7 Database Auditing Models.
Advanced Higher Computing SOFTWARE DEVELOPMENT PROCESS.
1 Administering Shared Folders Understanding Shared Folders Planning Shared Folders Sharing Folders Combining Shared Folder Permissions and NTFS Permissions.
The Digital National Framework of Great Britain GSDI 6 Conference - From Global to local September 16-19th 2002 BUDAPEST, HUNGARY.
© Mahindra Satyam 2009 Configuration Management QMS Training.
Quick Recap Monitoring and Controlling. Lesson 11: Monitoring and Controlling Project Work Topic 11A: Identify the Monitor and Control Project Work Process.
PAI Trial using LEHO software Liz Street Network Records Team Manager 2nd July 2003.
Campus Network upgrade and Wi-Fi Rollout REVIEW AND PHASE 3 PROJECT MANAGER TASKS.
Innovation Software Corporation's Cultural Awareness Training Program Presentation by:
LG DATABASE AND REPORTING SYSTEM (LGDRS) 8-9 September 2015
QILT May Webinar1. Just before we get started… Who are we? How questions will be handled Resources available after the webinar QILT May Webinar 2.
Legal Holds Department of State Division of Records Management Kevin Callaghan, Director.
1 DIRECTORATE-GENERAL FOR ENERGY AND TRANSPORT Digital Tachograph : Information Seminar Budapest, 25-26/02/20009 Digitac.
& FAX function in LRP For Agents Internal Circulation Only Presentation by: ESL Process Engineering Team.
SharePoint 101 – An Overview of SharePoint 2010, 2013 and Office 365
Mobile Software Solutions
Software Application Overview
DASNY Administered Grant Programs
Description of Revision
Document Custodian of the Drop Safe Log
Standard Scripts Project 2
Intermountain West Data Warehouse
Purge-it! USP's, pre-sales process & helping the customer to decide
BCS Template Presentation February 22, 2018
Standard Scripts Project 2
(Project) SIGN OFF PROCESS MONTH DAY, YEAR
Standard Scripts Project 2
Presentation transcript:

Pembrokeshire - A PAI example for others Pete Roberts GI Consultant

Overview PAI Impact on Pembrokeshire Planning for the change Data Quality Migration What’s next

Pembrokeshire County Council Rural unitary authority Area 1614 Sq km Pembroke Dock and Milford Haven on Urban tiles Remainder rural GIS development driven by a virtual team of 4 staff MapInfo Professional users since v4

Impact on Pembrokeshire 3 areas supplied to date Haverfordwest scheduled within next three months More areas now in the 3-9 month window Whole county scheduled for supply by end of ‘03-4 financial year Perceived as a barrier to implementing OS MasterMap if a means of implementing the data could not be found.

Understanding PAI Part of West Wales group of local councils Took lead within group on OS MasterMap migration planning PAI workflow development Learnt from others in the group on Data audits Use of OS MasterMap in PAI Established core team to coordinate programme across authority

Planning for Change (1) : Data Audit Audit Questionnaire Based on Ordnance Survey draft used in Ceredigion Audit database Basic MS Access database All users required to complete records for data they managed on behalf of authority Data analysis Sift based on audit responses Identified less than 20 tables of data that met criteria in matrix to be worthwhile migrating

Planning for Change (2) : Data Quality Review Visual inspection of data considered for migration Results Data was a modern interpretation of an historic document Data capture techniques were generally poor Data generally followed rather than was snapped to Ordnance Survey lines Uses Visual inspection only Reference to original source if ambiguity existed Conclusions Existing data was fit for purpose

Conclusions of Audit Phase Data was fit for current purpose of visual inspection BUT Overall quality was low due to a combination of Limited quality control on capture Limited techniques available during capture of oldest data Data captured to meet specific purpose rather than for wider use THEREFORE Data was not fit for future purposes

Migration : Aims Council data was perceived to have a low quality value Resources needed to be focussed on quality improvement not PAI migration Speed and ease of migration were considered important Cost minimisation was high priority Ambiguity caused by PAI should be removed to ensure data remained fit for use on current purposes Quality improvement was a separate related process

Migration : Technical solutions Council purchased single licence of Shiftwiz from Dotted Eyes for PAI migration Low cost (ca £2500 for licence) Used existing technology Provided means to migrate all data using same parameters Batch process Able to handle large volumes of PAI link files Perceived fast processing of data

Migration : Workflow overview Based on “Generic PAI data management workflow” joint document prepared with Ordnance Survey Stage 1 : Prepare feature level metadata Stage 2 : Create PAI status table Stage 3 : Freeze data and extract affected information Stage 4 : PAI migration Stage 5 : Reintegrate with original dataset

Migration : Workflow (1) Stage 1 : Feature level metadata New column to denote status of data created All objects populated with appropriate current status flag TagDescription PRObject captured on rural tiles in an unimproved position in relation to PAI or quality improvement PUObject captured on urban tiles prior to quality improvement PMObject captured on Mountain & Moorland tiles prior to quality improvement MRObject on a rural tile that has been migrated to a post PAI position but not yet improved in terms of data quality QRObject on a rural tile that has been captured at high quality but will be subject to subsequent PAI revision QData on any tile that has been captured at the defined quality level for the dataset or has been migrated and quality improved to the appropriate quality level Stage 2 : Create PAI status table DMU based table showing the internal PAI status of each map unit All tiles colour coded for No PAI impact PAI received PAI implemented PAI pending (with date if known)

Migration : Workflow (2) Stage 3 Freeze and extraction Users notified of area undergoing processing Data extracted from main file and stored in separate location Stage 4 PAI migration Shiftwiz configured once to determine optimum settings in PAI block Program used as “black box” solution for all data Output files checked for anomalies Stage 5 : Reintegration Status flag changed to post PAI unimproved Data incorporated back into main file Pre PAI data stored in archive DMU status changed Quality improvement commenced

What’s Next Data quality improvement process Scheduled at a feature level using Dotted Eyes CaptureWiz New processes in discussion for data capture with OS MasterMap OS MasterMap deployment Moved forward from Jan to end July to facilitate above program Unlikely to be affected by PAI due to speed of process Link file triggers new download Migration undertaken while order is processed OS MasterMap and PAI data updated at same time

Testing the Theory (1) 2 day project in Pembrokeshire HQ Test area northern PAI block on Ceredigion boundary. 466 link files Tested on NT4 workstation and Win 2000 laptop 17 datasets Approximately 1750 records not all in PAI area

Issues to watch out for : Software Including a $ sign in the file-path causes data load to fail $ is a reserved character in SQL, Pembrokeshire use the symbol to denote a server on the network but not visible Check your virtual memory settings System uses large amounts of virtual memory to page information in and out. Especially on NT the default settings will be too low. Virus checkers eat memory and should be disabled if there are limited amounts of physical memory

Results On the laptop 1.45 million links processed in 17 minutes to create both current matrix and stored data for future use User data processed in 90 minutes Visual inspection confirmed authority were happy that data could still be used for visual inspection Pre Post

Is the Model Generic? Applicable Any dataset that has not been snapped to Land-Line features Any data used for visual inspection were paper mapping is regarded as definitive document Data where a subsequent quality improvement is planned Applications where maintaining the most current mapbase overrides absolute replication of data Not Applicable Data replicated from Land-Line where quality is vital to be maintained Data used in fully automated systems until full QA is completed

Conclusions Pembrokeshire have a model workflow they will use for PAI migration Pembrokeshire plan to produce a companion document for our generic workflow detaillign their experiences of working with PAI Their proof of concept provides us with a means of defusing some of the concerns about the time impact of PAI in the local authority sector.

And Finally “Provided you do your areas as they come in it is quite easy and simplistic”

Contact for further information Customer Contact Centre Ordnance Survey Romsey Road SOUTHAMPTON United Kingdom SO16 4GU Phone: Fax: Web site: