Download presentation
Presentation is loading. Please wait.
Published byGarey Higgins Modified over 9 years ago
1
Data Exchange Needs Using ETL Tools
2
Overview Client Project Issue Methodology Schedule & Budget Results & Recommendations Challenges Acknowledgments Questions
3
Ministry Of Transportation
4
Project Issue & Primary Goal Current data conversion process o Each time data is updated it needs to be redone manually o Need to streamline the process o Extract Transform Load (ETL) Tools Safe Software Feature Manipulation Engine (FME) Esri ArcGIS Geoprocessing Tools (Data Interoperability Extension)
5
Methodology Standard Methodological Approach: Identify objectives, issues & goals Research topic and best practices Identify scheduling, budget, risks Communicate & Conduct Meetings Gather information for evaluation, reporting and decision making Report findings
6
Streamlined data conversion process User know-how ETL tools capabilities and limitations ETL tool decision making Final Report and recommendations Goals & Deliverables
7
Extract Transform Load ETL - Traditional ETL is used to migrate data from one database to another, to form data marts and data warehouses and also to convert databases from one format or type to another. Spatial ETL – Safe Software Feature Manipulation Engine - FME Provides the data processing functionality of traditional ETL, but with a primary focus on the ability to manage spatial data (the geometry, attributes, and coordinate systems of spatial datasets)
9
Oracle SQL Bridge Date xls ArcSDE ArcGIS Server ArcGIS Desktop Current Process
11
MTO Proof of Concept
16
FME Output
17
FME Server FME Desktop is the authoring tool for FME Server Any spatial ETL workflow created in FME Desktop can be published to FME Server FME Server is a scalable processing environment that allows multiple users via the web Workflows can be shared and automated in this environment
18
“Safe Software sets the standard for spatial data interoperability, so it was an obvious choice to use their FME technology for Esri’s ArcGIS Data Interoperability Extension.” – Jack Dangermond, Esri President ArcGIS Desktop Data Interoperability Spatial ETL
21
ArcGIS Output
22
Arc Server
23
Evaluation Architecture ETL Functionality Ease-of-Use Reusability Debugging Real-time Connectivity General ETL tool characteristics
24
Challenges GIS Expertise, knowledge and training Assumed licenses acquired and ready to use Data availability and ability to work on data Client Representation
25
Recommendations Streamlined data conversion process User know-how ETL tools capabilities and limitations ETL tool decision making
26
Acknowledgements Client o Laura Kingston Project Thesis Adviser o Mike Wallace Technical Advising o Colin Bissell o Jonathan Lepage o Allison Hughes FME Software Acquisition o Gerry McCoubrey o Craig Vernon
27
Questions
Similar presentations
© 2025 SlidePlayer.com. Inc.
All rights reserved.