FME Server as Geospatial add-on for Business Intelligence Querying Jeffrey Smith GIS Developer Farallon Geographics, Inc. Gerald Gloskin Director, Data.

Slides:



Advertisements
Similar presentations
A Roadmap of Open Source components for GI Web Services and Clients A Paul R Cooper MAGIC.
Advertisements

ASP Tutorial. What is ASP? ASP (Active Server Pages) is a Microsoft technology that enables you to make dynamic and interactive web pages. –ASP usually.
Benefits and Concerns when Constructing an Enterprise-scale Geodatabase Larry Theller, presenter Agricultural and Biological Engineering Dept Purdue University.
WHAT IS AJAX? Zack Sheppard [zts2101] WHIM April 19, 2011.
Multiple Tiers in Action
IBIS GIS Mapping Missouri “Show and Tell”. Outline 1.What is KML 2.Why we chose KML 3.Show and Tell.
Oracle XML Publisher Integration with PeopleSoft By, Mr. Venkat.
Charlie Crocker Vice President Farallon Geographics, Inc. An Overview of Internet Mapping Technology.
Sep , 2006 v FME Worldwide User Conference - Vancouver What’s New in ArcGIS Data Interoperability Extension Kim Avery, ESRI, California, USA, and.
4-1 INTERNET DATABASE CONNECTOR Colorado Technical University IT420 Tim Peterson.
Technical Workshops | Esri International User Conference San Diego, California Esri Maps for IBM Cognos Dave Kerr Darren Nelson July 2012.
AIRNow Web Services Data to Go! Prepared by Steven A. Ludewig, Timothy S. Dye Sonoma Technology, Inc. Petaluma, CA John E. White U.S. Environmental Protection.
Introducing Reporting Services for SQL Server 2005.
Product Feeds. What is a Product? In marketing terms, a product is an item, service or idea that is for sale Examples are: A flight with set dates and.
Cansys West International Conference February , 2013Panama City, Panama What new features being evaluated for APPX?
An Introduction To Building An Open Standard Web Map Application Joe Daigneau Pennsylvania State University.
GIS On The Web: An Overview of ArcIMS. *The easy flow of geographic data can offer real-life solutions in many societal sectors, including municipal government,
Best Practices for Designing Effective Map Services Tanu Hoque.
Data Interoperability Basics Bruce Harold & Dale Lutz.
Searching Business Data with MOSS 2007 Enterprise Search Presenter: Corey Roth Enterprise Consultant Stonebridge Blog:
1 Geospatial and Business Intelligence Jean-Sébastien Turcotte Executive VP San Francisco - April 2007 Streamlining web mapping applications.
Accessing and Using Fire-Related Data with the CAPITA DataFed.net* Services Framework Stefan Falke Rudolf Husar Kari Hoijarvi Washington University in.
Esri UC 2014 | Technical Workshop | Data Interoperability: An Introduction Bruce Dale LutzSafe Software.
Esri UC 2014 | Technical Workshop | Creating Geoprocessing Services Kevin Hibma.
 Previous lessons have focused on client-side scripts  Programs embedded in the page’s HTML code  Can also execute scripts on the server  Server-side.
23 Copyright © 2009, Oracle. All rights reserved. Oracle Business Intelligence Answers: Advanced Features.
 ASP.NET provides an event based programming model that simplifies web programming  All GUI applications are incomplete without enabling actions  These.
Excel Services Displays all or parts of interactive Excel worksheets in the browser –Excel “publish” feature with optional parameters defined in worksheet.
Creating and Sharing Geospatial Data January 28, 2010 presentation to the Bedford Institute of Oceanography Geographic Information Systems Special Interest.
CS 562 Advanced Java and Internet Application Computer Warehouse Web Application By Team Alpha :-  Puja Mehta (102163)  Mona Nagpure (102147)
1 Using MVC 6. MVC vs. ASP Web Forms Both run under ASP.NET Can coexist In Web Forms, browser requests page. xxx.aspx and xxx.aspx.cs on the server Page.
Sharing Maps and Layers to Portal for ArcGIS Melanie Summers, Tom Shippee, Ty Fitzpatrick.
C# Programming: From Problem Analysis to Program Design1 Visual Studio Configuration C# Programming: From Problem Analysis to Program Design 4th Edition.
Data Visualization with Tableau
Jim Fawcett CSE686 – Internet Programming Spring 2014
ArcGIS API for javascript
Mapping for the interwebs
Space and Cyberspace 2017 GIS Data on the Web Simon Wiles.
Jim Fawcett CSE686 – Internet Programming Spring 2012
21 Essential Data Visualization Tools
Flanders Marine Institute (VLIZ)
CUAHSI HIS Sharing hydrologic data
WOCAT Mapping methodology
Let’s Build a Dashboard (Informer 4 versus Informer 5)
Pentaho JavaScript API
Getting web pages First we need to get the webpage by issuing a HTTP request. The best option for this is the requests library that comes with Anaconda:
Data Virtualization Tutorial: JSON_TABLE Queries
Searching Business Data with MOSS 2007 Enterprise Search
Accessing Spatial Information from MaineDOT
Tools and guidance for data providers
Environmental Sensing Monitoring and Analyzing Water Temperatures
Spatial Data Processing
Searching Business Data with MOSS 2007 Enterprise Search
Oracle Analytic Views Enhance BI Applications and Simplify Development
04 | Web Applications Gerry O’Brien | Technical Content Development Manager Paul Pardi | Senior Content Publishing Manager.
Enhance BI Applications and Simplify Development
Azure's Performance, Scalability, SQL Servers Automate Real Time Data Transfer at Low Cost MINI-CASE STUDY “Azure offers high performance, scalable, and.
Lecture 1: Multi-tier Architecture Overview
Types of Spatial Data Sites
Introduction of Week 11 Return assignment 9-1 Collect assignment 10-1
MIS Professor Sandvig MIS 324 Professor Sandvig
Types of Spatial Data Sites
Web AppBuilder for ArcGIS
MIS2502: Data Analytics MySQL and MySQL Workbench
Types of Spatial Data Sites
Combining ArcGIS for Server & ArcGIS Online
ArcGIS Online – The Road Ahead
Client-Server Model: Requesting a Web Page
Introduction to Portal for ArcGIS
Introduction to JavaScript
Presentation transcript:

FME Server as Geospatial add-on for Business Intelligence Querying Jeffrey Smith GIS Developer Farallon Geographics, Inc. Gerald Gloskin Director, Data Warehouse ISO Innovative Analytics

 ISO Innovative Analytics needs a way to spatially visualize the output from Viador, a non-spatial BI tool.  Viador offers many visualization/reporting widgets, and ISO desires to add a map widget into the environment they are familiar with. Business Challenge

Technical Challenges  The schema of data exported from Viador changes depending on the query.  There are several spatial datasets that data from Viador may need to join with (States, Census Block Groups, etc).

Viador Capabilities to Leverage  Ability to create HTML forms that support querying  Export queries to formats including CSV and XML

Step 1 From a custom HTML form within Viador a query is made and the results are saved as a CSV file onto a network drive (a location accessible by FME Server)

Step 2 From the HTML form within Viador a URL to a custom ASP.NET MVC web application is constructed and opened within a results page

Step 2-1 The URL contains 5 querystring parameters which will eventually be used as published parameters passed to FME Server QueryString ParamDescription SourceDataset_CSVPath to CSV file exported from Viador CSVJoinAttrAttribute in CSV file to use for joining SpatialJoinAttAttribute in SQL Server to use for joining FeatureTypeSpatial layer in SQL Server to join CSV with ThematicAttribute in CSV to use for thematic rendering Example URL: rs.csv&CSVJoinAttr=State_Code&SpatialJoinAttr=state_abbr&FeatureType=STATES&Thematic=Filing_Status

Step 2-2 Example CSV file schema

Step 2-3 In SQL Server we have written a view that unions all of the potential spatial datasets. This creates a single view we can use as a FeatureType in FME (the FeatureType querystring param is used as a WHERE clause on the TYPE column) TYPEGEOMJOIN1JOIN2JOIN3… STATESPOLYGONCA40656…. STATESPOLYGONHI40613…. STATESPOLYGONOR40675… CENSUS_BLKGRPPOINT as88fdv…. CENSUS_BLKGRPPOINT vf66wsd… CENSUS_BLKGRPPOINT hf87dds…

Step 3 The custom web application takes these querystring parameters and uses them to build a URL for FME Server. This URL is embedded into the web page that is returned to the clients browser.

Step 4 On load of the webpage we have some JavaScript code that uses the embedded URL to make a request to FME Server

Step 5 FME Server then reads in the CSV file exported from Viador as well as the appropriate spatial data from SQL Server and joins these datasets together in effect spatially enabling the non- spatial data from the CSV file

Step 6 JSON data is returned from FME Server, and then rendered on a map using OpenLayers

The Solution

The Web Application

At this point the user can click on features on the map to view a popup with attribute information.

The Web Application Notice that the data is rendered thematically, and the application has a legend in the left corner

The Web Application Data can be exported to KML or Shapefile format

The Web Application Data can be viewed on top of either Google or Bing basemap data

Cool FME Functionality Used  CSV reader’s ability to read in a file with any schema into the translation  Generic writer’s ability to write multiple formats  Generic writer’s ability to handle any schema we throw at it

Thank you! Jeffrey Smith Farallon Geographics, Inc Gerry Gloskin ISO Innovative Analytics Questions?