Sep , 2006 v The Road Ahead

Housekeeping Wireless Internet Access UserName: hccxx Password: 55tt66yy Lightning Talks start at 1:00 PM. Conference Website:

Doctors’ Report

FME 2007 and Beyond  FME 2007 Overview  Product Integrations  Python in FME 2007  FME 2007 Spatial ETL Server debut  Demonstrations

FME 2007  New Geometry  Architectural refresh continues focusing on processing functions.  64 bit FME engine is running internally.  Not all formats as some rely on 3 rd party libraries.  Cannot have mixed 32 and 64 bit in an application  Raster  Improved performance. Reprojection is about 40 times faster.  More Web Service clients  WMS, WCS, GeoRSS and others.

FME 2007  More Formats  Geoconcept, GeoRSS, VOIV, CityGML, Lidar, TIGER GML…., File Geodatabase  Format updates  Oracle Spatial updates, Enterprise Geodatabase, Autocad, DGN, GeoMedia, …  Continued Workbench Improvements  Overview window, increased window flexibility  Improved do/undo  Improved schema migration support  Improved transformer upgrade support.

Workbench 2007

Customizable Categories  Create and share groups of transformers  Transformers could grouped by task

Selectable Reproject Engine  Default is FME engine  ESRI Reproject Engine can be used if ArcGIS is present  Possibly more Reproject engines could be made available  An FME Objects interface for Reproject engines has also been added  Special license needed

FME: The Road Ahead 13 Raster Support Goals  Translate between raster types  eg. GeoTIFF > JPEG2000  Translate between raster subtypes eg. 8 bit colour palette -> 24 bit continuous colour  Resample rasters  Reproject rasters  With reasonable performance(!)  Combine Raster & Vector in interesting ways  Clip rasters to specific vector rectangles  Drape -- moving raster data to vector features

FME: The Road Ahead 14 Raster in Databases  Raster database support status  ESRI ArcSDE  Writing and reading  Oracle 10g  Writing (reading will follow)

Zoning and Roads Overlaid on Landsat Image

Contours Generated From DEM

Why 64 Bit FME?  Memory, memory, memory.  Able to process drastically larger datasets.  Machines with more than 4 GB commonplace.  Increased processor performance  No cost premium  Vista + Core Duo 2 = commonplace 64 bit

New Geometry Model

 Backward compatible with old geometry model  Old geometry is in fact a type of new geometry.  All existing formats/transformers work as before.  Formats upgraded as needed to support new geometry  ESRI Geodatabase, FF, GML, Oracle, AutoCAD, GeoMedia, Design Files, SDF3, …  Enables FME to support all latest geometry models  Latest status on fmepedia.fmepedia

Why a New Geometry Model?  Arcs, Arcs, Arcs  Many systems represent features using arcs.  Paths can consist of both arcs and line segments.  More efficient/accurate way to represent curves.  New CurveFit transformer will create paths with arcs.  Proper support for measures.  Multiple measures per vertex also supported.  Lays groundwork for multiple geometries per feature.

Multi-Processing  Cores, Cores, Cores.  Intel/AMD now have dual core processors.  How to take advantage of this?  Multi-threading applications  Multi-processing applications  Advantages of Multi-Processing  Each process has its own memory space.  Multi-process workspace can be distributed across machine boundaries not just process boundaries.

Multi-Processing  Disadvantages of Multi-Processing  Communication is more expensive.  Big performance gain for high cpu intensive tasks like intersection, overlays, surface modeling, etc.  Advantages of Multi-Threading  Low communication overhead.  Finer grained parallelism.  Disadvantages of Multi-Threading  More difficult to debug and develop applications.  Safe has Multi-Processing via the FME TransporterFactory & Transporter Transformers

More Data Sources  FME is an environment able to use web services.  To FME these are just data sources, and transformers.  FME is an ideal data integration/aggregation tool able to consume many data sources.  It doesn’t matter where the data comes from!  Python plays critical part in this.  Our coming FME Spatial ETL Server can publish services derived from other services. FME is positioned to play a key role in enabling organizations to make wide-spread use of web services.

Python  Python is a great way to extend the reach of FME technology.  Most web services are not WFS, WMS, or SOAP..  FME 2007 enables users to exploit the power of Python more easily.  FME 2006 GB has some capabilities but not like FME 2007.

Python Goodies  Many great libraries out there for users  PyParsing (generic parsing)  BeautifulSoup (XML/HTML parsing)  Cheetah(Template Library)  ReportLab( PDF generation, etc)  ZSI(Soap library)  CElementTree (Wicked fast XML parsing)  GeometryFactory (geometry algorithms)  Many more…

Web Service via Python !! Call out to Yahoo Geocoding Web Service

FME Spatial ETL Server 2007  FME has very strong client applications  Workbench is a great authoring tool  Viewer is a strong data inspection tool for raster and vector  Workbench is to be the authoring environment for Server  Deploy workbench scripts to the server as a service/resource for organization  Run/debug workbench scripts on the server during the authoring phase  SpatialDirect is a client to this FME Spatial ETL Server  FME Spatial ETL Server will be released at same time as FME 2007  It will then evolve over the next few releases.

Spatial ETL Server Solution FME Spatial ETL Server

FME SpatialDirect Configuration FME Spatial ETL Server

Users see data the way they need to see it

Spatial ETL Server Ability to do data Federation is key

Survey at ETL Conference What is the most important data type that ETL tools don’t support? #2 answer was Spatial!

MIS + GIS = IS  Databases  All major databases both open source and proprietary now support or will support spatial data natively.  ETL Tools  Many of the Major ETL vendors such as Microsoft (SSIS) and Informatica now want to incorporate spatial capabilities.  Business Intelligence  Many decisions making processes can benefit from incorporation of spatial data.  Internet  Yahoo Maps, Google Maps, Google Earth, Microsoft Virtual Earth, AOL, GlobeXplorer, …

Safe and Microsoft SSIS

Safe and Informatica PowerCenter

Safe Software Strategy  There is one thing that all applications need to shine. Spatial Data  Data is to applications and databases as fuel is to an engine.  A database or web-based tool with no data is useless.  Web services with no easy way to consume them provide no value. The job of Safe Software and its Users is to bring the power of spatial data to all applications!

Demonstration(s)  Custom Transformers (fmepedia)  New Geometry  MRFClean, and CurveFit  Python  SSIS  Spatial ETL Server

Demonstration(s)