FS Enterprise Data Warehouse and Standard Reference Data
EDW Purpose and Benefits Provide a trusted source of information from FS authoritative sources Aggregate data from multiple FS programs and make it accessible Provide tools for data analysis and management reporting Provide public access to FS data Promote data quality Promote data standardization Reduce redundant data storage 2ENTERPRISE DATA WAREHOUSE (EDW) OVERVIEW
EDW provides one-stop shopping for standardized, current, trusted data from disparate sources to be used for analysis or for sharing with external partners ENTERPRISE DATA WAREHOUSE (EDW) OVERVIEW 3
What is the EDW? ENTERPRISE DATA WAREHOUSE (EDW) OVERVIEW 4
One Data Source – Many Publication Formats ENTERPRISE DATA WAREHOUSE (EDW) OVERVIEW 5
Some EDW Features Content Governance – EDW Content Governance Board reviews and approves proposals for all EDW content Data Quality Forum – by publishing the data for broader use, there is increased review and use of the data. Data Quality forum allows FS users to comment on issues identified in the data. Issues forwarded to data owners for resolution. Data Status information is available on proposed content from the proposal phase through development to publication. ENTERPRISE DATA WAREHOUSE (EDW) OVERVIEW 6
FS internal information resources on SharePoint EDW SharePoint Site: Program overview, strategy, tools, alertsEDW SharePoint Site Data Status: What data is available? Status of proposed data content. Data Status Data Quality Forum: Report issues with data quality Data Quality Forum Users Forum: Report problems, make suggestions Users Forum Training Training o General GIS Training General GIS Training o Use of EDW Best Practices Use of EDW Best Practices EDW Content Governance: process, charter, decision record, minutes, Governance content status EDW Content Governance ENTERPRISE DATA WAREHOUSE (EDW) OVERVIEW 7
EDW Standard Reference Data Reference data is any kind of data that is used to categorize other data found in a database, or for relating data in a database to information outside of the database. It is usually managed as a set of values (acronyms or codes) and descriptions, and examples include lists of counties, states, and countries. Reference data in the EDW goes through the Content approval process, and therefore can be considered an FS data standard. ENTERPRISE DATA WAREHOUSE (EDW) OVERVIEW 8
Benefits of Standard Reference Data in the EDW Provides data that can be used to link data from disparate programs Provides developers with needed data that is accurate, current, and readily accessible Reduces use of multiple (potentially inconsistent) versions of the same reference data in different parts of agency operation Provides metadata that documents data source Acquisition and maintenance of reference data is more cost-effective and convenient— individual applications do not need to acquire and maintain their own reference data. ENTERPRISE DATA WAREHOUSE (EDW) OVERVIEW 9
Internal and External Reference Data Sources Priorities were identified in interviews with FS programs External reference data: States (Census) Counties (Census) Congressional Districts (Census) Other external data: Hydrologic Unit Codes (HUCs) (USGS) Others under consideration Internal reference data: Standard Administrative Unit Names (and Codes) FS Office Locations (and related People, Units, and Building information) – under development ENTERPRISE DATA WAREHOUSE (EDW) OVERVIEW 10
Standard Reference Data Business Process Workflow ENTERPRISE DATA WAREHOUSE (EDW) OVERVIEW 11
Reference Data Documentation and Artifacts Data analysis (spreadsheet) Use Case Data Standard Business Rules Data Model Web Services – RESTful services developed for applications to consume EDW data using a URL (i.e., Get method) or HTML form (i.e., Post method). Examples provided for developers incorporating a web service call directly from their application through Oracle PL/SQL. ENTERPRISE DATA WAREHOUSE (EDW) OVERVIEW 12
Using EDW Data Public Access to FS data: Data and services with Data.Gov Data download capability for the public - Data available via map services Data available via data extract tool Collaborative Business Intelligence environment – internal use: Cognos and ESRI Maps tools available to developers from various FS programs - team.usda.gov/sites/fs-cio-edwts/edw-developers/SitePages/Home.aspxhttps://ems- team.usda.gov/sites/fs-cio-edwts/edw-developers/SitePages/Home.aspx Connecting to the data via ArcGIS (via Citrix): T:\FS\Reference\GeoTool\agency\DatabaseConnection\edwdb - sde.default as myself.sde Map services: Internal: Available only to FS users Internal External: Available to FS users and the external public External ENTERPRISE DATA WAREHOUSE (EDW) OVERVIEW 13
Public Distribution of FS Data: ENTERPRISE DATA WAREHOUSE (EDW) OVERVIEW 14
Questions? June 2015LOCATIONAL BUSINESS INTELLIGENCE IN THE U.S. FOREST SERVICE 15