Data visualisation with TIBCO Spotfire

Data visualisation and analysis software Spotfire Data visualisation and analysis software Loading data from a range of sources (databases, web services, linked data, files) Analysis (manipulation, filtering, statistics) Visualisation (graphs/charts, maps, tables) Data/image export Quick and easy visualisation and analysis of large datasets Intro to Spotfire Show a few examples of Spotfire tools http://spotfire.tibco.com/

Where to find it on SEWeb

Discover data link takes you to this page

Published tools Bathing Waters Climate Projections Climate Trends Climate Trends Handbook Native Woodland Survey of Scotland (NWSS) Household Waste Waste From All Sources Water Body Classification Groundwater 5

Published tools Bathing Waters Climate Projections Climate Trends Climate Trends Handbook Native Woodland Survey of Scotland (NWSS) Household Waste Waste From All Sources Water Body Classification Groundwater 6

Water body classification Surface water classifications (SEPA) Most recent classification (2013) Historical classifications Change between years 7

First example – WFD classifications provided by SEPA (from water monitoring work) Use this to show general Spotfire functionality Number of tabs – first tab shows most recent classification

Filter to local authority – all filters and visualisations updated accordingly 9

Mark bad classifications – highlight on Change graph shows that they haven’t changed since last time. Links to PDFs 10

Example of PDF link 11

Filter to particular water body categories from dropdown menu 12

View overall status or water quality 13

Second tab shows historical data Slider shows selected year on map. Show different example of this in a few slides where it’s easier to see change between years. Summary, change graphs and table all show history instead of just most recent classification 14

Applied filters and marked body on map: marked water body always classified as ‘good’ and no change between years. 15

Export visualisations with right click 16

Export table with right click 17

Third tab shows all data – same filters as previous tabs, but no visualisations, just data download table 18

Household waste Waste generated, recycled, diverted from landfill (other than recycling) and landfilled by local authority Detailed waste types at local authority and national levels (e.g., Chemical wastes, Discarded vehicles, Glass wastes) Trends in waste generation, recycling and landfill since 2004 19

Example 2: HH waste from local authorities and Zero Waste Scotland Results for Edinburgh shown on bottom chart 20

Generated waste by local authority for 2013. Data presented as total tonnages and kg per person 21

contrast Glasgow totals and kg/person 22

Climate Trends Analysis of: Dynamically calculates: One or more climate variables: 26 variables in total One or more locations: National, Met Office regions, river basins, local authorities, postcode districts, 5km grid squares (maps only) One or more averaging periods: annual averages for all variables; seasonal and monthly averages for 16 variables Dynamically calculates: Running means Trends Summary statistics Large and detailed dataset; tool contains some analyses that people may find confusing; tool designed for informed users. Alternative for non-specialists is climate trends handbook 23

3rd example: Climate trends data from Met Office Graphs, maps and statistics shown on several tabs 24

Running means indicated by blue arrows, trends indicated in red Running means indicated by blue arrows, trends indicated in red. Switch graph lines on and off in filter panel. 25

Split by up to four parameters in summary table and two in detailed table 26

Filtering to look at trend since 1950 shows significant trend in E Scotland as well 27

Map example: seasonal changes in total precipitation: 2011 values vs 1961-1990 baseline value Wetter in east during summer, drier in most places during winter 28

Climate Trends Handbook Analysis of: 20 climate variables National, Met Office regions, 5 km grid squares (trend maps only) Annual and seasonal averages Dynamically calculates: Running means Trends Summary statistics 29

Climate trends handbook for non-specialists: Same data as standalone tool, but presented in a much more user-friendly format Explanatory text; figures created in Spotfire 30

Average temperature: figure is a Spotfire tool, plus tables and maps below also presented in Spotfire 31

Figure responds to filter selections Table shows trends calculated in Spotfire 32

Summary Variety of Spotfire tools published Wide range of data from different sources Tools tailored for specific audiences Allows public to access, visualise and interrogate data Easy data analysis (e.g., statistics) Can make data available for download (helps with FOI requests) Presentation has given small insight into the Spotfire work on SEWeb 33

What went well? Data verification Engagement with partners Encouraging data sharing People see the potential of Spotfire and are enthusiastic Replaced some existing methods of data publication (e.g., static reports) Media attention – raises the profile of SEWeb, partners and Scotland’s environment 34

…and what didn’t? Combining datasets is limited – we could do more! Spotfire is not a mapping tool so spatial analysis capabilities are limited Data sourcing has been challenging (finding data in a suitable state and format for use in Spotfire) Lack of resource to produce dynamic data feeds Lack of time/resource to provide feedback on Spotfire work Legalities/data ownership 35

In development Air/Education package Marine Finfish Farms Food Standards Agency Shellfish Monitoring National Forest Inventory National Forest Estate Site Condition Monitoring Wetlands Inventory Soils and Land Capability Scottish Pollutant Release Inventory (SPRI) Water Quality Monitoring Sites 36

Proposed Nitrate Vulnerable Zones Invasive Non-Native Species Environmental Indicators Marine Scotland Fisheries Statistics Always on the lookout for new ideas! 37

“contact us” on the website Scotland’s Environment Web www.environment.scotland.gov.uk Take a look at the website, let us know what you think, share new ideas seweb.administrator@sepa.org.uk “contact us” on the website