PX API 2.0 Petros Likidis.

Slides:



Advertisements
Similar presentations
LiNC Developer Meetup Welcome!. Our job is to make your life easier APIs Tools and workflow Documentation Stay in touch: developers.lithium.com Join the.
Advertisements

Overview of Twitter API Nathan Liu. Twitter API Essentials Twitter API is a Representational State Transfer(REST) style web services exposed over HTTP(S).
Cognos Web Services Business Intelligence. SOA SOA (Service Oriented Architecture) The SOA approach involves seven key principles: -- Coarse -grained.
Maria Gunnarsson Statistic Sweden Petros Likidis Statistic Sweden.
® ® © 2012 Open Geospatial Consortium, Inc. Framing a Geo Strategy for the Web with Points-Of-Interest Data at: Terra Cognita by: Raj Singh, PhD Director,
Px-Web API use in INSTAT
Progress Report 11/1/01 Matt Bridges. Overview Data collection and analysis tool for web site traffic Lets website administrators know who is on their.
Session Management A290/A590, Fall /25/2014.
Overview of the ODP Data Provider Sergey Sukhonosov National Oceanographic Data Centre, Russia Expert training on the Ocean Data Portal technology, Buenos.
Configuration Management and Server Administration Mohan Bang Endeca Server.
Michalis Vafopoulos NTUA, GFOSS & The transformers GREEN CITY HACKATHON.
Using the SAS® Information Delivery Portal
1 Country report 2014 – Statistics Norway PC-Axis Reference Group meeting
COMP 365 Android Development.  Manages access from a central database  Allows multiple applications to access the same data.
DateADASS How to Navigate VO Datasets Using VO Protocols Ray Plante (NCSA/UIUC), Thomas McGlynn and Eric Winter NASA/GSFC T HE US N ATIONAL V IRTUAL.
GCMD/IDN STATUS AND PLANS Stephen Wharton CWIC Meeting February19, 2015.
PX File Format - Suggestions for improvments Petros Likidis, Statistics Sweden.
Open Data Protocol * Han Wang 11/30/2012 *
JSTL, XML and XSLT An introduction to JSP Standard Tag Library and XML/XSLT transformation for Web layout.
PX development Mikael Nordberg & Petros Likidis Statistics Sweden.
SDMX Web Services the JSON version Sami Airo & Gerard Salou.
Search Engines. Search Strategies Define the search topic(s) and break it down into its component parts What terms, words or phrases do you use to describe.
Creating Links. The Anchor Element: The anchor tag can be used in three different ways: 1.External link – to link to a web page outside your own website.
ITGS Databases.
Facebook API Kelly Orser. Client Libraries Client libraries will simplify the calls to the platform by reducing the amount of code you have to write.
ATNA Repository Access Rob Horn. Problem How to aggregate federated audit repositories How to extract audit records for processing How to use media/files/etc.
Grouper Training – Admin – Subject API – Part 4 Shilen Patel Duke University This work licensed under a Creative Commons Attribution-NonCommercial 3.0.
WStore Programmer Guide Offering management integration.
Chapter 10 Database Management. Data and Information How are data and information related? p Fig Next processing data stored on disk Step.
PX-API and development of new console Norwegian experiences Jan Bruusgaard Pc-Axis Reference Group Meeting 2015.
PX-Web 2014 Maria Gunnarsson, Statistics Sweden Petros Likidis, Statistics Sweden.
web Metadata Properties Thumbnails Properties by Kind MRU Change Notifications Bulk Access File broker functions Search Deep/Shallow Enumeration.
Maria Gunnarsson SCB Mikael Nordberg SCB PX-Web 2015 December.
Database Form Processing Made Easy Chad Killingsworth Web Projects Coordinator.
User surveys - why and how? Annegrete Wulff Statistics Denmark
Vladan Strigo CTO NETmedia ASP.NET Web Api Tips & Tricks.
Access and management of video and Meta asset Emanuele Porfiri Etere.
WStore Programmer Guide Resources management integration.
Esri UC 2014 | Technical Workshop | Administering ArcGIS for Server with Python Jon Bodamer.
ODP V2 Data Provider overview. 22 Scope Data Provider provides access to data and metadata of the local data systems. Data Provider is a wrapper, installed.
The Web Web Design. 3.2 The Web Focus on Reading Main Ideas A URL is an address that identifies a specific Web page. Web browsers have varying capabilities.
Dumps PDF Perform Data Engineering on Microsoft Azure HD Insight dumps.html Complete PDF File Download From.
SmartCode Brad Argue INLS /19/2001.
DPS Dissertation System
Maria Gunnarsson Statistic Sweden Mikael Nordberg Statistic Sweden
The Client-Server Model
Node.js Express Web Applications
Node.js Express Web Services
An introduction to REST for SharePoint 2013
CASE STUDY -HTML,URLs,HTTP
Client / Session Identification Cookies
Detailed search stats from DSpace Solr
Centrally Managed Content with JSON Views and the Feeds Module
Manik Bali and Lori Brown Annual Meeting Madison, Wisconsin
Pekka Korhonen - Statistical services
Azure Machine Learning & ML Studio
National updates Statistics Denmark
Testing REST IPA using POSTMAN
Ben Burbridge, Rebecca Jones, Hilary Newman Product Development
The Re3gistry software and the INSPIRE Registry
PX-Web 2017 v1 and The situation at Statistics Sweden right now
Access Lesson 2 Creating a Database
Cloud Web Filtering Platform
PX-Web 2019 and more… Mikael Nordberg Developer Statistics Sweden.
LOD reference architecture
PX-Graph – New graphics package
Advanced Database Concepts: Reports & Views
PX-API and JSON-stat present state and future directions
*metrics from a Technical Point of View
TN19-TCI: Integration and API management using TIBCO Cloud™ Integration
Presentation transcript:

PX API 2.0 Petros Likidis

Motivation Better structure More stable identities for tables No limits on the amount of data cell that can be retrieved in one request More self descriptive HTTP GET requests for data retrievals

Better structure Configuration Database Table Metadata about the API Information about the structure of the database Table Metadata and data for all tables in the database

Better structure { apiVersion: "2.0", languages: [{id: "sv", Endpoint name: "Svenska", defaultLanguage: true}, {id: "en", name: "English"}], maxDataCells: 10000, maxCalls: 30, timeWindow: 10, CORS: true, dataFormats: ["px", "json-stat", "csv", "tsv"], defaultDataFormat: "px", streamingFormats: ["csv", "tsv"], defaultStreamingFormat: "csv", etc ... } Endpoint http://api.scb.se/api/v2/config Base URL

More stable identities for tables Language Path to table http://api.scb.se/OV0104/v1/doris/sv/ssd/START/BE/BE0401/BE0401A/BefolkprognRevN Base URL Database

More stable identities for tables http://api.scb.se/api/v2/tables/TAB0001 MATRIX in PX file based and TableId in CNMM databases will be used as the identity for a table.

No limits… Stream the data But there is other type of limits Only a couple of formats supported (CSV and TSV) No aggregations Harder to implement for PX-file databases so it might come later

A bit more self descriptive { id: "TAB0001", text: "Tabell A", updated: "2018-01-01T09:30:00" links: [{ rel="metadata", href: "http://my-site.com/api/v2/tables/TAB0001"}, rel="data", href: "http://my-site.com/api/v2/tables/TAB0001/data"}] }

Add the table query to the url as query parameters HTTP GET requests… http://api.scb.se/api/v2/tables/TAB0001/data?tid=2017,2018 Add the table query to the url as query parameters

HTTP GET requests… the last 4 time periods The first two time periods YEAR=-(4),+(2),1999,*79,*3*,18* the last 4 time periods The first two time periods The year 1999 All years ending with 79 All years containing the number 3 All years starting with 18

Restrictions Names of aggregation files must be unique Only one database VARIABLETYPE keyword must be formalized Initially only support for PX, JSON-STAT, CSV,TSV

Names of aggregation files must be unique Since the name of the aggregation file is used as the identity of the filter it has to be unique.

Only one database Almost everybody only have one database per PX-Web installation it makes sense to limit the number of databases to one which will make it easier for everyone

VARIABLETYPE keyword TIME CONTENT GEOGRAPHY OTHER/NORMAL

Initially only support for PX, JSON-STAT, CSV and TSV Open formats More resource efficient Do not require 3-rd party extensions

Thanks for listening