Page 1 CSISS Center for Spatial Information Science and Systems Design and Implementation of CWIC Metrics Weiguo Han, Liping Di, Yuanzheng Shao, Lingjun Kang Center for Spatial Information Science and Systems George Mason University 2014 CWIC Development Team Meeting Greenbelt, MD January 28-30, 2014
Page 2 CSISS Center for Spatial Information Science and Systems Contents Background System Architecture Metrics Information Collection Metrics Information Extraction Metrics Information Presentation Demonstration Conclusions
Page 3 CSISS Center for Spatial Information Science and Systems Background Answer questions from stakeholders, sponsors, partners, and other users like –How many users have accessed CWIC service during the past month? –How long is the average processing times for the GetRecordById request? –Which data collections or datasets of USGS LSI is queried most often? –Which countries are CWIC users from? With more integrated catalogs and more client requests, it is desired to develop mechanisms and metrics for determining reliability and quality of CWIC service –Catalogs: NASA ECHO, USGS LSI, GHRSST, INPE, and CCMEO –Clients: CWIC Start, USGS LSI Explore, etc
Page 4 CSISS Center for Spatial Information Science and Systems Background The previous procedure of creating monthly report was laborious and time consuming 1)Analyze the log file in a Java program 2)Extract monthly statistics information from program output 3)Fill these information in a word document 4)Submit to CWIC website for review and comment Metrics information could not be presented interactively and responsively
Page 5 CSISS Center for Spatial Information Science and Systems System Architecture
Page 6 CSISS Center for Spatial Information Science and Systems Metrics Information Collection CWIC Mediator retrieve and store information in the format as seen below when handling CSW requests from clients and responses from integrated catalogs
Page 7 CSISS Center for Spatial Information Science and Systems Metrics Information Retrieval Six Java classes are defined to hold the requesting information for catalog, operation, output, country, and dataset.
Page 8 CSISS Center for Spatial Information Science and Systems Metrics Information Retrieval Free Java Packages used –RandomAccessFile in java.io - avoid repetitive analysis –MaxMind GeoIP - identify country information of CWIC client from its IP address –JSON.simple - encode and decode metrics information in JSON format
Page 9 CSISS Center for Spatial Information Science and Systems Metrics Information Retrieval
Page 10 CSISS Center for Spatial Information Science and Systems Metrics Information Retrieval Metrics information in JSON format –taking catalog access as an example date indicates the day to which the record applies failure means the numbered times of failed processing of that day success represents the ones of successful processing of that day visits is the total times of accesses to the specified catalog of that day
Page 11 CSISS Center for Spatial Information Science and Systems Metrics Information Representation Ext JS for building a responsive and intuitive Web dashboard like portal –free cross-browser AJAX framework –popular model-view-controller (MVC) pattern –a set of components, utilities, and APIs
Page 12 CSISS Center for Spatial Information Science and Systems Metrics Information Representation Data Flow among Components
Page 13 CSISS Center for Spatial Information Science and Systems Demonstration Two Instances Deployed on GMU CWIC Server and USGS CWIC Server – –
Page 14 CSISS Center for Spatial Information Science and Systems Demonstration CWIC Access Trends in 2013
Page 15 CSISS Center for Spatial Information Science and Systems Demonstration CWIC Service Performance in 2013
Page 16 CSISS Center for Spatial Information Science and Systems Demonstration Most Often Accessed Catalog and Dataset in 2013
Page 17 CSISS Center for Spatial Information Science and Systems Demonstration CWIC User Distribution in 2013
Page 18 CSISS Center for Spatial Information Science and Systems Demonstration GetCapabilities Access Trends and Performance by Day of Week in 2013
Page 19 CSISS Center for Spatial Information Science and Systems Demonstration GetRecords Access Trends and Performance by Day of Week in 2013
Page 20 CSISS Center for Spatial Information Science and Systems Demonstration GetRecordById Access Trends and Performance by Day of Week in 2013
Page 21 CSISS Center for Spatial Information Science and Systems Summary Drill-down into details of catalog and dataset Display detailed service metrics Provide powerful indicators of CWIC performance Filter metrics on-the-fly and update visit statistics automatically Create the periodical reports in seconds Provide interactive tables and graphs Offer complete and detailed traffic analysis
Page 22 CSISS Center for Spatial Information Science and Systems Future Work Add spatial extent and temporal range in the log file Track client information in the log file ( i.e. browser, CWIC Start, USGS LSI Explorer, Java or C Application etc) Use GeoIP to parse IP to city and organization level Identify unique visitors according to IP addresses View metrics information by time of day Categorize failures and count by categories Develop service of exporting chart as image (Sencha Web service, is not stable)
Page 23 CSISS Center for Spatial Information Science and Systems Future Work Questions or comments? Thanks!