A Web-based Visualization and Analysis System for Watershed Management

Slides:



Advertisements
Similar presentations
RbitPoint Computer Network Monitoring Software Complete Software Solution for Controlling all computers from your desk www. samaysoftware. net.
Advertisements

Components of GIS.
17th February, 2000 by Maciej Korzeniowski (CERN-IT-IA-MI) 1 Oracle Discoverer Product Presentation  This is an ad hoc query and analysis tool for.
ESafe Reporter V3.0 eSafe Learning and Certification Program February 2007.
Standa Vaněček The potential of Integrated Modelling and the OpenMI Standa Vaněček DHI, Chairman of the OATC.
CONTACTLESS Advanced punch-card system SYCAPS – Proximity Time Recorder.
C van Ingen, D Agarwal, M Goode, J Gupchup, J Hunt, R Leonardson, M Rodriguez, N Li Berkeley Water Center John Hopkins University Lawrence Berkeley Laboratory.
A.Q.M.E.I.S.: Air Quality Meteorological and Environmental Information System in Western Macedonia, Hellas International Conference on Buildings Energy.
Harlan Shannon Meteorologist U.S. Department of Agriculture Office of the Chief Economist World Agricultural Outlook Board Washington D.C., U.S.A. An Overview.
Managing Data Resources
Design of Web-based Systems IS Development: lecture 10.
Classifier Decision Tree A decision tree classifies data by predicting the label for each record. The first element of the tree is the root node, representing.
Introduction to Web Base Multimedia Application. Web base application TCP/IP (HTTP) protocol Using WWW technology & software Distributed environment.
Chapter 4: Database Management. Databases Before the Use of Computers Data kept in books, ledgers, card files, folders, and file cabinets Long response.
Chapter 9 Database Design
Professor Michael J. Losacco CIS 1150 – Introduction to Computer Information Systems Databases Chapter 11.
DASHBOARDS Dashboard provides the managers with exactly the information they need in the correct format at the correct time. BI systems are the foundation.
Data Warehousing: Defined and Its Applications Pete Johnson April 2002.
Slide 1 of 9 Presenting 24x7 Scheduler The art of computer automation Press PageDown key or click to advance.
LÊ QU Ố C HUY ID: QLU OUTLINE  What is data mining ?  Major issues in data mining 2.
© Crown copyright 2012 Met Office Weather Observations Website (WOW) Aidan Green, 17 th October Introducing the.
1 Introduction to Web Development. Web Basics The Web consists of computers on the Internet connected to each other in a specific way Used in all levels.
Kening Wang, Charles Stegman, Sean W. Mulvenon, and Yanling Xia University of Arkansas, Fayetteville, AR, Using Kriging and Interactive Graphics.
OLAM and Data Mining: Concepts and Techniques. Introduction Data explosion problem: –Automated data collection tools and mature database technology lead.
Data Mining Techniques
INTRODUCTION TO WEB DATABASE PROGRAMMING
1 Network Statistic and Monitoring System Wayne State University Division of Computing and Information Technology Information Technology.
GIS Application in Firewall Security Log Visualization Juliana Lo.
Database System Concepts and Architecture Lecture # 3 22 June 2012 National University of Computer and Emerging Sciences.
ROOT: A Data Mining Tool from CERN Arun Tripathi and Ravi Kumar 2008 CAS Ratemaking Seminar on Ratemaking 17 March 2008 Cambridge, Massachusetts.
Ihr Logo Chapter 5 Business Intelligence: Data Warehousing, Data Acquisition, Data Mining, Business Analytics, and Visualization Turban, Aronson, and Liang.
Workshop on DEVELOPING REGIONAL COOPERATION FOR SHARED KARST AQUIFER MANAGEMENT IN SEE June 2008 Thessaloniki, Greece Monitoring data and existing.
Course Presentation EEL5881, Fall, 2003 Project: Network Reliability Tests Project: Network Reliability Tests Team: Gladiator Team: Gladiator Shuxin Li.
Budget Module For Sage MIP Fund Accounting. Sage Requirements Fund Accounting 10.0 or higher Budget Module optional but required for multiple budget versions.
1 Adapted from Pearson Prentice Hall Adapted form James A. Senn’s Information Technology, 3 rd Edition Chapter 7 Enterprise Databases and Data Warehouses.
Chapter 6 SAS ® OLAP Cube Studio. Section 6.1 SAS OLAP Cube Studio Architecture.
California Data Exchange Center Hydrologic Database System
© 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang 5-1 Chapter 5 Business Intelligence: Data.
A Self-Manageable Infrastructure for Supporting Web-based Simulations Yingping Huang Xiaorong Xiang Gregory Madey Computer Science & Engineering University.
Professor Michael J. Losacco CIS 1110 – Using Computers Database Management Chapter 9.
1 Welcome to CSC 301 Web Programming Charles Frank.
Ihr Logo Chapter 5 Business Intelligence: Data Warehousing, Data Acquisition, Data Mining, Business Analytics, and Visualization Turban, Aronson, and Liang.
Data Preprocessing Dr. Bernard Chen Ph.D. University of Central Arkansas Fall 2010.
9 Systems Analysis and Design in a Changing World, Fourth Edition.
Chapter 5: Business Intelligence: Data Warehousing, Data Acquisition, Data Mining, Business Analytics, and Visualization DECISION SUPPORT SYSTEMS AND BUSINESS.
SmartReport Backend Reporting Tool © 2003 ITC Software
Accessing and Using Fire-Related Data with the CAPITA DataFed.net* Services Framework Stefan Falke Rudolf Husar Kari Hoijarvi Washington University in.
Distributed Data Analysis & Dissemination System (D-DADS ) Special Interest Group on Data Integration June 2000.
Evaluation of DBMiner By: Shu LIN Calin ANTON. Outline  Importing and managing data source  Data mining modules Summarizer Associator Classifier Predictor.
REPORTING SOFTWARE for BUILDING & INDUSTRIAL AUTOMATION.
WP1 WP2 WP3 WP4 WP5 COORDINATOR WORK PACKAGE LDR RESEARCHER ACEOLE MID TERM REVIEW CERN 3 RD AUGUST 2010 Magnoni Luca Early Stage Researcher WP5 - ATLAS.
An Integrated Fire, Smoke and Air Quality Data & Tools Network Stefan Falke and Rudolf Husar Center for Air Pollution Impact and Trend Analysis Washington.
1 Chapter Overview Monitoring Access to Shared Folders Creating and Sharing Local and Remote Folders Monitoring Network Users Using Offline Folders and.
STREAMLINING STORM WATER PERMIT IMPLEMENTATION THROUGH USE OF AN INFORMATION MANAGEMENT SYSTEM April 8, 2004 Presented by John W. Hart 30 th Environmental.
2.0 PROJECT INITIATION AND PLANNING The initiating and planning are the phase where process or workflow to develop the system will identify and planning.
Deck off cards Draft 2 Insert Your Name. Product Overview QlikView Developer Development tool to create data model and graphical interface QlikView Server.
Copyright © 2016 Pearson Education, Inc. Modern Database Management 12 th Edition Jeff Hoffer, Ramesh Venkataraman, Heikki Topi CHAPTER 11: BIG DATA AND.
Managing Data Resources File Organization and databases for business information systems.
1 Chapter 1 INTRODUCTION TO WEB. 2 Objectives In this chapter, you will: Become familiar with the architecture of the World Wide Web Learn about communication.
BLUEcloud ANALYTICS COSI Conference 2014 DEBORA WELLEN
Chapter 2 Database System Concepts and Architecture
Software Design and Architecture
Datamining : Refers to extracting or mining knowledge from large amounts of data Applications : Market Analysis Fraud Detection Customer Retention Production.
Copyright © 2011 Pearson Education, Inc. Publishing as Pearson Addison-Wesley Chapter 2 Database System Concepts and Architecture.
Data Mining: Concepts and Techniques Course Outline
Corps Water Management System (CWMS) Modernization
CHAPTER 7: Information Visualization
SOFTWARE DEVELOPMENT LIFE CYCLE
Sending data to EUROSTAT using STATEL and STADIUM web client
Presentation transcript:

A Web-based Visualization and Analysis System for Watershed Management Yufeng Kou, Chang-Tien Lu Dept. of Computer Science Virginia Tech Thomas Grizzard, Adil Godrej, Harold Post Dept. of Civil Engineering Virginia Tech

Outline Introduction System Architecture System Demonstration Future Work Summarization

Introduction: Objective of the system Build a comprehensive database of water information in the Occoquan Basin Surface water, Ground water, Water quality Report impact of extreme weather incidents on Occoquan water system Flooding, draught, storm

Objective of the system Water quality surveillance and evaluation Chemical pollutant density High efficiency data operation and dissemination Real time data collection Internet-based online information publication

Outline Introduction System Architecture System Demonstration Future Work Summarization

Hardware Architecture Real-time Data collecting System Connect monitoring stations to central database via telephone line Data collecting: every 15 minutes Web-based Information Publication Maintain duplicate databases: Master database: collect data from monitoring stations Slave database: A copy of master database Web server

Software Architecture Standard 3-tier System Thin client All the computation and maintenance are on server side High performance Efficient for data centric tasks

Software Architecture Automatic Data Synchronization Master database  Slave database By a FTP client programmed with Java Transfer action is triggered periodically by “Scheduled Task” in Windows 2003 Only the increment of data is transmitted Set firewall to ensure security

Software Architecture Database system Visual Foxpro 7.0 Water data database: flow, stage, … Station database: location, description, … User database: name, password, contact information, … Development Tools ASP, HTML, Javascript Java Applet, Java Servlet, Javascript

Outline Introduction System Architecture System Demonstration Future Work Summarization

System Demonstration: GUI

System Demonstration: Data comparison between stations Located upstream of Bull Run Peak flow detected at 7AM, Jan 14, 2004 ST45: Located downstream of Bull Run Peak flow detected at 5AM, Jan 14, 2004 9 Hour gap Useful for flood prediction

System Demonstration: Linear scale vs Log scale Suitable for data with small variance Details lost when plotting data with large variance Log Scale: Suitable for data with large variance Details retained for the value between the maximum and the minimum Not good for data with small variance

System Demonstration: Statistics from historical data 50 year flow data Minimum flow Maximum flow Average flow Help find interesting patterns 1980 is a dry year 1973 is a rainy year

System Demonstration: Data Cube Generate the union of a set of alpha-numeric summary tables corresponding to a given hierarchy Provide an aggregation view for different dimensions Usually aggregate temporal property to different granularities Or aggregate temporal dimension with spatial dimension

Data Cube: Stations vs Day of Month Water flow data for 7 stations in April, May, and June 2004 Show the flow fluctuation of multiple stations in a single figure High flow values are identified, for example By ST01 on April 13th ,14th; By ST01 and ST10 on May 8th and 9th By ST01 and ST10 on June 18th and 19th

Data Cube: Time of Day vs Day of Month Water flow data for ST70 in April, May, and June 2004 Clearly show the flow fluctuation at a specific time on a specific day High flow values are identified 20PM-24PM, on April 12th; 0-3AM and 19-24PM, on April 13th 0AM-12AM, on April 14

Data Cube: Years vs Day of Year Water 53 year flow data for ST70 High flow values are identified Near the 150th day of year

Outline Introduction System Architecture System Demonstration Future Work Summarization

More visualization methods Future Work More visualization methods 3-D representation Both spatial attribute and non-spatial attributes Animation Graphic tools for data comparison Histogram, bar chart, pie chart, 2-D and 3-D colormap Apply Data Mining Techniques Frequent Pattern Detection Discover the area flooded frequently in the past 30 years Abnormal Pattern Detection Find a week in which flow changes dramatically compared with flow in the immediate adjacent weeks

Future Work Apply Data Mining Techniques Similarity Search Find two similar pollutant leak accidents according to their impacts on the Occoquan water quality Association Rule Formulation Explore the relationship among temperature, humidity, and stage fluctuation Build a decision support system Combine GIS, Meteorological, Transportation, Economics, and Water monitoring data Generate a comprehensive model Rule-based system, Neural network, or Decision Tree Predict damage of the incoming calamity and provide corresponding decision support

Summarization Propose a web-based visualization and analysis system Has been successfully used for watershed management Based on a 3-tier client/server architecture Near real-time data collection and dissemination Support multiple visualization methods Table, figure, and data cube Support download data as text file, PDF, or JPEG Future direction Add more visualization methods Add data mining functionalities

Any comment is appreciated. Thank you ! Any comment is appreciated. ykou@cs.vt.edu