Review of Mathematical and Statistical Models to Predict (Extrapolate) Water Levels and to Fill Gaps (Interpolate) of the TCOON Data Texas A&M University.

Slides:



Advertisements
Similar presentations
NEURAL NETWORKS Backpropagation Algorithm
Advertisements

What goes UP must come DOWN The mathematics of tide prediction Rex Boggs, Glenmore State High School Kiddy Bolger, The Rockhampton Grammar School.
PRESENTS: FORECASTING FOR OPERATIONS AND DESIGN February 16 th 2011 – Aberdeen.
FTP Biostatistics II Model parameter estimations: Confronting models with measurements.
Motivation The Carolinas has had a tremendous residential and commercial investment in coastal areas during the past 10 years. However rapid development.
Comparison of Gap Interpolation Methodologies for Water Level Time Series Using Perl/PDL By Aimee Mostella, Alexey Sadovski, Scott Duff, Patrick Michaud,
Machine Learning Neural Networks
Lecture 14 – Neural Networks
Neural Network Based Approach for Short-Term Load Forecasting
A Voyage of Discovery Physical oceanography Instructor: Dr. Cheng-Chien LiuCheng-Chien Liu Department of Earth Sciences National Cheng Kung University.
Correlational Designs
Statistical Methods for long-range forecast By Syunji Takahashi Climate Prediction Division JMA.
Radial Basis Function Networks
1 Prediction of Software Reliability Using Neural Network and Fuzzy Logic Professor David Rine Seminar Notes.
Oceanography 569 Oceanographic Data Analysis Laboratory Kathie Kelly Applied Physics Laboratory 515 Ben Hall IR Bldg class web site: faculty.washington.edu/kellyapl/classes/ocean569_.
Artificial Neural Networks (ANN). Output Y is 1 if at least two of the three inputs are equal to 1.
IE 585 Introduction to Neural Networks. 2 Modeling Continuum Unarticulated Wisdom Articulated Qualitative Models Theoretic (First Principles) Models Empirical.
Outline What Neural Networks are and why they are desirable Historical background Applications Strengths neural networks and advantages Status N.N and.
L 1 Chapter 12 Correlational Designs EDUC 640 Dr. William M. Bauer.
NREL is a national laboratory of the U.S. Department of Energy Office of Energy Efficiency and Renewable Energy operated by the Alliance for Sustainable.
Neural Networks - Berrin Yanıkoğlu1 Applications and Examples From Mitchell Chp. 4.
NEURAL NETWORKS FOR DATA MINING
Guidance on Intensity Guidance Kieran Bhatia, David Nolan, Mark DeMaria, Andrea Schumacher IHC Presentation This project is supported by the.
T EXAS C OASTAL O CEAN O BSERVATION N ETWORK D IVISION OF N EARSHORE R ESEARCH-DR.GARY JEFFRESS, DIRECTOR T EXAS A & M U NIVERSITY- C ORPUS C HRISTI HISTORY.
TCOON Station Review Dr. Gary Jeffress James Rizzo.
CONRAD BLUCHER INSTITUTE ACTIVITIES SUPPORTING TEXAS PORTS AND WATERWAYS OPERATIONS Two Inter-related Services to the Port Community: 1. The Texas Coastal.
Integration of Statistics and Harmonic Analysis to Predict Water Levels in Estuaries and Shallow Waters of the Gulf of Mexico Texas A&M University - Corpus.
` DIVISION OF NEARSHORE RESEARCH TEXAS A&M UNIVERSITY-CORPUS CHRISTI Key Features:  Located on oil production platforms 3 and 15 nautical miles from Port.
Statistical Tools for Solar Resource Forecasting Vivek Vijay IIT Jodhpur Date: 16/12/2013.
Modeling the upper ocean response to Hurricane Igor Zhimin Ma 1, Guoqi Han 2, Brad deYoung 1 1 Memorial University 2 Fisheries and Oceans Canada.
Neural Network Modeling of Spring Levels Linked to a Karst Aquifer: Case Study of the Comal Springs Dawn Lalmansingh, Philippe Tissot, Richard Hay Texas.
Statistical and Neural Network Analysis to Predict Water Levels in Estuaries and Shallow Waters of the Gulf of Mexico Texas A&M University - Corpus Christi.
Texas A&M University-Corpus Christi  Division of Near Shore Research Present Trends in the Application of Artificial Intelligence to Environmental Systems.
Division of Nearshore Research Texas Coastal Ocean Observation Network Dr. Gary Jeffress Mr. James Rizzo October 2003.
Division of Nearshore Research Texas Coastal Ocean Observation Network Dr. Gary Jeffress Dr. Patrick Michaud Jessica Tishmack May 7, 2003.
Akram Bitar and Larry Manevitz Department of Computer Science
U.S. HYDRO 2007 TIDES WORKSHOP May 17, 2006 UNCERTAINTY WORKSHOP SKGILL SLIDES.
V Bandi and R Lahdelma 1 Forecasting. V Bandi and R Lahdelma 2 Forecasting? Decision-making deals with future problems -Thus data describing future must.
Data was collected from various instruments. AOD values come from our ground Radiometer (AERONET) The Planetary Boundary Layer (PBL) height is collected.
Division of Nearshore Research TCOON Tides and Tide Forecasting Dr. Patrick Michaud October 27, 2003.
Neural Networks - Berrin Yanıkoğlu1 Applications and Examples From Mitchell Chp. 4.
Artificial Neural Networks Approach to Stock Prediction Presented by Justin Jaeck.
Lecture 5 Neural Control
CHEE825 Fall 2005J. McLellan1 Nonlinear Empirical Models.
Artificial Neural Networks (ANN). Artificial Neural Networks First proposed in 1940s as an attempt to simulate the human brain’s cognitive learning processes.
Downscaling Global Climate Model Forecasts by Using Neural Networks Mark Bailey, Becca Latto, Dr. Nabin Malakar, Dr. Barry Gross, Pedro Placido The City.
LOAD FORECASTING. - ELECTRICAL LOAD FORECASTING IS THE ESTIMATION FOR FUTURE LOAD BY AN INDUSTRY OR UTILITY COMPANY - IT HAS MANY APPLICATIONS INCLUDING.
Canadian Weather Analysis Using Connectionist Learning Paradigms Imran Maqsood*, Muhammad Riaz Khan , Ajith Abraham  * Environmental Systems Engineering.
NAME SINDHU.M.P SUBJECT SOCIAL STUDIES. HYDROSPHERE The hydrosphere ] in physical geography describes the combined mass of water found on, under, and.
Surface Current Mapping in the Lower Chesapeake Bay INTRODUCTION High frequency RADAR antennas are used to observe the surface circulation patterns in.
Regression Models for Predictions of Water Levels in the Shallow Waters of the Gulf of Mexico Kelly Torres Texas A&M University - Corpus Christi.
Data Mining: Concepts and Techniques1 Prediction Prediction vs. classification Classification predicts categorical class label Prediction predicts continuous-valued.
Business Intelligence and Decision Support Systems (9 th Ed., Prentice Hall) Chapter 6: Artificial Neural Networks for Data Mining.
Neural Networks - Berrin Yanıkoğlu1 MLP & Backpropagation Issues.
Lean Innovative Connected Vessels
of Temperature in the San Francisco Bay Area
Deep Feedforward Networks
Urban pollution modeling
“The Art of Forecasting”
A Simple Artificial Neuron
Wave height prediction in the Apostle Islands
with Daniel L. Silver, Ph.D. Christian Frey, BBA April 11-12, 2017
Texas Coastal Ocean Observation Network
Neural Networks and Their Application in the Fields of Coporate Finance By Eric Séverin Hanna Viinikainen.
Predicting Frost Using Artificial Neural Network
Texas Coastal Ocean Observation Network
Division of Nearshore Research TCOON
Texas Coastal Ocean Observation Network
Facultad de Ingeniería, Centro de Cálculo
Mazen Abualtayef Associate Prof., IUG, Palestine
Presentation transcript:

Review of Mathematical and Statistical Models to Predict (Extrapolate) Water Levels and to Fill Gaps (Interpolate) of the TCOON Data Texas A&M University - Corpus Christi 6300 Ocean Dr. Corpus Christi, Texas 78412, USA This year team: Alexey Sadovski Scott Duff Garry Jeffress Carl Steidley Philippe Tissot Beate Zimmer Zack Bowles David Beck Jeremy Flores Aimee Mostella Kelly Knott (Torres)

Project Goals Develop effective & reliable prediction tools Developed methods: – –Harmonic analysis – –Numerical methods based equations of hydrodynamics – –Statistical models – –Neural networks

Primary Water Level Water Temperature Wind Speed Wind Gust Wind Direction Typical TCOON station web page Typical TCOON station web page

Texas Coastal Ocean Observation Network Monitors water levels and other coastal parameters along the Texas coast

Tide Charts In general this is the first choice Astronomical forcing –Earth, Sun, Moon motions Limitations –Areas such as the Gulf of Mexico where the dominant forcing is meteorological in nature

Harmonic Analysis Standard method for tide predictions Represented by constituent cosine waves with known frequencies based on gravitational (periodic) forces Elevation of water is modeled as h(t) = H 0 +  H c f y,c cos(a c t + e y,c – k c ) h(t) = elevation of water at time t a c = frequency (speed) of constituent c f y,c e y,c = node factors/equilibrium arg-s H 0 = datum offset H c = amplitude of constituent c k c = phase offset for constituent c

Prediction vs. Observation It’s nice when it works…

Prediction vs. Observation …but it often doesn’t work in Texas

Water Levels Tides In Texas, meteorological factors have significant effect on water elevations

Two Reliable Statistical Models –Both are linear multi-regression models –Both deal with combinations of previous water levels only –Difference in models Between 4 and 8 variables in one kind of model, which takes into account first and second differences of water levels All 12 to 48 variables in the other models, in which only previous water levels are used

Statistical Models

One possible future application –Occasional losses of data Regression models, using forward and backward regression, evaluate lost data as a linear combination of forward and backward predictions with weights proportional to the distances from the edges of the gap

Factor Analysis Question: Why do models with only previous water levels work better than models with all data provided by TCOON stations? No more than 5 factors explain over 90% of variance for water levels

Bob Hall Pier (014)

Flower Garden (028)

Factor Analysis –In off-shore deep waters, the first two or three components are periodical –In coastal shallow waters and estuaries the major or the first component is not periodical –Our conclusion is that the prime factor is “weather” –Linear regression models for different locations have different coefficients for the same variables –This difference may be explained by the geography where the data is collected

Improved Predictions Model differences between the observed water levels and the harmonic predictions by using multiple regression (so-called marriage of harmonic and regression analysis) Build a model based on past observations; use that to make a model to predict differences in future observations

Statistical Models

Predicted Levels

Station 005: Packery Channel

Evaluation Criteria Criteria for the evaluation of water level forecasts –Different criteria were developed mostly by the U.S. National Oceanic and Atmospheric Administration (NOAA) to address the different priorities of coastal users

Evaluation Criteria Average error will address the possible bias of a model The absolute error will give information on the overall accuracy of the model Standard deviation will give information on the variability of the forecasts

Evaluation Criteria Specialized criteria,e.g., positive and negative outlier frequencies, will be useful to characterize model performance for unusually high or low water level situations Some forecasting methodologies will be better suited for some criteria and worse for others, e.g., predictions based on harmonic analysis are very good when evaluated by the standard deviation criteria and not as good when using the absolute error criteria.

Rockport (015) Training Set - March 2003 Prediction for 48 hours

Bob Hall Pier (014) Training Set - March 2003 Prediction for 24 hours

Basic Algorithm Retrieve data according to user provided parameters Search data for missing values Perform linear regression to obtain two sets of coefficients Calculate missing values with coefficients Combine two sets into one Insert new values in place of missing data

Water Level RWL = AWL - HWL –RWL => Residual Water Level –AWL => Actual Water Level –HWL => Harmonic Water Level Record the location of gaps in the AWL Record the difference between AWL and HWL as the RWL

Linear Regression For each gap in the data –Perform forward and backward linear regression (FLR & BLR, respectively) using hourly data to obtain coefficients –Calculate the missing data points with these coefficients

Methods of Combination Combine the results of FLR & BLR using one of the following methods: –Convex linear combination Based on weighted proportion –Convex trigonometric combination Based on trigonometrically weighted proportion –Combination at intersection Fuse together at the intersection

Results

Effect of Number of Coefficients Timing was negligible Accuracy peaked and then declined depending upon weather conditions RMSE was used to determine the optimal number of coefficients

Coefficients Figure 1 displays our chosen coefficients according to weather condition Although these coefficients are optimal, the accuracy of interpolation still declines as weather becomes more extreme

Artificial Neural Network Modeling Started in the 60’s Key innovation in the late 80’s: backpropagation learning algorithms Number of applications has grown rapidly in the 90’s especially financial applications Growing number of publications presenting environmental applications

Why ANN’s? Modeled after human brain Neurons compute outputs (forecasts) based on inputs, weights and biases Able to model non-linear systems

Neural Network Features Non-linear modeling capability as well as generic modeling capability Robustness to noisy data Ability for dynamic learning Limitation: Requires availability of high density of data

Artificial Neural Network Setup ANN models developed within the Matlab and Matlab NN Toolbox environment Found simple ANNs are optimum Use of ‘tansig’ and ‘purelin’ functions Use of Levenberg-Marquardt training algorithm ANN trained over 1 year of hourly data (8760 observations)

Transform Functions Tansig Purelin y = x y =(e x – e -x )/(e x + e -x )

Optimum ANN Structure Simple ANNs work best: 1 hidden neuron and 1 output neuron Optimum number of previous water level inputs varies between 3 and 24 hours Optimum number of previous wind measurement inputs varies between 1 and 12 hours Actual number of inputs chosen does not significantly change model performance

ANN schematic Philippe Tissot H (t+i) Output LayerHidden Layer Wind Squared History Water Level History Input Layer Water Level Forecast  (a 1,i x i ) b1b1 b2b2  (X 1 +b 1 ) b3b3  (X 2 +b 2 )  (X 3 +b 3 )  (a 2,i x i )  (a 3,i x i ) Tidal Forecasts

Model Assessment Based on five 1-year data sets: ‘97, ‘98, ’99, ’00, ‘01 including observed water levels and winds, and tide forecasts Based on five 1-year data sets: ‘97, ‘98, ’99, ’00, ‘01 including observed water levels and winds, and tide forecasts Train the ANN model using one data set e.g. ‘97 for each hourly forecast target, e.g. 12 hours Train the ANN model using one data set e.g. ‘97 for each hourly forecast target, e.g. 12 hours Apply the ANN model to the other four data sets, Apply the ANN model to the other four data sets, Repeat the performance analysis for each training year and forecast target and compute the model performance and variability Repeat the performance analysis for each training year and forecast target and compute the model performance and variability

Artificial Neural Network forecasting of water levels Use historical time series of previous water levels, winds, barometric pressure as input Train neural network to associate changes in inputs and future water level changes Create water level forecasts using a static neural network model

ANN Inputs Tested model with input from different locations: –Rockport only –Rockport with Port Aransas (Ship channel) –Rockport with Bob Hall Pier (Coastal station) Tested model with different meteorological time series: –Water Level only –Water Level and Previous Wind measurements –Water Level, Previous Wind, and Wind Forecasts

Training with one set (X = 15cm) Morgan’s Point

Tropical Storms Tropical storms are a challenge for any predictive model They are relatively infrequent and unique As storms are often destructive, improved predictions are very useful to emergency management

Performance applied to 1998 Hours (1998) Water level (m)

Tropical Storm Frances - September 7-17, 1998 Frances Trajectory Landfall on Sept. 11

Forecasts in storm events Rockport ANN 24-hour Forecasts During 1998 Tropical Storm Frances (ANN trained over 1997 Data Set)

New Directions and Problems Statistics on ANN structures. New feedback functions and optimal criteria for ANN to improve prediction quality. Evaluating quality and quantity of information produced by ANN during training and predictions using ergodic and entropy analysis. Spatial-temporal analysis (statistics) of data from stations in and around Corpus Christi Bay and Galveston Bay. Dynamic models of the water levels (Integral-differential equations with boundary values).

New Directions and Problems Visualization and simulation of water levels. Predictions during tropical storms using as inputs the first, the second, and the third differences of water levels. Optimal control in multi-species models for fisheries and fish harvesting. Spectral analysis of stochastic processes based on TCOON data. Developing of the theory of quasi-periodic functions. Development of mathematics for autonomous boat.

Acknowledgments The presented work is funded in part by the following federal and state agencies of the USA: –National Aeronautic and Space Agency (NASA Grant #NCC5-517) –National Oceanic and Atmospheric Administration (NOAA) –Texas General Land Office –Coastal Management Program (CMP)

Resources Division of Nearshore Research Website TCOON Data Query Page Web-based Predictions Development Page