Use of spectral preprocessing to obtain a common basis for robust regression 5 spectral preprocessing combinations gave significantly higher RPDs (α =

Slides:



Advertisements
Similar presentations
Design of Experiments Lecture I
Advertisements

Multiple Analysis of Variance – MANOVA
QR Code Recognition Based On Image Processing
VSMC MIMO: A Spectral Efficient Scheme for Cooperative Relay in Cognitive Radio Networks 1.
Phytoplankton absorption from ac-9 measurements Julia Uitz Ocean Optics 2004.
Quantifying soil carbon and nitrogen under different types of vegetation cover using near infrared-spectroscopy: a case study from India J. Dinakaran*and.
Establishing the Integrity of Data:
Challenge the future Delft University of Technology Blade Load Estimations by a Load Database for an Implementation in SCADA Systems Master Thesis.
P M V Subbarao Professor Mechanical Engineering Department
Environmental Data Analysis with MatLab Lecture 23: Hypothesis Testing continued; F-Tests.
World Health Organization
A NEW PERSPECTIVE TO VISIBLE NEAR INFRARED REFLECTANCE SPECTROSCOPY: A WAVELET APPROACH Yufeng Ge, Cristine L.S. Morgan, J. Alex Thomasson and Travis Waiser.
Predicting TOR OC and EC from FT-IR Spectra of IMPROVE samples Ann M. Dillner Assoc. Research Scientist University of California, Davis Satoshi Takahama.
Pre-processing of NIR Åsmund Rinnan.
Curve-Fitting Regression
Elaine Martin Centre for Process Analytics and Control Technology University of Newcastle, England The Conjunction of Process and.
Preprocessing With focus on NIR
Copyright © 2006 The McGraw-Hill Companies, Inc. Permission required for reproduction or display. by Lale Yurttas, Texas A&M University Chapter 171 CURVE.
,. Sugar measurements in soybeans using Near Infrared Spectroscopy Introduction  Soluble carbohydrates are the third compound of soybeans by weight (11%),
Assigning Numbers to the Arrows Parameterizing a Gene Regulation Network by using Accurate Expression Kinetics.
Detecting the Domain Structure of Proteins from Sequence Information Niranjan Nagarajan and Golan Yona Department of Computer Science Cornell University.
Stat 112: Lecture 9 Notes Homework 3: Due next Thursday
1 Chapter 17: Introduction to Regression. 2 Introduction to Linear Regression The Pearson correlation measures the degree to which a set of data points.
AE 469/569 TERM PROJECT DEVELOPING CORRECTION FUNCTION FOR TEMPERATURE EFFECTS ON NIR SOYBEAN ANALYSIS Jacob Bolson Maureen Suryaatmadja Agricultural Engineering.
Calibration & Curve Fitting
, Materials and methods Samples  Set of 28 pipes from 5 major manufacturers, with triplicates from each pipe  6 diameter sizes (½” – 2”) Reference data.
Walloon Agricultural Research Center Walloon Agricultural Research Center, Quality Department Chaussée de Namur, 24 – 5030 GEMBLOUX - Tél :++ 32 (0) 81.
Prediction of PVC pipes performance under permeation conditions L. Esteve Agelet 1, C. R. Hurburgh 1 Jr., F. Mao 2, and J. A. Gaunt 2 Department of Agricultural.
Permeation is the passage of contaminants through porous and non-metallic materials. Permeation phenomenon is a concern for buried waterlines where the.
Marketing Research Aaker, Kumar, Day and Leone Tenth Edition
Aircraft Characterization in Icing Using Flight Test Data Ed Whalen University of Illinois Urbana Champaign 42 nd Annual Aerospace Sciences Conference.
Error Analysis Accuracy Closeness to the true value Measurement Accuracy – determines the closeness of the measured value to the true value Instrument.
Introduction Stomatal conductance regulates the rates of several necessary processes in plants including transpiration, carbon dioxide assimilation, and.
Copyright © The McGraw-Hill Companies, Inc. Permission required for reproduction or display. 1 Part 4 Curve Fitting.
Education Research 250:205 Writing Chapter 3. Objectives Subjects Instrumentation Procedures Experimental Design Statistical Analysis  Displaying data.
Analyzing and Interpreting Quantitative Data
© 2004 Prentice-Hall, Inc. Chapter 7 Demand Forecasting in a Supply Chain Supply Chain Management (2nd Edition) 7-1.
© 2013 Cengage Learning. All Rights Reserved. May not be scanned, copied or duplicated, or posted to a publicly accessible website, in whole or in part.
Metabolomics Metabolome Reflects the State of the Cell, Organ or Organism Change in the metabolome is a direct consequence of protein activity changes.
This material is approved for public release. Distribution is limited by the Software Engineering Institute to attendees. Sponsored by the U.S. Department.
Chapter 16 Data Analysis: Testing for Associations.
Sources of noise in instrumental analysis
Chimiometrie 2009 Proposed model for Challenge2009 Patrícia Valderrama
Slide 1 NATO UNCLASSIFIEDMeeting title – Location - Date Satellite Inter-calibration of MODIS and VIIRS sensors Preliminary results A. Alvarez, G. Pennucci,
THE HYPERSPECTRAL IMAGING APPROACH
QUANTITATIVE ANALYSIS OF POLYMORPHIC MIXTURES USING INFRARED SPECTROSCOPY IR Spectroscopy Calibration –Homogeneous Solid-State Mixtures –Multivariate Calibration.
BME 353 – BIOMEDICAL MEASUREMENTS AND INSTRUMENTATION MEASUREMENT PRINCIPLES.
Tutorial I: Missing Value Analysis
Measuring Soil Properties in situ using Diffuse Reflectance Spectroscopy Travis H. Waiser, Cristine L. Morgan Texas A&M University, College Station, Texas.
Evaluation of soil and vegetation salinity in crops lands using reflectance spectroscopy. Study cases : cotton crops and tomato plants Goldshleger Naftaly.
Data collection  Triticale samples from 2002 to 2005 (Iowa, USA).  Foss Infratec™ 1241 (transmittance instrument).  Crude protein analysis by AACC Method.
Standardization of NIR Instruments: How Useful Are the Existing Techniques? Benoit Igne Glen R. Rippke Charles.
, Maureen Suryaatmadja 1 Dr. Charles R Hurburgh 1 Jr. Department of Agricultural and Biosystems Engineering.
Date of download: 5/29/2016 Copyright © 2016 SPIE. All rights reserved. Number of expected scans and percentage of processed scans for all four instruments.
Date of download: 6/22/2016 Copyright © 2016 SPIE. All rights reserved. Glucose sensor architecture. The lamp provides broadband electromagnetic radiation.
Date of download: 6/22/2016 Copyright © 2016 SPIE. All rights reserved. Schematic representation of the near-infrared (NIR) structured illumination instrument,
Ch 1. Introduction Pattern Recognition and Machine Learning, C. M. Bishop, Updated by J.-H. Eom (2 nd round revision) Summarized by K.-I.
Background and purpose
Matteo Reggente Giulia Ruggeri Satoshi Takahama
M.L. Amodio, F. Piazzolla, F. Colantuono, G.Colelli
Part 5 - Chapter
Term project for the coursework AE 569
Development of PAT tools using guided microwave spectroscopy and chemometrics for meat and dairy processing applications Ming Zhao,¹ Bhavya Panikuttira,¹.
Part 5 - Chapter 17.
1 2 3 INDIAN INSTITUTE OF TECHNOLOGY ROORKEE PROJECT REPORT 2016
AC-9/AC-S data analysis from CDOM Lab
Regression Computer Print Out
Part 5 - Chapter 17.
CHAPTER- 17 CORRELATION AND REGRESSION
Inferential Statistics
Presentation transcript:

Use of spectral preprocessing to obtain a common basis for robust regression 5 spectral preprocessing combinations gave significantly higher RPDs (α = 5%): Second derivative (25-point window) + Normalization. SNV + Second derivative (25-point window) + Normalization. MSC + Second derivative (25-point window) + Normalization. Second derivative (25-point window) + Normalization + OSC + Autoscaling. Second derivative (25-point window) + GLSW + Normalization + Mean-Center. The five combinations were averaged and compared to other standardization techniques. Comparison among standardization techniques Figures 1 and 2 show results obtained when predicting validation sets where Foss Infratec 1241 and Dickey-john OmegAnalyzer G 6118 were respective network masters. PDS and DS gave significantly lower RPDs. Other techniques were not significantly different. Network master’ RPDs were significantly higher. Among common standardization techniques, post- regression correction gave as good or better results than individual models (developed on their own calibration set). Robust techniques also gave as good or better results than other techniques in 6 of 8 cases. Calibration transfer from Foss Infratec to Dickey-john OmegAnalyzer G gave more precise validation results than the reverse case. Data Preprocessing for common basis Baseline and Offset Correction: Smoothing / Derivative. Detrending. Weighted Least Squares Baseline. Sample Normalization or Light Scattering Correction: Normalization. Standard Normal Variate (SNV). Multiplicative Scatter Correction (MSC). Interference Removal or Multivariate filtering: Orthogonal Signal Correction (OSC). Generalized Least Squares Weighting (GLSW). Variable Scaling: Mean-Center. Autoscaling. All reasonable and meaningful spectral pretreatment combinations were evaluated (n = 75). Common Standardization techniques Optical Techniques: Direct Standardization (DS) and Piecewise Direct Standardization (PDS). Post-Regression Correction: Slope and Offset; and Bias Only. The transfer of calibration models without any standardization procedure was also considered. All models using common standardization techniques and when each instrument was developed on their own calibration set used 2 nd derivative (25 point window) + Normalization + Autoscale as spectral pretreatment. Model comparison RPD: Ratio of standard error of prediction to standard deviation of reference values. RPD allows rapid comparison between models validated on the same set. Software MATLAB v (The MathWorks,Inc., Natick, MA). PLS_Toolbox (Eigenvector Research, Inc., Wenatchee, WA). JMP v (SAS Institute Inc., Cary, NC). Robust Regression for Inter-Brand Standardization Benoit Igne Glen R. Rippke Charles R. Hurburgh, Jr. Department of Agricultural and Biosystems Engineering, Iowa State University, Ames, Iowa. Introduction Objectives Materials and Methods Conclusions Procedure The transfer of calibrations from instrument to instrument is an important research area. Many methods have been developed to transfer a prediction model from a master unit to a secondary unit: Optical techniques (Piecewise Direct Standardization, Direct Standardization) Post-regression correction techniques (slope and bias or bias only correction) Model adaptation techniques (robust regression) The new challenge is to transfer calibration across brands. Robust models are attractive because they allow the use of historical databases and the use of the same samples scanned on different instruments. Robust models often increase the prediction error because they add additional noise. 1.Evaluate the use of preprocessing techniques in the creation of robust models for inter-brand standardization. 2.Compare results with standardization performance of known standardization techniques. Data collection Soybean Samples (whole): Calibration set: 638 samples from 2002 to 2006 crop years. Two validation sets: Set 1: 20 samples representative of the variability of the calibration set. Set 2: 40 very diverse samples from the 2006 crop year. Spectral data: Four transmittance units, spectral range: 850 – 1048 nm with 2 nm increment. 2 Foss Infratec™ (Foss North America, Eden Prairie, MN): Foss Infratec™ 1229 (S/N: ) and Foss Infratec™ 1241 (S/N: ). 2 Dickey-john/Bruins OmegAnalyzer G (Dickey-john ® Corporation, Auburn, IL): S/N and Reference analysis: Protein content by combustion (AOAC ), Eurofins, Des Moines. Oil content by ether extract (AOCS Ac 3-44), Eurofins, Des Moines. Calibration method Partial Least Squares Regression (PLS). Robust Regression Two types of robust models were created: Combine historical databases of each brand master. Use historical database of one brand master. Models were developed on a common spectral basis obtained using spatial spectral pretreatments. Results 1.Establish baseline calibration performance when each instrument is calibrated on its own calibration set. 2.Apply common standardization techniques to inter-brand standardization (Infratec 1241 and OmegAnalyzer G were brand masters). 3.Compare inter-brand standardization results developed from the best spectral preprocessing combinations with common standardization results. The calculation of intermediate standardization parameters for optical techniques (DS, PDS) increased the error. Results from other standardization techniques were similar across standardization sets and instruments. The transformation of spectral data to a common basis by preprocessing techniques (before robust regression) gave the best results in 75% of the cases. The transfer of historical databases from one instrument brand to another was proven possible, with or without spectral data from the secondary brand, using robust regressions developed on a common basis obtained by spatial spectral pretreatment. Figure 1: Foss Infratec 1241 as Overall Master for Common Methods.Figure 2: Dickey-john OmegAnalyzer G as Overall Master for Common Methods. Legend: