Course survey: what has been done, and what should be done

Slides:



Advertisements
Similar presentations
Workshop in Esbjerg Course survey: what has been done, and what should be done Semenov Institute of Chemical Physics Russian Chemometrics Society.
Advertisements

13-Jun-14ASQ-FDC\FDA Conference Process Analytical Technology: What you need to know Frederick H. Long, Ph.D. President, Spectroscopic Solutions
Multivariate Statistical Process Control and Optimization
Application of NIR for counterfeit drug detection Another proof that chemometrics is usable: NIR confirmed by HPLC-DAD-MS and CE-UV Institute of Chemical.
PCA for analysis of complex multivariate data. Interpretation of large data tables by PCA In industry, research and finance the amount of data is often.
Regression analysis Relating two data matrices/tables to each other Purpose: prediction and interpretation Y-data X-data.
Pattern Recognition for the Natural Sciences Explorative Data Analysis Principal Component Analysis (PCA) Lutgarde Buydens, IMM, Analytical Chemistry.
Software Quality Ranking: Bringing Order to Software Modules in Testing Fei Xing Michael R. Lyu Ping Guo.
1 Simple Interval Calculation (SIC-method) theory and applications. Rodionova Oxana Semenov Institute of Chemical Physics RAS & Russian.
1 Status Classification of MVC Objects Oxana Rodionova & Alexey Pomerantsev Semenov Institute of Chemical Physics Russian Chemometric Society Moscow.
Two cases of chemometrics application in protein crystallography European Molecular Biology Laboratory (EMBL), Hamburg, Germany Andrey Bogomolov.
WSC-6 Critical levels in projection Alexey Pomerantsev Semenov Institute of Chemical Physics, Moscow.
The rank of a product of two matrices X and Y is equal to the smallest of the rank of X and Y: Rank (X Y) =min (rank (X), rank (Y)) A = C S.
4 Th Iranian chemometrics Workshop (ICW) Zanjan-2004.
CALIBRATION Prof.Dr.Cevdet Demir
Dimension reduction : PCA and Clustering Christopher Workman Center for Biological Sequence Analysis DTU.
PATTERN RECOGNITION : PRINCIPAL COMPONENTS ANALYSIS Prof.Dr.Cevdet Demir
Chapter 2 Dimensionality Reduction. Linear Methods
Chemometric tutorials and courses in the Internet -a review.
A project proposals Distance learning center on Chemometrics.
Workshop at VUT Chemometrics in Excel Semenov Institute of Chemical Physics Russian Chemometrics Society Alexey Pomerantsev, Oxana Rodionova.
Spectroscopy Chromatography PhysChem Naming Drawing and Databasing Enterprise Solutions Software for Interactive Curve Resolution using SIMPLISMA Andrey.
Chemometric functions in Excel
Project: Distance Learning Course in Chemometrics for Technological and Natural-Science Mastership Education Grant awarded by the Nordic Council of Ministers.
Interactive Series Baseline Correction Algorithm
The Unscrambler ® A Handy Tool for Doing Chemometrics Prof. Waltraud Kessler Prof. Dr. Rudolf Kessler Hochschule Reutlingen, School of Applied Chemistry.
WSC-4 Simple View on Simple Interval Calculation (SIC) Alexey Pomerantsev, Oxana Rodionova Institute of Chemical Physics, Moscow and Kurt Varmuza.
THE ANALYSIS OF FRACTURE SURFACES OF POROUS METAL MATERIALS USING AMT AND FRACTAL GEOMETRY METHODS Sergei Kucheryavski Artem Govorov Altai State University.
Mingyang Zhu, Huaijiang Sun, Zhigang Deng Quaternion Space Sparse Decomposition for Motion Compression and Retrieval SCA 2012.
This supervised learning technique uses Bayes’ rule but is different in philosophy from the well known work of Aitken, Taroni, et al. Bayes’ rule: Pr is.
CLASSIFICATION. Periodic Table of Elements 1789 Lavosier 1869 Mendelev.
PATTERN RECOGNITION : CLUSTERING AND CLASSIFICATION Richard Brereton
Definition and overview of chemometrics. Paul Geladi Head of Research NIRCE Chairperson NIR Nord Unit of Biomass Technology and Chemistry Swedish University.
EIGENSYSTEMS, SVD, PCA Big Data Seminar, Dedi Gadot, December 14 th, 2014.
Elements of Pattern Recognition CNS/EE Lecture 5 M. Weber P. Perona.
PATTERN RECOGNITION : PRINCIPAL COMPONENTS ANALYSIS Richard Brereton
Principal Component Analysis (PCA)
Principal Component Analysis Zelin Jia Shengbin Lin 10/20/2015.
Applying MetaboAnalyst
Introduction to Programming on MATLAB Ecological Modeling Course Sep 11th, 2006.
1 Statistics & R, TiP, 2011/12 Multivariate Methods  Multivariate data  Data display  Principal component analysis Unsupervised learning technique 
Dual data driven SIMCA as a one-class classifier WSC-9 Alexey Pomerantsev ICP RAS.
Unsupervised Learning II Feature Extraction
Self-Modeling Curve Resolution and Constraints Hamid Abdollahi Department of Chemistry, Institute for Advanced Studies in Basic Sciences (IASBS), Zanjan,
Introduction to Matlab
Refitting PCA/MPCA and CLS/PARAFAC Models to Incomplete Data Records
Background on Classification
Exploring Microarray data
How to solve authentication problems
School of Computer Science & Engineering
ASTER image – one of the fastest changing places in the U.S. Where??
Dimensionality Reduction
Curve fitting methods for complex and rank deficient chemical data
Lecture 8:Eigenfaces and Shared Features
The Elements of Statistical Learning
Principal Component Analysis (PCA)
Machine Learning Dimensionality Reduction
Multi-class PLS-DA: soft and hard approaches
Example of PCR, interpretation of calibration equations
Principal Component Analysis (PCA)
Dimension reduction : PCA and Clustering
X.1 Principal component analysis
Feature space tansformation methods
X.2 Linear Discriminant Analysis: 2-Class
Data Driven SIMCA – more than One-Class Classifier
Feature Selection Methods
SIMCA.XLA as an extension of Chemometrics Add-In
Recognition of the 'high quality’ forgeries among medicines
On-Line Prediction and Classification using The Unscrambler On-Line Predictor (OLUP) and Classifier (OLUC)
Dimensionality Reduction Part 1 of 2
Presentation transcript:

Course survey: what has been done, and what should be done Russian Chemometrics Society Semenov Institute of Chemical Physics Alexey Pomerantsev forecast@chph.ras.ru 22.09.08 Workshop in Esbjerg

Introduction Unfulfilled need in chemometric education in Russia Low number of qualified specialists in chemometrics Large distances, e.g. Moscow – Barnaul is about 3000 km No modern chemometrics books in Russian No available chemometric software No support from officials: government, Academy, etc Easy available everywhere => INTERNET Interactive layout: all calculations should be clear and repeatable Web friendly environment for the calculations => EXCEL Necessity to make and use our own (free) software => EXCEL Add-In 3000 km 4000 km Barnaul 22.09.08 Workshop in Esbjerg

Interactivity in practice 22.09.08 Workshop in Esbjerg

Charged in English elsewhere International View Free in Russian Charged in English elsewhere Free in Afrikaans – Sylvia Paul initiative 22.09.08 Workshop in Esbjerg

Dream about profits In 2005 Braunschweig Univ. announced an Internet based Master course in hydrogeology Some 1000 applicants (mostly from China) have applied Only 3 persons (as planned) have been accepted Each Master student brings some 1000 EUR per year Braunschweig 2007 Our need is a world famous university that can support our initiative It should confirm the Master of Chemometrics degree obtained at the distance education 22.09.08 Workshop in Esbjerg

Course Levels Basics Chemometrics Advanced 22.09.08 Workshop in Esbjerg

Course Layout Tutorials Exercises Projects Tests Basics Chemometrics Advanced Exercises Basics Chemometrics Advanced Projects Chemometrics Advanced Tests Chemometrics Advanced 22.09.08 Workshop in Esbjerg

Course Contents Basics Chemometrics Advanced Matrices Excel Statistics Matlab XLA Instruments Chemometrics Calibration PCA Classification MCR Introduction Advanced MSPC MIA Preprocessing DoE Multi Way Spectroscopy 22.09.08 Workshop in Esbjerg

Ready in Russian Basics Chemometrics Advanced Calibration PCA Introduction Basics Matrices Matlab XLA 22.09.08 Workshop in Esbjerg

To be created Basics Chemometrics Advanced Statistics Excel Instruments Chemometrics Classification MCR Advanced MSPC MIA Preprocessing DoE Multi Way Spectroscopy 22.09.08 Workshop in Esbjerg

Illustration: Excel workbook Basic. Matrices. Ready Minimum Matrix & vector Operations Rank, determinant Inverse & psedoinverse Additional Linear equations Quadratic forms Decompositions Eigenvectors SVD Linear space and basis Subspace and projection Illustration: Excel workbook 22.09.08 Workshop in Esbjerg

Illustration: Functions Basic. Matlab. Ready Framework Workspace Calculations MAT files Matrices Data and data access Matrix operations MatLab & Excel Programming M-files Functions & subroutines Plotting Examples Preprocessing SVD & NIPALS PLS1 & PLS2 Illustration: Functions function [T, P] = pcasvd(X) % pcasvd: calculates PCA components. % The output matrices are T and P. % T contains scores % P contains loadings [U,D,V] = svd(X); T = U * D; P = V; %end of pcasvd 22.09.08 Workshop in Esbjerg

Simulated illustration Basic. XLA. Ready Projection methods PCA & PLS Simulated example Chemometrics xla Installation General PCA ScoresPCA LoadingsPCA PLS ScoresPLS .... PLS2 ScoresPLS 2 Simulated illustration 22.09.08 Workshop in Esbjerg

Basic. Excel. To be created ? Illustration: Excel workbook 22.09.08 Workshop in Esbjerg

Basic. Statistics. To be created ? Illustration: Excel workbook 22.09.08 Workshop in Esbjerg

Basic. Instruments. To be created Introduction Spectroscopy (IR, UV, NIR, Raman) Chromatography Hyphenated techniques Etc ... 22.09.08 Workshop in Esbjerg

Chemometrics. Introduction. Ready Data and models used in chemical analysis Qualitative analysis methods. Exploration, classification and discrimination Quantitative analysis methods. Calibration Data preprocessing and signal processing Conclusions 22.09.08 Workshop in Esbjerg

Chemometrics. PCA. Ready Introduction Data reduction Intuitive approach PCA Algorithm Scores Loadings Residuals Number of PC Example. People Data exploration Score plots Loading plots Illustration: People 22.09.08 Workshop in Esbjerg

Chemometrics. Calibration. Ready Introduction Validation and quality Over – and underfitting Multicolinearity Classic Direct calibration Univariate calibration Multiply calibration Step wise calibration Multivariate Projections PCR PLS PLS2 Simulated illustration 22.09.08 Workshop in Esbjerg

Chemometrics. Classification. To be done Introduction Supervised PR Unsupervised PR SIMCA PCA Scores and orthog. distances Example PLS discrimination PLS Illustration: Drugs 22.09.08 Workshop in Esbjerg

Chemometrics. MCR. To be created Introduction Data reduction Intuitive approach Example. HPLC-DAD Data Elution profiles Pure Spectra Resolution PCA EFA WFA Procrustean rotation ALS Illustration: HPLC-DAD 22.09.08 Workshop in Esbjerg

Advanced. MSPC. To be created Introduction Process control Shewart cards Multivariate approach PCA & SIMCA Batch process PLS Illustration: Simulated 22.09.08 Workshop in Esbjerg

Advanced. MIA. To be created Introduction Imaging Digitalization Example. Microarrays Unfolding PCA Multivariate approach Illustration: Microarray 22.09.08 Workshop in Esbjerg

Advanced. Preprocessing. To be created ? Illustration: ??? 22.09.08 Workshop in Esbjerg

Advanced. Multi Way. To be created ? Illustration: ??? 22.09.08 Workshop in Esbjerg

Advanced. Spectroscopy. To be created ? Illustration: ??? 22.09.08 Workshop in Esbjerg

Advanced. DoE. To be created ? Illustration: ??? 22.09.08 Workshop in Esbjerg

Team work Nadezhda is the project coordinator Alexey is responsible for tutorials preparation (in Russian) Oxana is responsible for Chemometrics.xla software, exercises, projects, and tests Oleg and Tatiana are the exemplars of a student. They are also responsible for the English translation Satu-Pia is working to legalize the course inside the LUT Jarno is responsible for validation. He will also contribute with projects Sergei is responsible for the Internet medium 22.09.08 Workshop in Esbjerg

Conclusions and tasks We have a good groundwork for start There is a lot of future activities though Besides the conceptual, a legalization efforts are needed Topical problem is allocation of responsibilities Just now I am waiting for your comments, proposals, etc 22.09.08 Workshop in Esbjerg