Slide 1 Tutorial: Optimal Learning in the Laboratory Sciences A case application – Growing carbon nanotubes December 10, 2014 Warren B. Powell Kris Reyes.

Slides:



Advertisements
Similar presentations
R&D Portfolio Optimization One Stage R&D Portfolio Optimization with an Application to Solid Oxide Fuel Cells Lauren Hannah 1, Warren Powell 1, Jeffrey.
Advertisements

1 -Classification: Internal Uncertainty in petroleum reservoirs.
Estimating a Population Variance
The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL Chapter 5. Continuous Probability Distributions Sections 5.4, 5.5: Exponential and Gamma Distributions.
Use of Kalman filters in time and frequency analysis John Davis 1st May 2011.
© 2008 Warren B. Powell 1. Optimal Learning Informs TutORials October, 2008 Warren Powell Peter Frazier Princeton University © 2008 Warren B. Powell, Princeton.
Slide 1 Tutorial: Optimal Learning in the Laboratory Sciences Richer belief models December 10, 2014 Warren B. Powell Kris Reyes Si Chen Princeton University.
Optimal Design Laboratory | University of Michigan, Ann Arbor 2011 Design Preference Elicitation Using Efficient Global Optimization Yi Ren Panos Y. Papalambros.
Introduction to Mobile Robotics Bayes Filter Implementations Gaussian filters.
Probabilistic Robotics: Kalman Filters
CS 547: Sensing and Planning in Robotics Gaurav S. Sukhatme Computer Science Robotic Embedded Systems Laboratory University of Southern California
Neural Networks Marco Loog.
An Optimal Learning Approach to Finding an Outbreak of a Disease Warren Scott Warren Powell
Fundamental Sciences Electronics Energy Pharmaceutical Bio Nano Science & Technology Physics Chemistry Biology  m] MACRO ~10 o m ~10 -9 m ~10 -6 m 
Chem101 Chapter 01 Chemical Foundations.
Statistics and Probability Theory Prof. Dr. Michael Havbro Faber
Reinforcement Learning (1)
Slide 1 Tutorial: Optimal Learning in the Laboratory Sciences Working with nonlinear belief models December 10, 2014 Warren B. Powell Kris Reyes Si Chen.
Slide 1 Tutorial: Optimal Learning in the Laboratory Sciences The power of interactivity December 10, 2014 Warren B. Powell Kris Reyes Si Chen Princeton.
Slide 1 Tutorial: Optimal Learning in the Laboratory Sciences Building a belief model December 10, 2014 Warren B. Powell Kris Reyes Si Chen Princeton University.
Gaussian Mixture Model and the EM algorithm in Speech Recognition
Computational Stochastic Optimization: Bridging communities October 25, 2012 Warren Powell CASTLE Laboratory Princeton University
Myopic Policies for Budgeted Optimization with Constrained Experiments Javad Azimi, Xiaoli Fern, Alan Fern Oregon State University AAAI, July
Designing a Multi-Disciplinary Hybrid Vehicle Systems Course Curriculum Suitable for Multiple Departments Dr. Vincent Winstead Assistant Professor Minnesota.
Markov Localization & Bayes Filtering
Applications of Bayesian sensitivity and uncertainty analysis to the statistical analysis of computer simulators for carbon dynamics Marc Kennedy Clive.
/09/dji-phantom-crashes-into- canadian-lake/
Lab 4 1.Get an image into a ROS node 2.Find all the orange pixels (suggest HSV) 3.Identify the midpoint of all the orange pixels 4.Explore the findContours.
Slide 1 Tutorial: Optimal Learning in the Laboratory Sciences The knowledge gradient December 10, 2014 Warren B. Powell Kris Reyes Si Chen Princeton University.
St5219: Bayesian hierarchical modelling lecture 2.1.
Visibility Graph. Voronoi Diagram Control is easy: stay equidistant away from closest obstacles.
Probabilistic Robotics Bayes Filter Implementations Gaussian filters.
Outline of Chapter 9: Using Simulation to Solve Decision Problems Real world decisions are often too complex to be analyzed effectively using influence.
INFORMS Annual Meeting San Diego 1 HIERARCHICAL KNOWLEDGE GRADIENT FOR SEQUENTIAL SAMPLING Martijn Mes Department of Operational Methods for.
Slide 1 Tutorial: Optimal Learning in the Laboratory Sciences Overview December 10, 2014 Warren B. Powell Kris Reyes Si Chen Princeton University
Teacher Resources  Chapter 4 Color Teaching Transparency —Ch 4.2Ch 4.2  Laboratory Black line Masters Laboratory Black line Masters  Electronic Book.
Confidence intervals and hypothesis testing Petter Mostad
Statistical learning and optimal control: A framework for biological learning and motor control Lecture 4: Stochastic optimal control Reza Shadmehr Johns.
Understanding Sampling
1 Demand for Repeated Insurance Contracts with Unknown Loss Probability Emilio Venezian Venezian Associates Chwen-Chi Liu Feng Chia University Chu-Shiu.
ITEC 352 Lecture 3 Low level components(2). Low-level components Review Electricity Transistors Gates Really simple circuit.
Section 7-3 Estimating a Population Mean: σ Known.
4 Proposed Research Projects SmartHome – Encouraging patients with mild cognitive disabilities to use digital memory notebook for activities of daily living.
Term 4, 2006BIO656--Multilevel Models 1 PROJECTS ARE DUE By midnight, Friday, May 19 th Electronic submission only to Please.
© 2009 Ilya O. Ryzhov 1 © 2008 Warren B. Powell 1. Optimal Learning On A Graph INFORMS Annual Meeting October 11, 2009 Ilya O. Ryzhov Warren Powell Princeton.
Slide 1 Tutorial: Optimal Learning in the Laboratory Sciences Forming the decision set December 10, 2014 Warren B. Powell Kris Reyes Si Chen Princeton.
Human and Optimal Exploration and Exploitation in Bandit Problems Department of Cognitive Sciences, University of California. A Bayesian analysis of human.
Boolean and Sequential Logic Last week – Basic Gates AND OR NOT NOR XOR NAND.
CS 547: Sensing and Planning in Robotics Gaurav S. Sukhatme Computer Science Robotic Embedded Systems Laboratory University of Southern California
Transfer Learning in Sequential Decision Problems: A Hierarchical Bayesian Approach Aaron Wilson, Alan Fern, Prasad Tadepalli School of EECS Oregon State.
Slide 1 Tutorial: Optimal Learning in the Laboratory Sciences Searching a two-dimensional surface December 10, 2014 Warren B. Powell Kris Reyes Si Chen.
COMP 2208 Dr. Long Tran-Thanh University of Southampton Reinforcement Learning.
Geogg124: Data assimilation P. Lewis. What is Data Assimilation? Optimal merging of models and data Models Expression of current understanding about process.
Modeling Errors in Satellite Data Yudong Tian University of Maryland & NASA/GSFC Sponsored by NASA ESDR-ERR Program.
Sequential Off-line Learning with Knowledge Gradients Peter Frazier Warren Powell Savas Dayanik Department of Operations Research and Financial Engineering.
Coached Active Learning for Interactive Video Search Xiao-Yong Wei, Zhen-Qun Yang Machine Intelligence Laboratory College of Computer Science Sichuan University,
Probabilistic Robotics Probability Theory Basics Error Propagation Slides from Autonomous Robots (Siegwart and Nourbaksh), Chapter 5 Probabilistic Robotics.
Outline Historical note about Bayes’ rule Bayesian updating for probability density functions –Salary offer estimate Coin trials example Reading material:
Sullivan – Fundamentals of Statistics – 2 nd Edition – Chapter 9 Section 4 – Slide 1 of 11 Chapter 9 Section 4 Putting It All Together: Which Procedure.
© 2008 Warren B. Powell 1. Optimal Learning Informs TutORials October, 2008 Warren Powell Peter Frazier With research by Ilya Ryzhov Princeton University.
Slide 1 Tutorial: Optimal Learning in the Laboratory Sciences The value of information December 10, 2014 Warren B. Powell Kris Reyes Si Chen Princeton.
Bayesian Model Selection and Averaging SPM for MEG/EEG course Peter Zeidman 17 th May 2016, 16:15-17:00.
Optimal Learning in the Laboratory Sciences
Clearing the Jungle of Stochastic Optimization
Lecture 10: Observers and Kalman Filters
Approximate Dynamic Programming for
Instructors: Fei Fang (This Lecture) and Dave Touretzky
CS 188: Artificial Intelligence Fall 2008
Optimal Learning in the Laboratory Sciences
CS639: Data Management for Data Science
Presentation transcript:

Slide 1 Tutorial: Optimal Learning in the Laboratory Sciences A case application – Growing carbon nanotubes December 10, 2014 Warren B. Powell Kris Reyes Si Chen Princeton University Slide 1

Lecture outline 2  A case application – Carbon nanotubes  Building a belief model (the prior)  Running an experiment  Updating the belief (the posterior)  Designing a policy  Creating a prior

Courtesy Growing Nanotubes Nanotubes  As of 2013 carbon nanotube production exceeded several thousand tons per year  Applications: energy storage, automotive parts, boat hulls, sporting goods, water filters, thin-film electronics, coatings, actuators, etc. 3

Growing Nanotubes  Find the catalysts that give the best nanotube length  Objective: optimize the nanotube length  Discrete choices: different catalysts, e.g. Fe, Ni, PHN, Al 2 O 3 +Fe, Al 2 O 3 +Ni  Budget: small number of sequential experiments 4 K. Kempa, Z. Ren et al., Appl. Phys. Lett. 85, 13 (2004)Appl. Phys. Lett.

Simple Belief Model Point estimate: depending on the catalysts, we get different nanotube lengths Distribution: describes our belief about the length of the bar produced by each catalyst Which catalyst to try? 5 FeNi PHN Al 2 O 3 +FeAl 2 O 3 +Ni Nanotube Length

Simple Belief Model Which catalyst to try?  If we try Al 2 O 3 +Fe, our belief of the best may stay unchanged. 6 FeNi PHN Al 2 O 3 +FeAl 2 O 3 +Ni Nanotube Length

Simple Belief Model Which catalyst to try?  If we try Al 2 O 3 +Fe, our belief of the best may stay unchanged. 7 FeNi PHN Al 2 O 3 +FeAl 2 O 3 +Ni Nanotube Length

Simple Belief Model Which catalyst to try?  If we try Al 2 O 3 +Fe, our belief of the best may stay unchanged.  If we try Ni, our belief of the best may change lot. 8 FeNi PHN Al 2 O 3 +FeAl 2 O 3 +Ni Nanotube Length

Simple Belief Model Which catalyst to try?  If we try Al 2 O 3 +Fe, our belief of the best may stay unchanged.  If we try Ni, our belief of the best may change lot. 9 FeNi PHN Al 2 O 3 +FeAl 2 O 3 +Ni Nanotube Length

Policy Measurement policy:  A rule for making decisions, i.e. which catalyst to try? Different policies  Try a random one (exploration)  Try the one that looks the best (exploitation), i.e. Al 2 O 3 +Fe  Try the most uncertain one (variance reduction), i.e. Ni  Combine exploration and exploitation (interval estimation) Questions:  Can we be smarter?  What is the effect of decision-making rule to the number of experiments needed to discover the best? 10

Prior Simple belief model (lookup table)  Point estimate (single truth) 11 FeNi PHN Al 2 O 3 +FeAl 2 O 3 +Ni Nanotube Length

Prior Simple belief model (lookup table)  Point estimate (single truth)  Many possible truths 12 Fe Ni PHN Al 2 O 3 +Fe Al 2 O 3 +Ni FeNi PHN Al 2 O 3 +Fe Al 2 O 3 +Ni Fe Ni PHN Al 2 O 3 +Fe Al 2 O 3 +Ni FeNi PHN Al 2 O 3 +Fe Al 2 O 3 +Ni

Prior Simple belief model (lookup table)  Point estimate  Many possible truths  Truths can be captured by a distribution called the prior. 13 FeNi PHN Al 2 O 3 +FeAl 2 O 3 +Ni Nanotube Length

How to Construct a Prior? Literature review  Similar systems may be studied before Material property database  E.g. NIST Property Data Summaries for Advanced Materials, AFLOWLIB, MatWeb Previous lab data  Estimate the estimation (mean) and uncertainty (variance) using some initial experiments or similar experiments done earlier Fundamental understanding of physics and chemistry 14