Maria Okuniewski Nuclear Engineering Dept.

Slides:



Advertisements
Similar presentations
Neural and Evolutionary Computing - Lecture 4 1 Random Search Algorithms. Simulated Annealing Motivation Simple Random Search Algorithms Simulated Annealing.
Advertisements

Simulated Annealing Premchand Akella. Agenda Motivation The algorithm Its applications Examples Conclusion.
Acoustic design by simulated annealing algorithm
CHAPTER 8 A NNEALING- T YPE A LGORITHMS Organization of chapter in ISSO –Introduction to simulated annealing –Simulated annealing algorithm Basic algorithm.
Random numbers and optimization techniques Jorge Andre Swieca School Campos do Jordão, January,2003 second lecture.
BAYESIAN INFERENCE Sampling techniques
Simulated Annealing Student (PhD): Umut R. ERTÜRK Lecturer : Nazlı İkizler Cinbiş
CS774. Markov Random Field : Theory and Application Lecture 16 Kyomin Jung KAIST Nov
1 Quantum Monte Carlo Methods Jian-Sheng Wang Dept of Computational Science, National University of Singapore.
Spie98-1 Evolutionary Algorithms, Simulated Annealing, and Tabu Search: A Comparative Study H. Youssef, S. M. Sait, H. Adiche
Tabu Search for Model Selection in Multiple Regression Zvi Drezner California State University Fullerton.
Supervised learning 1.Early learning algorithms 2.First order gradient methods 3.Second order gradient methods.
MAE 552 – Heuristic Optimization Lecture 8 February 8, 2002.
Optimization Techniques
MAE 552 – Heuristic Optimization Lecture 6 February 6, 2002.
Nature’s Algorithms David C. Uhrig Tiffany Sharrard CS 477R – Fall 2007 Dr. George Bebis.
A Comparative Study Of Deterministic And Stochastic Optimization Methods For Integrated Design Of Processes Mario Francisco a, Silvana Revollar b, Pastora.
Simulated Annealing Van Laarhoven, Aarts Version 1, October 2000.
MAE 552 – Heuristic Optimization Lecture 10 February 13, 2002.
Planning operation start times for the manufacture of capital products with uncertain processing times and resource constraints D.P. Song, Dr. C.Hicks.
Introduction to Simulated Annealing 22c:145 Simulated Annealing  Motivated by the physical annealing process  Material is heated and slowly cooled.
Optimization of thermal processes2007/2008 Optimization of thermal processes Maciej Marek Czestochowa University of Technology Institute of Thermal Machinery.
JM - 1 Introduction to Bioinformatics: Lecture XVI Global Optimization and Monte Carlo Jarek Meller Jarek Meller Division of Biomedical.
1 IE 607 Heuristic Optimization Simulated Annealing.
A Comparison of Nature Inspired Intelligent Optimization Methods in Aerial Spray Deposition Management Lei Wu Master’s Thesis Artificial Intelligence Center.
Optimization in Engineering Design Georgia Institute of Technology Systems Realization Laboratory Mixed Integer Problems Most optimization algorithms deal.
Zorica Stanimirović Faculty of Mathematics, University of Belgrade
Boltzmann Machine (BM) (§6.4) Hopfield model + hidden nodes + simulated annealing BM Architecture –a set of visible nodes: nodes can be accessed from outside.
Optimization Problems - Optimization: In the real world, there are many problems (e.g. Traveling Salesman Problem, Playing Chess ) that have numerous possible.
Simulated Annealing.
For a new configuration of the same volume V and number of molecules N, displace a randomly selected atom to a point chosen with uniform probability inside.
Derivative Free Optimization G.Anuradha. Contents Genetic Algorithm Simulated Annealing Random search method Downhill simplex method.
Doshisha Univ., Kyoto, Japan CEC2003 Adaptive Temperature Schedule Determined by Genetic Algorithm for Parallel Simulated Annealing Doshisha University,
Markov Chain Monte Carlo and Gibbs Sampling Vasileios Hatzivassiloglou University of Texas at Dallas.
Introduction to Simulated Annealing Study Guide for ES205 Yu-Chi Ho Xiaocang Lin Aug. 22, 2000.
Introduction to Simulated Annealing Study Guide for ES205 Xiaocang Lin & Yu-Chi Ho August 22, 2000.
Simulated Annealing. Difficulty in Searching Global Optima starting point descend direction local minima global minima barrier to local search.
Ramakrishna Lecture#2 CAD for VLSI Ramakrishna
An Introduction to Simulated Annealing Kevin Cannons November 24, 2005.
Genetic Algorithm Dr. Md. Al-amin Bhuiyan Professor, Dept. of CSE Jahangirnagar University.
Artificial Intelligence By Mr. Ejaz CIIT Sahiwal Evolutionary Computation.
Genetic Algorithms And other approaches for similar applications Optimization Techniques.
On the Computation of All Global Minimizers Through Particle Swarm Optimization IEEE Transactions On Evolutionary Computation, Vol. 8, No.3, June 2004.
Systematic errors of MC simulations Equilibrium error averages taken before the system has reached equilibrium  Monitor the variables you are interested.
The Monte Carlo Method/ Markov Chains/ Metropolitan Algorithm from sec in “Adaptive Cooperative Systems” -summarized by Jinsan Yang.
Axially Variable Strength Control Rods for The Power Maneuvering of PWRs KIM, UNG-SOO Dept. of Nuclear and Quantum Engineering.
Scientific Research Group in Egypt (SRGE)
Optimization by Quantum Computers
Optimization Of Robot Motion Planning Using Genetic Algorithm
Optimization of Monte Carlo Integration
Simulated Annealing Chapter
Heuristic Optimization Methods
Van Laarhoven, Aarts Version 1, October 2000
Advanced Statistical Computing Fall 2016
Optimization Techniques Gang Quan Van Laarhoven, Aarts Sources used.
Meta-heuristics Introduction - Fabien Tricoire
A Comparison of Simulated Annealing and Genetic Algorithm Approaches for Cultivation Model Identification Olympia Roeva.
Artificial Intelligence (CS 370D)
Subject Name: Operation Research Subject Code: 10CS661 Prepared By:Mrs
Basics of Genetic Algorithms (MidTerm – only in RED material)
Introduction to Simulated Annealing
Steady-State Aerodynamics Codes for HAWTs
5.2.3 Optimization, Search and
More on Search: A* and Optimization
Basics of Genetic Algorithms
Boltzmann Machine (BM) (§6.4)
Xin-She Yang, Nature-Inspired Optimization Algorithms, Elsevier, 2014
Greg Knowles ECE Fall 2004 Professor Yu Hu Hen
Simulated Annealing & Boltzmann Machines
Presentation transcript:

Conformational Optimization of Silicon Cluster System by Simulated Annealing Maria Okuniewski Nuclear Engineering Dept. Folusho Oyerokun Material Science & Eng. Dept. Rui Qiao Mechanical Engineering Dept.

Project Goals Apply Simulated Annealing to Si Cluster Optimization Incorporate Adaptive Cooling Schedule Compare Results with Genetic Algorithm

Motivation Properties of clusters are directly related to their conformation Quantum chemistry calculations are very expensive Traditional optimization techniques do not perform well when applied to cluster optimization problems

What is simulated annealing (SA) ? A Monte-Carlo approach for minimizing multi-variate functions Advantages Ability to find the global minimum independent of initial configuration Less likely to get trapped in local minima Mimics physical annealing process

Cooling Schedules Initial Value of Temperature Final Value of Temperature Decrement Rule for Temperature Markov Chain Length at Each Temperature (Quasi-Equilibrium)

Initial Value of Temperature Issues Too High Results in Wasted Computer Time Too Low Might Get You Trapped in Local Minimum Selection Based on Acceptance Ratio Select Low T and Compute AR Increase T until AR >= 0.8

Final Temperature Issues Selection Based on Minimum AR and Box Size Zero Kelvin Not Feasible! Possibility of Stopping Before Global Conformation is Found if T is Too High Wasted Computer Time After Global Minimum Has Been Found if T Too Low Selection Based on Minimum AR and Box Size

Plot of Cv for Fixed Decrement Rate Tn+1= f (Cv, Tn) ?

Decrement Rule Adaptive Cooling Based on Cv Two Schemes Chosen (Modified Aarts and van Laarhoven) (Huang et al.)

Markov Chain Properties Mathematical Requirement for Convergence Infinite Markov Length Transition Matrix Must Satisfy the Following Requirements:

Markov Chain (Contd) Practical Implementation Finite Chain Length Based On Acceptable Variance Detailed Balance Sufficient for Irreducibility Requirement of the Markov Chain

Initialize configuration X0 Initialize temperature T0 Perturb atom position once k*natom times? N Y Metropolis algorithm Record lowest energy E_good = f ( X_good ) Accept # < M Calculate Cv D < Dmin ? END update configuration: X = Xgood Tn+1 = f(Tn, Cv) Adjust box size D based on accept ratio

Initial Configuration 1 2 3 5 4 6 y z x

Robustness of algorithm tested for different initial configurations Initial Configuration (n=12) Final Configuration (n=12)

Gong Potential Gong is a Modified SW Potential Two Body Term Three Body Term where

Global Minima for Clusters Cluster size Energy per atom 3 atoms -0.8085 9 atoms -1.5649 4 atoms -1.0004 10 atoms -1.5800 5 atoms -1.2783 11 atoms -1.6661 6 atoms -1.3749 12 atoms -1.6245 7 atoms -1.4418 13 atoms -1.6494 8 atoms -1.5111 14 atoms -1.6464 Units are in ε = 2.17eV.

Structural Evolution 4 atoms 8 atoms 10 atoms 12 atoms Initial Final

Comparison of Temperature Decrement Rules   Exponential Fixed Inverse natoms Function cost error function cost 4 65646 30371 326400 32883 78900 9200 6 72148 33860 323124 41990 204490 9535 10 139974 45833 591374 17846 481550 113470

Inner Loop Sensitivity Small inner loop – difficult to reach convergence Large inner loop – helps to improve convergence, but slows algorithm

Parametric study: Delta Sensitivity Regions of robustness for choice of delta

Genetic Algorithm Basics Developed by John Holland in the 1960’s Incorporates principles based on Darwin’s evolution theories Survival of the fittest – selects candidate solutions (coordinates of the cluster structures) from total population (all available cluster structures) Candidate solutions compete with each other for survival Breeding, selection, and mutations – fittest individuals pass on their genetics to subsequent generations After several generations – fittest individual obtained (global potential energy minimum)

Function Cost Evaluation Exponential function is less costly for larger clusters (6-12) GA is less costly for small clusters Exponential - O(n1.2) GA – O(n8.2)

Achievements Developed SA Algorithm Based on Adaptive Cooling Schedule Implemented Adaptive Box Size Found Global Minimum Energy State for Cluster up to 14 atoms Highlighted Sensitivity of Algorithm to Choice of Parameters Compared Results with GA