Venkataramanan Balakrishnan Purdue University Applications of Convex Optimization in Systems and Control.

Slides:



Advertisements
Similar presentations
Edge Preserving Image Restoration using L1 norm
Advertisements

Globally Optimal Estimates for Geometric Reconstruction Problems Tom Gilat, Adi Lakritz Advanced Topics in Computer Vision Seminar Faculty of Mathematics.
FTP Biostatistics II Model parameter estimations: Confronting models with measurements.
Experimental Design, Response Surface Analysis, and Optimization
Fast Bayesian Matching Pursuit Presenter: Changchun Zhang ECE / CMR Tennessee Technological University November 12, 2010 Reading Group (Authors: Philip.
Properties of State Variables
T HE POWER OF C ONVEX R ELAXATION : N EAR - OPTIMAL MATRIX COMPLETION E MMANUEL J. C ANDES AND T ERENCE T AO M ARCH, 2009 Presenter: Shujie Hou February,
by Rianto Adhy Sasongko Supervisor: Dr.J.C.Allwright
Classification and Prediction: Regression Via Gradient Descent Optimization Bamshad Mobasher DePaul University.
Visual Recognition Tutorial
CSCE 641: Forward kinematics and inverse kinematics Jinxiang Chai.
280 SYSTEM IDENTIFICATION The System Identification Problem is to estimate a model of a system based on input-output data. Basic Configuration continuous.
Rational Trigonometry Applied to Robotics
© Goodwin, Graebe, Salgado, Prentice Hall 2000 Chapter7 Synthesis of SISO Controllers.
A De-coupled Sliding Mode Controller and Observer for Satellite Attitude Control Ronald Fenton.
Inverse Kinematics Problem:
Efficient Statistical Pruning for Maximum Likelihood Decoding Radhika Gowaikar Babak Hassibi California Institute of Technology July 3, 2003.
CSCE 641: Forward kinematics and inverse kinematics Jinxiang Chai.
Reformulated - SVR as a Constrained Minimization Problem subject to n+1+2m variables and 2m constrains minimization problem Enlarge the problem size and.
CSCE 689: Forward Kinematics and Inverse Kinematics
1 Iterative Reweighted Least-Squares Algorithm for 2-D IIR Filters Design Bogdan Dumitrescu, Riitta Niemistö Institute of Signal Processing Tampere University.
1 Multiple Kernel Learning Naouel Baili MRL Seminar, Fall 2009.
Normalised Least Mean-Square Adaptive Filtering
Optimal Placement and Selection of Camera Network Nodes for Target Localization A. O. Ercan, D. B. Yang, A. El Gamal and L. J. Guibas Stanford University.
Goal Directed Design of Serial Robotic Manipulators
Definition of an Industrial Robot
Introduction to estimation theory Seoul Nat’l Univ.
Machine Learning CUNY Graduate Center Lecture 3: Linear Regression.
Introduction to Adaptive Digital Filters Algorithms
AUTOMATIC CONTROL THEORY II Slovak University of Technology Faculty of Material Science and Technology in Trnava.
LOGO A Path –Following Method for solving BMI Problems in Control Author: Arash Hassibi Jonathan How Stephen Boyd Presented by: Vu Van PHong American Control.
Machine Learning Seminar: Support Vector Regression Presented by: Heng Ji 10/08/03.
Analytic Placement. Layout Project:  Sending the RTL file: −Thursday, 27 Farvardin  Final deadline: −Tuesday, 22 Ordibehesht  New Project: −Soon 2.
ECE 8443 – Pattern Recognition ECE 8423 – Adaptive Signal Processing Objectives: Deterministic vs. Random Maximum A Posteriori Maximum Likelihood Minimum.
PATTERN RECOGNITION AND MACHINE LEARNING CHAPTER 3: LINEAR MODELS FOR REGRESSION.
Modeling and Complexity Reduction for Interconnected Systems Carolyn Beck University of Illinois at Urbana-Champaign August 2, 2001.
EE 6332, Spring, 2014 Wireless Communication Zhu Han Department of Electrical and Computer Engineering Class 11 Feb. 19 th, 2014.
Computer Animation Rick Parent Computer Animation Algorithms and Techniques Optimization & Constraints Add mention of global techiques Add mention of calculus.
CSCE 441: Computer Graphics Forward/Inverse kinematics Jinxiang Chai.
EE513 Audio Signals and Systems
A Semi-Blind Technique for MIMO Channel Matrix Estimation Aditya Jagannatham and Bhaskar D. Rao The proposed algorithm performs well compared to its training.
NCAF Manchester July 2000 Graham Hesketh Information Engineering Group Rolls-Royce Strategic Research Centre.
Introduction to Semidefinite Programs Masakazu Kojima Semidefinite Programming and Its Applications Institute for Mathematical Sciences National University.
1  The Problem: Consider a two class task with ω 1, ω 2   LINEAR CLASSIFIERS.
Lecture #14 Computational methods to construct multiple Lyapunov functions & Applications João P. Hespanha University of California at Santa Barbara Hybrid.
Review of fundamental 1 Data mining in 1D: curve fitting by LLS Approximation-generalization tradeoff First homework assignment.
1  Problem: Consider a two class task with ω 1, ω 2   LINEAR CLASSIFIERS.
Professors: Eng. Diego Barral Eng. Mariano Llamedo Soria Julian Bruno
Trajectory Generation Cherevatsky Boris. Mathematical Fact Given n+1 values of a n-degree polynomial : i.e. if we have the values: we can compute the.
Large-Scale Matrix Factorization with Missing Data under Additional Constraints Kaushik Mitra University of Maryland, College Park, MD Sameer Sheoreyy.
Chapter 2-OPTIMIZATION G.Anuradha. Contents Derivative-based Optimization –Descent Methods –The Method of Steepest Descent –Classical Newton’s Method.
September 28, 2000 Improved Simultaneous Data Reconciliation, Bias Detection and Identification Using Mixed Integer Optimization Methods Presented by:
Optimization in Engineering Design 1 Introduction to Non-Linear Optimization.
Impulse Response Measurement and Equalization Digital Signal Processing LPP Erasmus Program Aveiro 2012 Digital Signal Processing LPP Erasmus Program Aveiro.
(COEN507) LECTURE III SLIDES By M. Abdullahi
CSCE 441: Computer Graphics Forward/Inverse kinematics Jinxiang Chai.
1 Chapter 6 Reformulation-Linearization Technique and Applications.
1 Chapter 5 Branch-and-bound Framework and Its Applications.
Ch 9.6: Liapunov’s Second Method In Section 9.3 we showed how the stability of a critical point of an almost linear system can usually be determined from.
Singularity-Robust Task Priority Redundancy Resolution for Real-time Kinematic Control of Robot Manipulators Stefano Chiaverini.
CSCE 441: Computer Graphics Forward/Inverse kinematics
Multiplicative updates for L1-regularized regression
Non-linear relationships
§7-4 Lyapunov Direct Method
Autonomous Cyber-Physical Systems: Dynamical Systems
Nuclear Norm Heuristic for Rank Minimization
CSCE 441: Computer Graphics Forward/Inverse kinematics
Outline: Introduction Solvability Manipulator subspace when n<6
Chapter 4 . Trajectory planning and Inverse kinematics
Presentation transcript:

Venkataramanan Balakrishnan Purdue University Applications of Convex Optimization in Systems and Control

Basic idea Computational methods, esp. convex optimization increasingly relevant to systems and control Much wider class of problems can now be “solved”

Outline Convex optimization for control Equalizer design in communications Fault-tolerant control laws for robots Conclusion

Concept of “solution” constantly changing Often dictates techniques used Example: Stability of LTI systems –Late 1800s, complex variable techniques –1900s, numerical linear algebra Current state of the art: “Reduction to a convex optimization problem constitutes a solution” Introduction

is a convex set: is a convex function: Convex optimization

Semidefinite programming (SDP) Special convex optimization problem: – is linear, i.e., –Domain of optimization is defined via linear matrix inequalities:

Solving SDPs SDPs are “easy” to solve: –Unique global minimum –Polynomial worst-case complexity –Duality theory –Algorithms and software available

SDPs in Control Stability of LTI system: Stable if there exists quadratic Lyapunov function that decays along trajectories, or (Can find suitable by solving linear equations, i.e., can find “analytical solution”)

SDPs in Control Stability of LTV system: Stable if there exists quadratic Lyapunov function that decays along trajectories, or No analytical solution! …but SDP

Lyapunov functions for other uncertain system models Performance objectives, e.g., bounds on norms Synthesis of control laws SDPs in control

Outline Convex optimization for control Equalizer design in communications Fault-tolerant control laws for robots Conclusion

Communication multi-path

A simple block diagram h 1 (n), …, h N (n) represent the effective channel; assumed fixed and known u 1 (n), …, u N (n) represent noises, assumed independent and white h1(n)h1(n) hN(n)hN(n)    y(n)y(n) gN(n)gN(n) g1(n)g1(n)  u1(n)u1(n) uN(n)uN(n)      x(n)x(n)

Zero-forcing equalizer design Design FIR G 1 (z), …, G N (z) to equalize: H 1 (z) G 1 (z) +    + H N (z) G N (z) = 1 Mitigate effects of noise H1(z)H1(z) HN(z)HN(z)    y(n)y(n) GN(z)GN(z) G1(z)G1(z) u1(n)u1(n) uN(n)uN(n)    x(n)x(n)   

Equalization error (ISI): –Quantified as –Exactly reformulated as LMI using KYP Lemma –Frequency-windowing possible Effect of noise: –“Large” G 1 (z), …, G N (z) amplify noise power –Noise power amplification quantified as –Quadratic in FIR coefficients, another LMI Tradeoff between  and  via SDP Design trade-offs

A two-channel example

Tradeoff:  vs. 

Tradeoff: MSE vs. 

BER vs SNR (  = 0.1)

Outline Convex optimization for control Equalizer design in communications Fault-tolerant control laws for robots Conclusion

Failures in robots Robots are often used in hostile environments, with an increased likelihood of failures Some ways of enhancing failure tolerance: –Component redundancy –Kinematic redundancy Focus here: kinematically redundant robots (more joints than are necessary)

Assumptions Joint failures lead to “locking” of joint Joint failure is undetected, and controller continues to command motion of the failed joint –No failure detection and identification –Delay in failure detection and identification –Overwhelming number of failures

Joint variable Task space variable Given end-effector velocity, joint velocity generated as Joint space to task space: Mathematical framework Joint velocity to end-effector velocity: with

Suppose joint i fails. Then, i th component of is identically zero Under perfect servo control: Control with unidentified failure Then actual end-effector velocity is where Thus:

Consequences of failures Global issues: –Does manipulator converge to desired location? –If not, does it converge? –Conditions that guarantee answers can be given Local issues: –Quantifying local performance measures –Design of G to improve local performance

Quantifying local performance

Euclidean norm of velocity error, averaged over all single-joint failures Finding G to minimize MSE( ) is a least- squares problem Solution is a weighted pseudo-inverse Quantifying local performance Mean-square velocity error

Quantifying local performance Peak-velocity error Peak norm of velocity error, over all single joint failures: Finding G to minimize PKE( ) is an SDP: Can also allow some pre-failure error  pre by adding constraint

Performance comparison

Outline Convex optimization for control Equalizer design in communications Fault-tolerant control laws for robots Conclusion

General conclusions Convex optimization has become a standard tool in system and control theory Ideas from system and control theory are effective in many areas of EE

Often SDP problems are large, general- purpose solvers inadequate Need algorithms that take advantage of problem structure In other applications, data varies with time Need algorithms that “track” optimal SDP solutions Further research directions

Equalized spectrum (  = 0.1)

Simulation parameters