Image Compression SVD Defuses the Bomb. Where Mathematics and Classical Art come together to combat terrorism.

Slides:



Advertisements
Similar presentations
Introduction to Information Retrieval Outline ❶ Latent semantic indexing ❷ Dimensionality reduction ❸ LSI in information retrieval 1.
Advertisements

Eigen Decomposition and Singular Value Decomposition
3D Geometry for Computer Graphics
Applied Informatics Štefan BEREŽNÝ
Chapter 28 – Part II Matrix Operations. Gaussian elimination Gaussian elimination LU factorization LU factorization Gaussian elimination with partial.
Linear Algebra Applications in Matlab ME 303. Special Characters and Matlab Functions.
Extremum Properties of Orthogonal Quotients Matrices By Achiya Dax Hydrological Service, Jerusalem, Israel
3D Reconstruction – Factorization Method Seong-Wook Joo KG-VISA 3/10/2004.
Lecture 19 Singular Value Decomposition
Principal Component Analysis CMPUT 466/551 Nilanjan Ray.
Principal Component Analysis
Hinrich Schütze and Christina Lioma
3D Geometry for Computer Graphics
Some useful linear algebra. Linearly independent vectors span(V): span of vector space V is all linear combinations of vectors v i, i.e.
Chapter 4.1 Mathematical Concepts. 2 Applied Trigonometry Trigonometric functions Defined using right triangle  x y h.
Math for CSLecture 41 Linear Least Squares Problem Over-determined systems Minimization problem: Least squares norm Normal Equations Singular Value Decomposition.
Information Retrieval in Text Part III Reference: Michael W. Berry and Murray Browne. Understanding Search Engines: Mathematical Modeling and Text Retrieval.
Chapter 3 Determinants and Matrices
The Terms that You Have to Know! Basis, Linear independent, Orthogonal Column space, Row space, Rank Linear combination Linear transformation Inner product.
Introduction to Information Retrieval Introduction to Information Retrieval Hinrich Schütze and Christina Lioma Lecture 18: Latent Semantic Indexing 1.
CSci 6971: Image Registration Lecture 2: Vectors and Matrices January 16, 2004 Prof. Chuck Stewart, RPI Dr. Luis Ibanez, Kitware Prof. Chuck Stewart, RPI.
Previously Two view geometry: epipolar geometry Stereo vision: 3D reconstruction epipolar lines Baseline O O’ epipolar plane.
3D Geometry for Computer Graphics
3D Geometry for Computer Graphics
Math for CSLecture 11 Mathematical Methods for Computer Science Lecture 1.
MOHAMMAD IMRAN DEPARTMENT OF APPLIED SCIENCES JAHANGIRABAD EDUCATIONAL GROUP OF INSTITUTES.
1cs542g-term Notes  Extra class next week (Oct 12, not this Friday)  To submit your assignment: me the URL of a page containing (links to)
EE 441 Some example projects. Singular Value Decomposition for Image Compression A = U Λ V T = σ1σ1 σ2σ2 σ3σ3 Use svd command in MATLAB…
Introduction The central problems of Linear Algebra are to study the properties of matrices and to investigate the solutions of systems of linear equations.
Computer vision: models, learning and inference
CHAPTER SIX Eigenvalues
CS246 Topic-Based Models. Motivation  Q: For query “car”, will a document with the word “automobile” be returned as a result under the TF-IDF vector.
Eigenvalue Problems Solving linear systems Ax = b is one part of numerical linear algebra, and involves manipulating the rows of a matrix. The second main.
J. ElderPSYC 6256 Principles of Neural Coding ASSIGNMENT 2: REVERSE CORRELATION.
Introduction to MATLAB adapted from Dr. Rolf Lakaemper.
Applying Colour Theory to Visual Design.  Color Theory is the art of mixing colors to achieve desired effects.  The way colors are combined can be used.
Image Compression by Singular Value Decomposition Presented by Annie Johnson MTH421 - Dr. Rebaza May 9, 2007.
Geometric Mean Decomposition and Generalized Triangular Decomposition Yi JiangWilliam W. HagerJian Li
D. van Alphen1 ECE 455 – Lecture 12 Orthogonal Matrices Singular Value Decomposition (SVD) SVD for Image Compression Recall: If vectors a and b have the.
SVD: Singular Value Decomposition
CpSc 881: Information Retrieval. 2 Recall: Term-document matrix This matrix is the basis for computing the similarity between documents and queries. Today:
Digital Image Compression via Singular Value Decomposition Robert White Ray Buhr Math 214 Prof. Buckmire May 3, 2006.
§ Linear Operators Christopher Crawford PHY
Scientific Computing Singular Value Decomposition SVD.
Singular Value Decomposition
CIS 601 Fall 2003 Introduction to MATLAB Longin Jan Latecki Based on the lectures of Rolf Lakaemper and David Young.
Fall 1999 Copyright © R. H. Taylor Given a linear systemAx -b = e, Linear Least Squares (sometimes written Ax  b) We want to minimize the sum.
Advanced Computer Graphics Spring 2014 K. H. Ko School of Mechatronics Gwangju Institute of Science and Technology.
+ Mixing Paint Rational Equations. + Paint Mixing 1) You have a 12 pint mixture of paint that is made up of equal amounts of blue paint and yellow paint.
Mona: Secure Multi-Owner Data Sharing for Dynamic Groups in the Cloud.
Singular Value Decomposition and Numerical Rank. The SVD was established for real square matrices in the 1870’s by Beltrami & Jordan for complex square.
Matrices.
Sect. 4.5: Cayley-Klein Parameters 3 independent quantities are needed to specify a rigid body orientation. Most often, we choose them to be the Euler.
CS246 Linear Algebra Review. A Brief Review of Linear Algebra Vector and a list of numbers Addition Scalar multiplication Dot product Dot product as a.
CSE 554 Lecture 8: Alignment
Singular Value Decomposition and its applications
Introduction The central problems of Linear Algebra are to study the properties of matrices and to investigate the solutions of systems of linear equations.
Introduction The central problems of Linear Algebra are to study the properties of matrices and to investigate the solutions of systems of linear equations.
Review of Linear Algebra
Updating M.O.D. Portfolios
Introduction to MATLAB
Singular Value Decomposition
Christopher Crawford PHY
Singular Value Decomposition SVD
Digital Imagery: The Basic Idea.
Maths for Signals and Systems Linear Algebra in Engineering Lectures 13 – 14, Tuesday 8th November 2016 DR TANIA STATHAKI READER (ASSOCIATE PROFFESOR)
Lecture 13: Singular Value Decomposition (SVD)
Linear Algebra: Matrix Eigenvalue Problems – Part 2
Presentation transcript:

Image Compression SVD Defuses the Bomb

Where Mathematics and Classical Art come together to combat terrorism

Dusty Wilson Western Washington University Graduate Student Instructor

In the midst of the political unrest in Russia, many nuclear warheads have mysteriously disappeared Russian Nuclear Facilities

Some missiles are believed in the hands of anti-American terrorist groups

In the interest of national security, the CIA has worked with the Russians to neutralize the terrorist threat.

Extreme political paranoia in Russia led to fitting their missiles with safety mechanisms.

Deactivation codes - 11 digit phone numbers - were encrypted in classical art.

Creation of Adam O 15 = 5 mod(10) 5 o

We hold the key to decode what is locked in the images.

However, the images are stored remotely and we must access them before we can decode the key

There is a ten minute window for us to access the images and deactivate the terrorist missiles.

For this, we need powerful and effective image compression.

Image Compression An application of the Singular Value Decomposition Theorem

The Way It Works. S V D Image Compression

ImageArray

Every color has a red, green, and blue (RGB) component. where each r i,j is the i,j th component of the matrix R. Define G and B in a similar manner.

Image R G B

R is real valued and has rank r. For simplicity, consider R

The Singular Value Decomposition Theorem

Any real valued matrix is the product of orthonormal and diagonal matrices. where the rank of R is r, U r and V r are orthonormal, and Σ r is an ordered diagonal matrix

Orthonormal and Diagonal Matrices What are they, and how hard do they bite?

Orthonormal rotates by θ. For example, the orthonormal matrix Visualize orthonormal matrices as rotations.

Diagonal Visualize diagonal transformations as a component-wise stretches mapsinto For example:

A diagonal matrix is ordered if where

An Example of The Singular Value Decomposition Theorem

Let R be where R has rank 2

The singular value decom- position of R is:

Which we recognize as

With fiddling, this is equal to

We visualize: 1.) A rotation by 2.) A diagonal stretch 3.) A rotation by

This can be seen in the following Mathematica animation

How does SVD apply to Image Compression ?

R Recall that R was the red component of an imageImageG B R

By the SVD Theorem

So SVD says: But Image Compression???

Approximate R with and continue on to

In particular, R r = R We have that

Choose the k such that R k approximates R to the desired degree

We measure the quality of an approximation by our satisfaction with the compressed image

This is illustrated in the following example Consider approximations of RR

Again

How much does SVD compress an image? What would we be satisfied with?

Each iteration costs 0.59% in storage 10 iterations = 5.9%

The  determine what percent of the original image is gained at each iteration. This can be seen in the following graph.

10 iterations gives 71.3%

100% 5.9% Original Approximation

So what are the drawbacks? Computing Power -

SVD requires more power than any groups other than the government, military, and some research institutes have.

For Example, the SVD of this image required 28 seconds On a Pentium II operating at 300mhz with 128mb of RAM on MATLAB v6

More dramatically, SVD on this image took 6 min 31 sec On a Pentium II operating at 300mhz with 128mb of RAM on MATLAB v6

Now that the power and limitations of SVD are evident, it is time to save our nation from terrorists

Solutions (1) American Gothic (3) Mona Lisa (6) Last Supper (0) Old Guitar Player (6) Praying Hands (5) Washington Crossing the Delaware (0) Sunday Afternoon On La Grande Jatte (4) David (8) The Thinker (3) The Scream (6) Waterfall Feel free to call 1 (360) to confirm that the world is safe once more for the American people. (You are also free to call and chat;-)

Now that the world is safe from terrorists and I have explained singular value decomposition...

Special thanks to Charlene Wilson my wonderful wife Dr. John Woll my academic advisor

Additional thanks to Peter Caldwell Alison Haukaas Audrey Kalinowski Doug Ronne Vika Savalei Nathaniel Wilson Dean J Alan Ross Travel Fund Travel Fund Dr. Tjalling Ypma Math Dept. Staff WWU Graduate School Staff School Staff

Dusty Wilson Graduate Student Instructor Western Washington University (360)

Historical Notes SVD was independently discovered and rediscovered a number of times including: Eugenio Beltrami ( ) in 1873 M.E. Camille Jordan ( ) in 1875 James J. Sylvester ( ) in 1889 L. Autonne in 1913 C. Eckart and G. Young in 1936