Rank Bounds for Design Matrices and Applications Shubhangi Saraf Rutgers University Based on joint works with Albert Ai, Zeev Dvir, Avi Wigderson.

Slides:



Advertisements
Similar presentations
Numerical Linear Algebra in the Streaming Model Ken Clarkson - IBM David Woodruff - IBM.
Advertisements

Approximate List- Decoding and Hardness Amplification Valentine Kabanets (SFU) joint work with Russell Impagliazzo and Ragesh Jaiswal (UCSD)
Applied Informatics Štefan BEREŽNÝ
Elementary Linear Algebra Anton & Rorres, 9th Edition
1.5 Elementary Matrices and a Method for Finding
12.1 Systems of Linear Equations: Substitution and Elimination.
Matrices & Systems of Linear Equations
Bichromatic and Equichromatic Lines in C 2 and R 2 George B Purdy Justin W Smith 1.
Chapter 5 Orthogonality
Lecture 19 Quadratic Shapes and Symmetric Positive Definite Matrices Shang-Hua Teng.
Matrices. Special Matrices Matrix Addition and Subtraction Example.
Multivariable Control Systems Ali Karimpour Assistant Professor Ferdowsi University of Mashhad.
Lecture 20 SVD and Its Applications Shang-Hua Teng.
ENGG2013 Unit 9 3x3 Determinant
Chapter 1 Systems of Linear Equations
Linear Equations in Linear Algebra
10.1 Gaussian Elimination Method
Boot Camp in Linear Algebra Joel Barajas Karla L Caballero University of California Silicon Valley Center October 8th, 2008.
化工應用數學 授課教師: 郭修伯 Lecture 9 Matrices
Arithmetic Operations on Matrices. 1. Definition of Matrix 2. Column, Row and Square Matrix 3. Addition and Subtraction of Matrices 4. Multiplying Row.
2.5 Zeros of Polynomial Functions
Linear Algebra With Applications by Otto Bretscher. Page The Determinant of any diagonal nxn matrix is the product of its diagonal entries. True.
1 1.1 © 2012 Pearson Education, Inc. Linear Equations in Linear Algebra SYSTEMS OF LINEAR EQUATIONS.
Compiled By Raj G. Tiwari
System of Linear Equations Nattee Niparnan. LINEAR EQUATIONS.
 Row and Reduced Row Echelon  Elementary Matrices.
Systems of Linear Equation and Matrices
Matrix Algebra. Quick Review Quick Review Solutions.
Row rows A matrix is a rectangular array of numbers. We subscript entries to tell their location in the array Matrices are identified by their size.
WEEK 8 SYSTEMS OF EQUATIONS DETERMINANTS AND CRAMER’S RULE.
January 22 Review questions. Math 307 Spring 2003 Hentzel Time: 1:10-2:00 MWF Room: 1324 Howe Hall Instructor: Irvin Roy Hentzel Office 432 Carver Phone.
What you will learn 1. What an identity matrix is
Matrices CHAPTER 8.1 ~ 8.8. Ch _2 Contents  8.1 Matrix Algebra 8.1 Matrix Algebra  8.2 Systems of Linear Algebra Equations 8.2 Systems of Linear.
Algebra 3: Section 5.5 Objectives of this Section Find the Sum and Difference of Two Matrices Find Scalar Multiples of a Matrix Find the Product of Two.
Section 4.3 Zeros of Polynomials. Approximate the Zeros.
Three different ways There are three different ways to show that ρ(A) is a simple eigenvalue of an irreducible nonnegative matrix A:
Chapter 3 Determinants Linear Algebra. Ch03_2 3.1 Introduction to Determinants Definition The determinant of a 2  2 matrix A is denoted |A| and is given.
3.4 Zeros of Polynomial Functions. The Fundamental Theorem of Algebra If f(x) is a polynomial of degree n, where n>0, then f has at least one zero in.
ADVANTAGE of GENERATOR MATRIX:
Chap. 4 Vector Spaces 4.1 Vectors in Rn 4.2 Vector Spaces
Information Theory Linear Block Codes Jalal Al Roumy.
Chapter 6 Systems of Linear Equations and Matrices Sections 6.3 – 6.5.
Chapter 1 Systems of Linear Equations Linear Algebra.
Chapter 2 Determinants. With each square matrix it is possible to associate a real number called the determinant of the matrix. The value of this number.
Linear Algebra Chapter 2 Matrices.
Notes Over 10.5 Using Cramer’s Rule for a 2 x 2 System
2.5 – Determinants and Multiplicative Inverses of Matrices.
Section 2.1 Determinants by Cofactor Expansion. THE DETERMINANT Recall from algebra, that the function f (x) = x 2 is a function from the real numbers.
Chapter 5 Chapter Content 1. Real Vector Spaces 2. Subspaces 3. Linear Independence 4. Basis and Dimension 5. Row Space, Column Space, and Nullspace 6.
Boot Camp in Linear Algebra TIM 209 Prof. Ram Akella.
Linear Algebra Engineering Mathematics-I. Linear Systems in Two Unknowns Engineering Mathematics-I.
2.1 Matrix Operations 2. Matrix Algebra. j -th column i -th row Diagonal entries Diagonal matrix : a square matrix whose nondiagonal entries are zero.
Linear Algebra With Applications by Otto Bretscher.
Linear Equations in Linear Algebra
College Algebra Chapter 3 Polynomial and Rational Functions
Combinatorial Spectral Theory of Nonnegative Matrices
Sublinear-Time Error-Correction and Error-Detection
GROUPS & THEIR REPRESENTATIONS: a card shuffling approach
2. Matrix Algebra 2.1 Matrix Operations.
4.6: Rank.
CSE 541 – Numerical Methods
Linear Algebra Lecture 18.
College Algebra Chapter 6 Matrices and Determinants and Applications
Linear Algebra Lecture 20.
Linear Equations in Linear Algebra
3.IV. Change of Basis 3.IV.1. Changing Representations of Vectors
Matrices are identified by their size.
Elementary Linear Algebra Anton & Rorres, 9th Edition
Zeev Dvir (Princeton) Shachar Lovett (IAS)
Presentation transcript:

Rank Bounds for Design Matrices and Applications Shubhangi Saraf Rutgers University Based on joint works with Albert Ai, Zeev Dvir, Avi Wigderson

Sylvester-Gallai Theorem (1893) v v v v Suppose that every line through two points passes through a third

Sylvester Gallai Theorem v v vv Suppose that every line through two points passes through a third

Proof of Sylvester-Gallai: By contradiction. If possible, for every pair of points, the line through them contains a third. Consider the point-line pair with the smallest distance. ℓ P m Q dist(Q, m) < dist(P, ℓ) Contradiction!

Several extensions and variations studied – Complexes, other fields, colorful, quantitative, high-dimensional Several recent connections to complexity theory – Structure of arithmetic circuits – Locally Correctable Codes BDWY: – Connections of Incidence theorems to rank bounds for design matrices – Lower bounds on the rank of design matrices – Strong quantitative bounds for incidence theorems – 2-query LCCs over the Reals do not exist This work: builds upon their approach – Improved and optimal rank bounds – Improved and often optimal incidence results – Stable incidence thms stable LCCs over R do not exist

The Plan Extensions of the SG Theorem Improved rank bounds for design matrices From rank bounds to incidence theorems Proof of rank bound Stable Sylvester-Gallai Theorems – Applications to LCCs

Points in Complex space Hesse Configuration [Elkies, Pretorius, Swanpoel 2006]: First elementary proof This work: New proof using basic linear algebra

Quantitative SG vivi

Stable Sylvester-Gallai Theorem v v v v

Stable Sylvester Gallai Theorem v v vv

Other extensions High dimensional Sylvester-Gallai Theorem Colorful Sylvester-Gallai Theorem Average Sylvester-Gallai Theorem Generalization of Freiman’s Lemma

The Plan Extensions of the SG Theorem Improved rank bounds for design matrices From rank bounds to incidence theorems Proof of rank bound Stable Sylvester-Gallai Theorems – Applications to LCCs

Design Matrices An m x n matrix is a (q,k,t)-design matrix if: 1.Each row has at most q non-zeros 2.Each column has at least k non-zeros 3.The supports of every two columns intersect in at most t rows m n · t · q ¸ k

(q,k,t)-design matrix q = 3 k = 5 t = 2 An example

Not true over fields of small characteristic! Holds for any field of char=0 (or very large positive char) Main Theorem: Rank Bound

Rank Bound: no dependence on q

Square Matrices Any matrix over the Reals/complex numbers with same zero-nonzero pattern as incidence matrix of the projective plane has high rank – Not true over small fields! Rigidity?

The Plan Extensions of the SG Theorem Improved rank bounds for design matrices From rank bounds to incidence theorems Proof of rank bound Stable Sylvester-Gallai Theorems – Applications to LCCs

Rank Bounds to Incidence Theorems

The Plan Extensions of the SG Theorem Improved rank bounds for design matrices From rank bounds to incidence theorems Proof of rank bound Stable Sylvester-Gallai Theorems – Applications to LCCs

Proof Easy case: All entries are either zero or one AtAt A = m m n n n n Diagonal entries ¸ k Off-diagonals · t “diagonal-dominant matrix”

Idea (BDWY) : reduce to easy case using matrix- scaling: r1r rmr1r rm c 1 c 2 … c n Replace A ij with r i ¢ c j ¢ A ij r i, c j positive reals Same rank, support. Has ‘balanced’ coefficients: General Case: Matrix scaling

Matrix scaling theorem Sinkhorn (1964) / Rothblum and Schneider (1989) Thm: Let A be a real m x n matrix with non- negative entries. Suppose every zero minor of A of size a x b satisfies Then for every ² there exists a scaling of A with row sums 1 ± ² and column sums (m/n) ± ² Can be applied also to squares of entries!

Bounding the rank of perturbed identity matrices

The Plan Extensions of the SG Theorem Improved rank bounds for design matrices From rank bounds to incidence theorems Proof of rank bound Stable Sylvester-Gallai Theorems – Applications to LCCs

Stable Sylvester-Gallai Theorem v v v v

Stable Sylvester Gallai Theorem v v vv

Not true in general..

Bounded Distances

Theorem

Incidence theorems to design matrices

proof

The Plan Extensions of the SG Theorem Improved rank bounds for design matrices From rank bounds to incidence theorems Proof of rank bound Stable Sylvester-Gallai Theorems – Applications to LCCs

Correcting from Errors Message Encoding Corrupted Encoding Correction Decoding

Local Correction & Decoding Message Encoding Corrupted Encoding Correction Decoding Local

Stable Codes over the Reals

Our Results Constant query stable LCCs over the Reals do not exist. (Was not known for 2-query LCCs) There are no constant query LCCs over the Reals with decoding using bounded coefficients

Thanks!