Daniel Dadush Centrum Wiskunde & Informatica (CWI) Aussois 2019

Slides:



Advertisements
Similar presentations
1/15 Agnostically learning halfspaces FOCS /15 Set X, F class of functions f: X! {0,1}. Efficient Agnostic Learner w.h.p. h: X! {0,1} poly(1/ )
Advertisements

Efficient classification for metric data Lee-Ad GottliebWeizmann Institute Aryeh KontorovichBen Gurion U. Robert KrauthgamerWeizmann Institute TexPoint.
Sublinear-time Algorithms for Machine Learning Ken Clarkson Elad Hazan David Woodruff IBM Almaden Technion IBM Almaden.
Shortest Vector In A Lattice is NP-Hard to approximate
Fearful Symmetry: Can We Solve Ideal Lattice Problems Efficiently?
Enumerative Lattice Algorithms in any Norm via M-Ellipsoid Coverings Daniel Dadush (CWI) Joint with Chris Peikert and Santosh Vempala.
The Stability of a Good Clustering Marina Meila University of Washington
Computer vision: models, learning and inference Chapter 8 Regression.
Advanced Topics in Algorithms and Data Structures Lecture 7.1, page 1 An overview of lecture 7 An optimal parallel algorithm for the 2D convex hull problem,
10/11/2001Random walks and spectral segmentation1 CSE 291 Fall 2001 Marina Meila and Jianbo Shi: Learning Segmentation by Random Walks/A Random Walks View.
Complexity 16-1 Complexity Andrei Bulatov Non-Approximability.
Probabilistic Methods in Coding Theory: Asymmetric Covering Codes Joshua N. Cooper UCSD Dept. of Mathematics Robert B. Ellis Texas A&M Dept. of Mathematics.
Approximate Nearest Neighbors and the Fast Johnson-Lindenstrauss Transform Nir Ailon, Bernard Chazelle (Princeton University)
1 Variance Reduction via Lattice Rules By Pierre L’Ecuyer and Christiane Lemieux Presented by Yanzhi Li.
Oded Regev Tel-Aviv University On Lattices, Learning with Errors, Learning with Errors, Random Linear Codes, Random Linear Codes, and Cryptography and.
Lecture 4 Unsupervised Learning Clustering & Dimensionality Reduction
OBBTree: A Hierarchical Structure for Rapid Interference Detection Gottschalk, M. C. Lin and D. ManochaM. C. LinD. Manocha Department of Computer Science,
Clustering In Large Graphs And Matrices Petros Drineas, Alan Frieze, Ravi Kannan, Santosh Vempala, V. Vinay Presented by Eric Anderson.
cover times, blanket times, and majorizing measures Jian Ding U. C. Berkeley James R. Lee University of Washington Yuval Peres Microsoft Research TexPoint.
Diophantine Approximation and Basis Reduction
1 Energy-aware stage illumination. Written by: Friedrich Eisenbrand Stefan Funke Andreas Karrenbauer Domagoj Matijevic Presented By: Yossi Maimon.
Orthogonality and Least Squares
Quantum Computing MAS 725 Hartmut Klauck NTU
13 th Nov Geometry of Graphs and It’s Applications Suijt P Gujar. Topics in Approximation Algorithms Instructor : T Kavitha.
A Sieving Algorithm for Approximate Integer Programming Daniel Dadush, CWI.
Cover times, blanket times, and the GFF Jian Ding Berkeley-Stanford-Chicago James R. Lee University of Washington Yuval Peres Microsoft Research.
Lattice-based cryptography and quantum Oded Regev Tel-Aviv University.
Lecture 14 Lower Bounds Decision tree model Linear-time reduction.
Data Visualization Fall The Data as a Quantity Quantities can be classified in two categories: Intrinsically continuous (scientific visualization,
Central Limit Theorem Let X 1, X 2, …, X n be n independent, identically distributed random variables with mean  and standard deviation . For large n:
The Poincaré Constant of a Random Walk in High- Dimensional Convex Bodies Ivona Bezáková Thesis Advisor: Prof. Eric Vigoda.
Common Intersection of Half-Planes in R 2 2 PROBLEM (Common Intersection of half- planes in R 2 ) Given n half-planes H 1, H 2,..., H n in R 2 compute.
PATTERN RECOGNITION AND MACHINE LEARNING CHAPTER 1: INTRODUCTION.
Open Problems in Streaming
Rotation Invariant Minkowski Classes Vienna University of Technology
Understanding Generalization in Adaptive Data Analysis
Distance Computation “Efficient Distance Computation Between Non-Convex Objects” Sean Quinlan Stanford, 1994 Presentation by Julie Letchner.
Haim Kaplan and Uri Zwick
Background: Lattices and the Learning-with-Errors problem
Computability and Complexity
Effcient quantum protocols for XOR functions
Additive Combinatorics and its Applications in Theoretical CS
Polyhedron Here, we derive a representation of polyhedron and see the properties of the generators. We also see how to identify the generators. The results.
Subhash Khot Theory Group
Hiroshi Hirai University of Tokyo
Linear sketching with parities
CSCI B609: “Foundations of Data Science”
Uri Zwick – Tel Aviv Univ.
Maximum vanishing subspace problem, CAT(0)-space relaxation, and block-triangularization of partitioned matrix Hiroshi Hirai University of Tokyo
Polyhedron Here, we derive a representation of polyhedron and see the properties of the generators. We also see how to identify the generators. The results.
Linear sketching over
Orthogonality and Least Squares
Linear sketching with parities
Compute convex lower bounding function and optimize it instead!
Chapter 11 Limitations of Algorithm Power
Lattices. Svp & cvp. lll algorithm. application in cryptography
Classical Algorithms from Quantum and Arthur-Merlin Communication Protocols Lijie Chen MIT Ruosong Wang CMU.
Feature space tansformation methods
Generally Discriminant Analysis
I.4 Polyhedral Theory (NW)
On The Quantitative Hardness of the Closest Vector Problem
Data Transformations targeted at minimizing experimental variance
Sphere Packing and Kepler’s Conjecture
Lecture 15: Least Square Regression Metric Embeddings
I.4 Polyhedral Theory.
Generalization bounds for uniformly stable algorithms
Clustering.
President’s Day Lecture: Advanced Nearest Neighbor Search
Orthogonality and Least Squares
A quantum machine learning algorithm based on generative models
Presentation transcript:

Daniel Dadush Centrum Wiskunde & Informatica (CWI) Aussois 2019 On Approximating the Covering Radius and Finding Dense Lattice Subspaces Daniel Dadush Centrum Wiskunde & Informatica (CWI) Aussois 2019

Lattices A lattice ℒ⊆ ℝ 𝑛 is 𝐵 ℤ 𝑛 for a basis 𝐵= 𝑏 1 ,…, 𝑏 𝑛 . ℒ(𝐵) denotes the lattice generated by 𝐵. Note: a lattice has many equivalent bases. 𝑏 1 𝑏 2 ℒ

Lattices A lattice ℒ⊆ ℝ 𝑛 is 𝐵 ℤ 𝑛 for a basis 𝐵= 𝑏 1 ,…, 𝑏 𝑛 . ℒ(𝐵) denotes the lattice generated by 𝐵. The determinant of ℒ is | det 𝐵 | . 𝑏 1 𝑏 2 ℒ

Lattices A lattice ℒ⊆ ℝ 𝑛 is 𝐵 ℤ 𝑛 for a basis 𝐵= 𝑏 1 ,…, 𝑏 𝑛 . ℒ(𝐵) denotes the lattice generated by 𝐵. The determinant of ℒ is | det 𝐵 | . Equal to volume of any tiling set. 𝑏 1 𝑏 2 ℒ

Notation 𝑀⊆ℒ sublattice of dimension 𝑘 Normalized Determinant: nd 𝑀 ≔ det 𝑀 1 𝑘 Projected Sublattice: ℒ 𝑀 ≔ Π span 𝑀 ⊥ (ℒ)

ℓ 2 Covering Radius 𝜇 ℒ ≔𝜇 𝐵 2 𝑛 ,ℒ 𝜇 ℒ ≔𝜇 𝐵 2 𝑛 ,ℒ Distance of farthest point to the lattice ℒ. 𝜇 𝒱 ℒ Voronoi cell 𝒱≔ all points closest to 0

Distance of farthest point to the lattice ℒ. ℓ 2 Covering Radius 𝜇 ℒ ≔𝜇 𝐵 2 𝑛 ,ℒ Distance of farthest point to the lattice ℒ. 𝜇 𝒱 ℒ Question: Does the covering radius admit a “good” dual characterization?

Volumetric Lower Bounds vol 𝑛 𝐵 2 𝑛 𝜇 ℒ ≥ vol 𝑛 𝒱 = det (ℒ) 𝜇 𝒱 ℒ

Volumetric Lower Bounds 𝜇(ℒ) ≥ vol 𝑛 𝐵 2 𝑛 − 1 𝑛 det ℒ 1 𝑛 𝜇 𝒱 ℒ

Volumetric Lower Bounds 𝜇 ℒ ≿ 𝑛 det ℒ 1 𝑛 ≔ dim ℒ nd(ℒ) 𝜇 𝒱 ℒ

Volumetric Lower Bounds 𝜇 ℒ ≥𝜇 ℒ/𝑀 ≿ dim ℒ 𝑀 nd(ℒ/𝑀) ℒ 𝜇 ℒ/𝑀 𝑀

ℓ 2 Kannan-Lovász Constant Define 𝐶 𝐾𝐿,2 (𝑛) to be smallest number such that 𝜇 ℒ ≤ 𝐶 𝐾𝐿,2 (𝑛) max 𝑀⊆ℒ dim ℒ 𝑀 nd(ℒ/𝑀) for all lattices of dimension at most 𝑛. 𝐶 𝐾𝐿,2 𝑛 =Ω( log 𝑛 ) : Basis 𝑒 1 , 1 2 𝑒 2 ,…, 1 𝑛 𝑒 𝑛 . Kannan−Lovász `88: 𝐶 𝐾𝐿,2 𝑛 =𝑂( 𝑛 )

ℓ 2 Kannan-Lovász Conjecture Define 𝐶 𝐾𝐿,2 (𝑛) to be smallest number such that 𝜇 ℒ ≤ 𝐶 𝐾𝐿,2 (𝑛) max 𝑀⊆ℒ dim ℒ 𝑀 nd(ℒ/𝑀) for all lattices of dimension at most 𝑛. 𝐶 𝐾𝐿,2 𝑛 =Ω( log 𝑛 ) : Basis 𝑒 1 , 1 2 𝑒 2 ,…, 1 𝑛 𝑒 𝑛 . Kannan−Lovász `88: 𝐶 𝐾𝐿,2 𝑛 =𝑂( log 𝑛 )

ℓ 2 KL Conjecture Resolution D. Regev 16: Reduction to Reverse Minkowski Conj. If all sublattices of ℒ have determinant at least 1 then ∀𝑟>0 ℒ∩𝑟 𝐵 2 𝑛 ≤exp⁡(polylog 𝑛 𝑟 2 ). Regev-S. Davidowitz 17: Reverse Minkowski proved. 𝐶 𝐾𝐿,2 𝑛 =𝑂( log 3 2 𝑛 ) Questions: 1. Can we compute KL projections? 2. Is there a better characterization?

Canonical Polygon [Stuhler 76] 𝑛 dimensional lattice ℒ 𝒫(ℒ) Log det (𝑛, log det ℒ ) (0,0) dim. 1 2 𝑛-1 𝑛 { 𝑘, log det 𝑀 :sublattice 𝑀⊆ℒ, dim 𝑀 =𝑘 }

Canonical Filtration [Stuhler 76] 𝑛 dimensional lattice ℒ ℒ Log det Vertices of 𝒫(ℒ) ℒ 2 (𝑛, log det ℒ ) (0,0) ℒ 1 {0} dim. 1 2 𝑛-1 𝑛 Form Chain: 0 = ℒ 0 ⊂ ℒ 1 ⊂⋯⊂ ℒ 𝑘 =ℒ

Canonical Filtration [Stuhler 76] 𝑛 dimensional lattice ℒ Slope: ln nd( ℒ 2 ℒ 1 ) ℒ Log det ℒ 2 (𝑛, log det ℒ ) (0,0) ℒ 1 {0} dim. 1 2 𝑛-1 𝑛 Form Chain: 0 = ℒ 0 ⊂ ℒ 1 ⊂⋯⊂ ℒ 𝑘 =ℒ

Stable Lattice [Stuhler 76] 𝑛 dimensional lattice ℒ is stable I.e. no dense sublattices ℒ Log det (𝑛, log det ℒ ) (0,0) {0} dim. 1 2 𝑛-1 𝑛 If canonical filtration is trivial: 0 ⊂ℒ

ℓ 2 KL for stable lattices 𝐶 𝑛 := max ℒ 𝜇 ℒ dim ℒ , where ℒ ranges over all stable lattices of det 1 and dimension ≤𝑛. Conjecture [Shapira-Weiss 16]: 𝐶 𝑛 =𝑂(1) ( ℤ 𝑛 is worst-case) Regev-S. Davidowitz 17: 𝐶 𝑛 =𝑂( log 𝑛 )

Canonical filtration and ℓ 2 KL Regev-S. Davidowitz 17: For the canonical filtration 0 = ℒ 0 ⊂ ℒ 1 ⊂⋯⊂ ℒ 𝑘 =ℒ we have that 𝜇 ℒ 2 ≤ 𝐶 𝑛 2 𝑖∈ 𝑘 dim ( ℒ 𝑖 ℒ 𝑖−1 ) nd ℒ 𝑖 ℒ 𝑖−1 2 ≤ log 𝑛 𝐶 𝑛 2 max i∈[𝑘] dim ( ℒ ℒ 𝑖−1 ) nd ℒ ℒ 𝑖−1 2

Above NP certificate tight up to 𝐶 𝑛 ! Main Results Theorem [D. 18]: 1. Can compute 𝑂( log 𝑛 ) ``approximate’’ canonical filtration in 2 𝑂(𝑛) time. 2. For any chain 0 = ℒ 0 ⊂ ℒ 1 ⊂⋯⊂ ℒ 𝑘 =ℒ 𝜇 ℒ 2 ≿ 𝑖∈ 𝑘 dim ( ℒ 𝑖 ℒ 𝑖−1 ) nd ℒ ℒ 𝑖−1 2 Above NP certificate tight up to 𝐶 𝑛 !

Densest Sublattice Problem 𝜏 ℒ ≔ min 𝑀⊆ℒ 𝑀≠{0} nd(𝑀) 𝛼-DSP: Given ℒ find 𝑀⊆ℒ, 𝑀≠{0} such that nd 𝑀 ≤𝛼 𝜏(ℒ). Remark: dimension of 𝑀 is not fixed! Key primitive for finding sparse lattice projections.

Densest Sublattice Problem 𝑛 dimensional lattice ℒ Want sublattice with slope ≤ log 𝛼 + log nd ( ℒ 1 ) ℒ Log det ℒ 2 (𝑛, log det ℒ ) (0,0) ℒ 1 {0} dim. 1 2 𝑛-1 𝑛

Densest Sublattice Problem Theorem: Can solve 𝑂( log 𝑛 )-DSP in 2 𝑂(𝑛) time with high probability. High Level Approach: If ℒ is not approximate minimizer: find 𝑦≠0, orthogonal to actual minimizer, and recurse on ℒ∩ 𝑦 ⊥

Densest Sublattice Problem High Level Approach: If ℒ is not approximate minimizer: find 𝑦≠0, orthogonal to actual minimizer, and recurse on ℒ∩ 𝑦 ⊥ Q: Where to find 𝑦? A: The dual lattice ℒ ∗ Q: How to find it in ℒ ∗ ? A: Discrete Gaussian sampling

Discrete Gaussian Distribution 6:30-8:30 Aharonov and Regev use the periodic Gaussian function. You can see how oracle access to this can be helpful.

Discrete Gaussian Distribution Aggarwal-D.-Regev-S. Davidowitz: `15: Can sample in 2 𝑛+𝑜(𝑛) time for any parameter. 6:30-8:30 Aharonov and Regev use the periodic Gaussian function. You can see how oracle access to this can be helpful.

Conclusions Open Problem Algorithmic version of ℓ 2 KL conjecture. Lower bound certificates for covering radius that are conjecturally tight within 𝑂(1). Open Problem Prove that ℓ 2 KL for stable lattices is 𝑂(1). Prove KL conjecture for general convex bodies.

Kannan-Lovász (KL) Conjecture 𝑃= 1 0 0 1 𝐾 If 𝐾∩ ℤ 𝑛 =∅ then ∃ 𝑘∈[𝑛], 𝑃∈ ℤ 𝑘×𝑛 , 𝑟𝑎𝑛𝑘 𝑃 =𝑘 such that vol 𝑃𝐾 1 𝑘 ≤𝑂( log 𝑛 ). [Kannan `87, Kannan-Lovász `88]