SUPER: Sparse signals with Unknown Phases Efficiently Recovered Sheng Cai, Mayank Bakshi, Sidharth Jaggi and Minghua Chen The Chinese University of Hong.

Slides:



Advertisements
Similar presentations
Image acquisition using sparse (pseudo)-random matrices Piotr Indyk MIT.
Advertisements

CS 206 Introduction to Computer Science II 11 / 07 / 2008 Instructor: Michael Eckmann.
Graph Theory - I. Today’s Plan Introduction Special Graphs Various Representations Depth First Search Solve a problem from GCJ Breadth First Search Solve.
Algebra Recap Solve the following equations (i) 3x + 7 = x (ii) 3x + 1 = 5x – 13 (iii) 3(5x – 2) = 4(3x + 6) (iv) 3(2x + 1) = 2x + 11 (v) 2(x + 2)
Beyond Nyquist: Compressed Sensing of Analog Signals
Noisy Group Testing (Quick and Efficient) Sheng Cai, Mayank Bakshi, Sidharth Jaggi The Chinese University of Hong Kong Mohammad Jahangoshahi Sharif University.
1 Network Coding: Theory and Practice Apirath Limmanee Jacobs University.
1 Representing Graphs. 2 Adjacency Matrix Suppose we have a graph G with n nodes. The adjacency matrix is the n x n matrix A=[a ij ] with: a ij = 1 if.
Network Coding Project presentation Communication Theory 16:332:545 Amith Vikram Atin Kumar Jasvinder Singh Vinoo Ganesan.
Random Convolution in Compressive Sampling Michael Fleyer.
I.1 ii.2 iii.3 iv.4 1+1=. i.1 ii.2 iii.3 iv.4 1+1=
I.1 ii.2 iii.3 iv.4 1+1=. i.1 ii.2 iii.3 iv.4 1+1=
6.829 Computer Networks1 Compressed Sensing for Loss-Tolerant Audio Transport Clay, Elena, Hui.
Tirgul 7 Review of graphs Graph algorithms: – BFS (next tirgul) – DFS – Properties of DFS – Topological sort.
Non-adaptive probabilistic group testing with noisy measurements: Near-optimal bounds with efficient algorithms Chun Lam Chan, Pak Hou Che and Sidharth.
Many quadratic equations can not be solved by factoring. Other techniques are required to solve them. 7.1 – Completing the Square x 2 = 20 5x =
Compressive sensing SHO-FA: Robust compressive sensing with order-optimal complexity, measurements, and bits 1 Mayank Bakshi, Sidharth Jaggi, Sheng Cai.
13-1 Introduction to Quadratic Equations  CA Standards 14.0 and 21.0  Quadratic Equations in Standard Form.
Feng Lu Chuan Heng Foh, Jianfei Cai and Liang- Tien Chia Information Theory, ISIT IEEE International Symposium on LT Codes Decoding: Design.
Game Theory Meets Compressed Sensing
Simple and Improved Parameterized Algorithms for Multiterminal Cuts Mingyu Xiao The Chinese University of Hong Kong Hong Kong SAR, CHINA CSR 2008 Presentation,
Cs: compressed sensing
Phase Retrieval from the Short-Time Fourier Transform
Fast and robust sparse recovery New Algorithms and Applications The Chinese University of Hong Kong The Institute of Network Coding Sheng Cai Eric Chan.
User Cooperation via Rateless Coding Mahyar Shirvanimoghaddam, Yonghui Li, and Branka Vucetic The University of Sydney, Australia IEEE GLOBECOM 2012 &
International Workshop on Complex Networks, Seoul (23-24 June 2005) Vertex Correlations, Self-Avoiding Walks and Critical Phenomena on the Static Model.
Performed by: Ron Amit Supervisor: Tanya Chernyakova In cooperation with: Prof. Yonina Eldar 1 Part A Final Presentation Semester: Spring 2012.
Stochastic Threshold Group Testing Chun Lam Chan, Sheng Cai, Mayank Bakshi, Sidharth Jaggi The Chinese University of Hong Kong Venkatesh Saligrama Boston.
8.1.4 Can it still be factored? Factoring Completely I can factor out a common factor.
Learning to Sense Sparse Signals: Simultaneous Sensing Matrix and Sparsifying Dictionary Optimization Julio Martin Duarte-Carvajalino, and Guillermo Sapiro.
Markov Chains and Random Walks. Def: A stochastic process X={X(t),t ∈ T} is a collection of random variables. If T is a countable set, say T={0,1,2, …
Javad Lavaei Department of Electrical Engineering Columbia University Convex Relaxation for Polynomial Optimization: Application to Power Systems and Decentralized.
PARALLEL FREQUENCY RADAR VIA COMPRESSIVE SENSING
Workshop on Optimization in Complex Networks, CNLS, LANL (19-22 June 2006) Application of replica method to scale-free networks: Spectral density and spin-glass.
Compressive sensing meets group testing: LP decoding for non-linear (disjunctive) measurements Chun Lam Chan, Sidharth Jaggi and Samar Agnihotri The Chinese.
5-5 Solving Quadratic Equations Objectives:  Solve quadratic equations.
KPS 2007 (April 19, 2007) On spectral density of scale-free networks Doochul Kim (Department of Physics and Astronomy, Seoul National University) Collaborators:
Table of Contents First get all nonzero terms on one side. Quadratic Equation: Solving by factoring Example: Solve 6x 2 – 13x = 8. 6x 2 – 13x – 8 = 0 Second.
Network RS Codes for Efficient Network Adversary Localization Sidharth Jaggi Minghua Chen Hongyi Yao.
4.8 “The Quadratic Formula” Steps: 1.Get the equation in the correct form. 2.Identify a, b, & c. 3.Plug numbers into the formula. 4.Solve, then simplify.
CHARACTERIZATION PRESENTATION ANAT KLEMPNER SPRING 2012 SUPERVISED BY: MALISA MARIJAN YONINA ELDAR A Compressed Sensing Based UWB Communication System.
Reliable Deniable Communication: Hiding Messages in Noise The Chinese University of Hong Kong The Institute of Network Coding Pak Hou Che Mayank Bakshi.
David Stotts Computer Science Department UNC Chapel Hill.
Reliable Deniable Communication: Hiding Messages from Noise Pak Hou Che Joint Work with Sidharth Jaggi, Mayank Bakshi and Madhi Jafari Siavoshani Institute.
Network Coding Tomography for Network Failures
Sampling in Graphs Alexandr Andoni (Microsoft Research)
ON AVCS WITH QUADRATIC CONSTRAINTS Farzin Haddadpour Joint work with Madhi Jafari Siavoshani, Mayank Bakshi and Sidharth Jaggi Sharif University of Technology,
MATH II – QUADRATICS to solve quadratic equations. MATH III – MATH II –
ICTP School and Workshop on Structure and Function of complex Networks (16-28 May 2005) Structural correlations and critical phenomena of random scale-free.
DISPLACED PHASE CENTER ANTENNA SAR IMAGING BASED ON COMPRESSED SENSING Yueguan Lin 1,2,3, Bingchen Zhang 1,2, Wen Hong 1,2 and Yirong Wu 1,2 1 National.
Dan O. Popa, Intro to EE, Freshman Seminar, Spring 2015 EE 1105 : Introduction to EE Freshman Seminar Lecture 4: Circuit Analysis Node Analysis, Mesh Currents.
P & NP.
M ? n m
Reliable Deniable Communication: Hiding Messages in Noise
Lecture 15 Sparse Recovery Using Sparse Matrices
PC trees and Circular One Arrangements
MST in Log-Star Rounds of Congested Clique
Uniform Linear Array based Spectrum Sensing from sub-Nyquist Samples
Find 4 A + 2 B if {image} and {image} Select the correct answer.
On Sequential Locally Repairable Codes
Sudocodes Fast measurement and reconstruction of sparse signals
Slides prepared on 09 September, 2018
Figure 8. Stages within the Phases of the Process
Index Notation Sunday, 24 February 2019.
Solving Equations 3x+7 –7 13 –7 =.
Aishwarya sreenivasan 15 December 2006.
 = N  N matrix multiplication N = 3 matrix N = 3 matrix N = 3 matrix
Bellwork: 2/13/18 Find each product.
Subspace Expanders and Low Rank Matrix Recovery
Presentation transcript:

SUPER: Sparse signals with Unknown Phases Efficiently Recovered Sheng Cai, Mayank Bakshi, Sidharth Jaggi and Minghua Chen The Chinese University of Hong Kong

b Compressive Sensing 2 ? ? n m k I. Introduction

b Compressive Phase Retrieval 2 ? ? k I. Introduction -2e iπ/3 Complex number m n 2 x → -x x →e iθ x

b Compressive Phase Retrieval ? ? k I. Introduction Applications: X-ray crystallography, Optics, Astronomical imaging… m n 2 Complex number

Compressive Phase Retrieval 2 ? ? I. Introduction Our contribution: 1. O(k) number of measurements (best known O(k) [1] ) 2. O(klogk) decoding complexity (best known O(knlogn) [2] ) [1] H. Ohlsson and Y. C. Eldar, “On conditions for uniqueness in sparse phase retrieval,” e-prints, arXiv: [2] K. Jaganathan, S. Oymak, and B. Hassibi, “Sparse phase retrieval: Convex algorithms and limitations,” in 2013 IEEE International Symposium on Information Theory Proceedings (ISIT), 2013, pp. 1022–1026. b m n

x2x2 x6x6 x5x5 x4x4 x3x3 b1b1 b2b2 b3b3 b4b4 x1x1 Bipartite graph n signal nodesO(k) measurement nodes k non-zero components II. Overview/High-Level Intuition 3

x2x2 x6x6 x5x5 x4x4 x3x3 b1b1 b2b2 b3b3 b4b4 x1x1 Bipartite Graph → Measurement Matrix II. Overview/High-Level Intuition & IV. Measurement Design x1x1 x2x2 x3x3 x4x4 x5x5 x6x6 b1b1 b2b2 b3b3 b4b4 Adjacent Matrix 4

x2x2 x6x6 x4x4 b1b1 b2b2 b3b3 b4b4 Useful Measurement Nodes n signal nodesO(k) measurement nodes II. Overview/High-Level Intuition 5

b1b1 b2b2 b3b3 b4b4 x2x2 x6x6 x4x4 Doubleton Multiton Singleton Useful Measurement Nodes II. Overview/High-Level Intuition 5

b1b1 b2b2 b3b3 b4b4 x2x2 x6x6 x4x4 Doubleton Multiton Singleton Useful Measurement Nodes Magnitude recovery Phase recovery Resolvable Δ |x 2 +x 4 | |x 2 | |x 4 | Solving a quadratic equation “Cancelling out” process: II. Overview/High-Level Intuition & V. Reconstruction Algorithm 5

Three Phases … n signal nodes … … Seeding Phase: Singletons and Resolvable Doubletons … Geometric-decay Phase: Resolvable Multitons … Cleaning-up Phase: Resolvable Multitons O(k) measurement nodes II. Overview/High-Level Intuition 6

Seeding Phase II. Overview/High-Level Intuition … n signal nodes … GIGI H 7

Seeding Phase II. Overview/High-Level Intuition … n signal nodes … GIGI “Sigma” Structure 7 x1x1 x2x2 H x2x2 x1x1

Seeding Phase II. Overview/High-Level Intuition … n signal nodes … GIGI H’ 7 H 1/2

Geometric-decay phase II. Overview/High-Level Intuition … n signal nodes … G II,l 1/4 H’ 8 H

Geometric-decay phase II. Overview/High-Level Intuition … n signal nodes … G II,l 1/8 O(k/logk) O(loglogk) stages H’ 8 H

Cleaning-up Phase II. Overview/High-Level Intuition … n signal nodes … G III |V( H ’)|=k H’ 9 H

Seeding Phase II. Overview/High-Level Intuition & III. Graph Properties … n signal nodes … ck measurement nodes … GIGI with prob. 1/k H H ’ Many Singletons Many Doubletons 10

Geometric-decay phase II. Overview/High-Level Intuition & III. Graph Properties … n signal nodes … ck/2 measurement nodes … G II,l H H ’ with prob. 2/k O(loglogk) Many Multitons 11

Geometric-decay phase II. Overview/High-Level Intuition & III. Graph Properties … n signal nodes … ck/4 measurement nodes … G II,l H H ’ with prob. 4/k O(k/logk) O(loglogk) 11 Many Multitons

Cleaning-up Phase II. Overview/High-Level Intuition & III. Graph Properties … n signal nodes … c(k/logk)log(k/logk) = O(k) measurement nodes … G III H H ’ |V( H ’)|=k with prob. logk/k Many Multitons 12

x2x2 x6x6 x5x5 x4x4 x3x3 b1b1 b2b2 b3b3 b4b4 x1x1 Bipartite Graph → Measurement Matrix II. Overview/High-Level Intuition & IV. Measurement Design Adjacent Matrix 13 x1x1 x2x2 x3x3 x4x4 x5x5 x6x6 b1b1 b2b2 b3b3 b4b4

x2x2 x5x5 b1b1 x1x1 Bipartite Graph → Measurement Matrix II. Overview/High-Level Intuition & IV. Measurement Design x1x1 x2x2 x3x3 x4x4 x5x5 x6x6 b1b1 b2b2 b3b3 b4b4 13

x2x2 x5x5 b1b1 x1x1 Bipartite Graph → Measurement Matrix II. Overview/High-Level Intuition & IV. Measurement Design x1x1 x2x2 x3x3 x4x4 x5x5 x6x6 b1b1 b2b2 b3b3 b4b4 α = (π/2)/n unit phase b 1,1 b 1,2 b 1,3 b 1,4 b 1,5 13

x2x2 x5x5 b1b1 x1x1 Bipartite Graph → Measurement Matrix II. Overview/High-Level Intuition & V. Reconstruction Algorithm α = (π/2)/n unit phase b 1,1 b 1,2 b 1,3 b 1,4 b 1,5 arctan(b 1,2 /ib 1,1 )/ α = 2 Guess: x 2 ≠ 0 and |x 2 | = b 1,1 /cos2α Verify: |x 2 | = b 1,5 ? 13

Seeding Phase: Giant Connected Component VI. Parameters Design O(k) different edges in graph H’ (By Coupon Collection) O(k) right nodes Each edge appears with prob. 1/k O(k) right nodes are singletons O(k) right nodes are doubletons Size of H’ is (1-f I )k (By percolation results) H H’ EXPECTATION! 14

Geometric-decay Phase VI. Parameters Design O(f II,l-1 k) different nodes appended in graph H’ (By Coupon Collection) O(f II,l-1 k) right nodes Each edge appears with prob. 1/f II,l-1 k O(f II,l-1 k) right nodes are resolvable multitons H H’ EXPECTATION! 15

VII. Performance of Algorithm Number of Measurements … n signal nodes … … … … Seeding Phase Geometric-decay Phase Cleaning-up Phase cf II,l-1 k measurement nodes O(k) ck measurement nodes O(k) c(k/logk)log(k/logk) measurement nodes O(k) 16

Decoding Complexity and Correctness BFS: O(|V|+|E|) for a graph G(V,E). O(k) in the seeding phase. “Cancelling out”: O(logk) for a right node. Overall decoding complexity is O(klogk). (1-ε II,l-1 )f II,l-1 <g II,l-1 <(1+ε II,l-1 )f lI,l-1 hold for all l. – Generalized/traditional coupon collection – Chernoff bound – Percolation results – Union bound VII. Performance of Algorithm 17

THANK YOU 謝謝