Compressive sensing SHO-FA: Robust compressive sensing with order-optimal complexity, measurements, and bits 1 Mayank Bakshi, Sidharth Jaggi, Sheng Cai.

Slides:



Advertisements
Similar presentations
1+eps-Approximate Sparse Recovery Eric Price MIT David Woodruff IBM Almaden.
Advertisements

Lower Bounds for Additive Spanners, Emulators, and More David P. Woodruff MIT and Tsinghua University To appear in FOCS, 2006.
Hardness of testing 3- colorability in bounded degree graphs Andrej Bogdanov Kenji Obata Luca Trevisan.
Peeling Arguments Invertible Bloom Lookup Tables and Biff Codes
Multi-Label Prediction via Compressed Sensing By Daniel Hsu, Sham M. Kakade, John Langford, Tong Zhang (NIPS 2009) Presented by: Lingbo Li ECE, Duke University.
Qiwen Wang, Sidharth Jaggi, Shuo-Yen Robert Li Institute of Network Coding (INC) The Chinese University of Hong Kong October 19, 2011 IEEE Information.
Online Social Networks and Media. Graph partitioning The general problem – Input: a graph G=(V,E) edge (u,v) denotes similarity between u and v weighted.
1 Efficient Subgraph Search over Large Uncertain Graphs Ye Yuan 1, Guoren Wang 1, Haixun Wang 2, Lei Chen 3 1. Northeastern University, China 2. Microsoft.
Noisy Group Testing (Quick and Efficient) Sheng Cai, Mayank Bakshi, Sidharth Jaggi The Chinese University of Hong Kong Mohammad Jahangoshahi Sharif University.
ECE Department Rice University dsp.rice.edu/cs Measurements and Bits: Compressed Sensing meets Information Theory Shriram Sarvotham Dror Baron Richard.
1 Representing Graphs. 2 Adjacency Matrix Suppose we have a graph G with n nodes. The adjacency matrix is the n x n matrix A=[a ij ] with: a ij = 1 if.
Near Shannon Limit Performance of Low Density Parity Check Codes
Distributed Regression: an Efficient Framework for Modeling Sensor Network Data Carlos Guestrin Peter Bodik Romain Thibaux Mark Paskin Samuel Madden.
1 On Compressing Web Graphs Michael Mitzenmacher, Harvard Micah Adler, Univ. of Massachusetts.
1 On the Anonymization of Sparse High-Dimensional Data 1 National University of Singapore 2 Chinese University of Hong.
Introduction to Compressive Sensing
Code and Decoder Design of LDPC Codes for Gbps Systems Jeremy Thorpe Presented to: Microsoft Research
Computing Sketches of Matrices Efficiently & (Privacy Preserving) Data Mining Petros Drineas Rensselaer Polytechnic Institute (joint.
Tracey Ho Sidharth Jaggi Tsinghua University Hongyi Yao California Institute of Technology Theodoros Dikaliotis California Institute of Technology Chinese.
Lattices for Distributed Source Coding - Reconstruction of a Linear function of Jointly Gaussian Sources -D. Krithivasan and S. Sandeep Pradhan - University.
Evaluation of Branch Predictors Using High-density-branch Programs Fang Pang MEng. Lei Zhu MEng. Electrical and Computer Engineering Department University.
Optimal Multicast Algorithms Sidharth Jaggi Michelle Effros Philip A. Chou Kamal Jain.
Hybrid Dense/Sparse Matrices in Compressed Sensing Reconstruction
Topological Surgery Progressive Forest Split Papers by Gabriel Taubin et al Presented by João Comba.
CS774. Markov Random Field : Theory and Application Lecture 10 Kyomin Jung KAIST Oct
Analysis of Iterative Decoding
SUPER: Sparse signals with Unknown Phases Efficiently Recovered Sheng Cai, Mayank Bakshi, Sidharth Jaggi and Minghua Chen The Chinese University of Hong.
Repairable Fountain Codes Megasthenis Asteris, Alexandros G. Dimakis IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, VOL. 32, NO. 5, MAY /5/221.
Game Theory Meets Compressed Sensing
Efficient Gathering of Correlated Data in Sensor Networks
Audio Compression Usha Sree CMSC 691M 10/12/04. Motivation Efficient Storage Streaming Interactive Multimedia Applications.
Fast and robust sparse recovery New Algorithms and Applications The Chinese University of Hong Kong The Institute of Network Coding Sheng Cai Eric Chan.
Adaptive Data Aggregation for Wireless Sensor Networks S. Jagannathan Rutledge-Emerson Distinguished Professor Department of Electrical and Computer Engineering.
Threshold Phenomena and Fountain Codes Amin Shokrollahi EPFL Joint work with M. Luby, R. Karp, O. Etesami.
Andrea Montanari and Ruediger Urbanke TIFR Tuesday, January 6th, 2008 Phase Transitions in Coding, Communications, and Inference.
Stochastic Threshold Group Testing Chun Lam Chan, Sheng Cai, Mayank Bakshi, Sidharth Jaggi The Chinese University of Hong Kong Venkatesh Saligrama Boston.
Shriram Sarvotham Dror Baron Richard Baraniuk ECE Department Rice University dsp.rice.edu/cs Sudocodes Fast measurement and reconstruction of sparse signals.
Design of a High-Throughput Low-Power IS95 Viterbi Decoder Xun Liu Marios C. Papaefthymiou Advanced Computer Architecture Laboratory Electrical Engineering.
Ramsey Properties of Random Graphs; A Sharp Threshold Proven via A Hypergraph Regularity Lemma. Ehud Friedgut, Vojtech Rödl, Andrzej Rucinski, Prasad.
Error control coding – binary linear codes Background material for linear error control codes.
When Affinity Meets Resistance On the Topological Centrality of Edges in Complex Networks Gyan Ranjan University of Minnesota, MN [Collaborators: Zhi-Li.
Low Density Parity Check codes
Bundle Adjustment A Modern Synthesis Bill Triggs, Philip McLauchlan, Richard Hartley and Andrew Fitzgibbon Presentation by Marios Xanthidis 5 th of No.
Some Computation Problems in Coding Theory
Network RS Codes for Efficient Network Adversary Localization Sidharth Jaggi Minghua Chen Hongyi Yao.
Reliable Deniable Communication: Hiding Messages in Noise The Chinese University of Hong Kong The Institute of Network Coding Pak Hou Che Mayank Bakshi.
Raptor Codes Amin Shokrollahi EPFL. BEC(p 1 ) BEC(p 2 ) BEC(p 3 ) BEC(p 4 ) BEC(p 5 ) BEC(p 6 ) Communication on Multiple Unknown Channels.
Reliable Deniable Communication: Hiding Messages from Noise Pak Hou Che Joint Work with Sidharth Jaggi, Mayank Bakshi and Madhi Jafari Siavoshani Institute.
ON AVCS WITH QUADRATIC CONSTRAINTS Farzin Haddadpour Joint work with Madhi Jafari Siavoshani, Mayank Bakshi and Sidharth Jaggi Sharif University of Technology,
Computational Molecular Biology Pooling Designs – Inhibitor Models.
SketchVisor: Robust Network Measurement for Software Packet Processing
Group Testing and Its Applications
Yu Wang1, Gao Cong2, Guojie Song1, Kunqing Xie1
RELIABLE COMMUNICATION
Cohesive Subgraph Computation over Large Graphs
Sathya Ronak Alisha Zach Devin Josh
M ? n m
Chapter 5. Greedy Algorithms
Reliable Deniable Communication: Hiding Messages in Noise
Lecture 15 Sparse Recovery Using Sparse Matrices
Towards Understanding the Invertibility of Convolutional Neural Networks Anna C. Gilbert1, Yi Zhang1, Kibok Lee1, Yuting Zhang1, Honglak Lee1,2 1University.
Benjamin Doerr Partial Colorings of Unimodular Hypergraphs.
The Communication Complexity of Distributed Set-Joins
Coverage Approximation Algorithms
Neuro-RAM Unit in Spiking Neural Networks with Applications
Jongik Kim1, Dong-Hoon Choi2, and Chen Li3
Alan Kuhnle*, Victoria G. Crawford, and My T. Thai
The travelling salesman problem
Author: Yi Lu, Balaji Prabhakar Publisher: INFOCOM’09
Approximate Graph Mining with Label Costs
Presentation transcript:

compressive sensing SHO-FA: Robust compressive sensing with order-optimal complexity, measurements, and bits 1 Mayank Bakshi, Sidharth Jaggi, Sheng Cai and Minghua Chen The Chinese University of Hong Kong FasterHigherStronger order-optimal complexity, measurements, and bits with Robust SHO-FA:

Compressive sensing 2 ? k ≤ m<n ? n m k

Robust compressive sensing Approximate sparsity Measurement noise 3 ? Random

4

Decoding complexity # of measurements ° RS’60 ° TG’07 ° CM’06 ° C’08 ° IR’08 ° SBB’06 ° GSTV’06 ° MV’12,KP’12 ° DJM’11  This work Lower bound

6 SHO(rt)-FA(st) Good Bad Good Bad

High-Level Overview n ck k= n ck k=2

High-Level Overview n ck k=2 How to find the leaf nodes and utilize the leaf nodes to do decoding How to guarantee the existence of leaf node

Left-regular Bipartite Graph n ck d=3 9 A Q1: How to guarantee the existence of leaf node?

Existence of leaf nodes 10 e.g., existence of 2-core in d-uniform hypergraph M. T. Goodrich and M. Mitzenmacher, “Invertible bloom lookup tables,” ArXiv.org e-Print archive, arXiv: [cs.DS], Sharp transition Q1: How to guarantee the existence of leaf node?

Existence of “Many” leafs ≥2|S| |S| L+L’≥2|S| 3|S|≥L+2L’ (L+L’)/(L+2L’) ≥2/3 11 L/(L+L’) ≥1/2 Q1: How to guarantee the existence of leaf node?

Bipartite Graph → Sensing Matrix n ck d=3 12 A Distinct weights Q2: How to find the leaf nodes and utilize the leaf nodes to do decoding?

Bipartite Graph → Sensing Matrix 13 n ck A Q2: How to find the leaf nodes and utilize the leaf nodes to do decoding?

14 Encoding Q2: How to find the leaf nodes and utilize the leaf nodes to do decoding?

15 Q2: How to find the leaf nodes and utilize the leaf nodes to do decoding? Decoding

Decoding – First Iteration 16

Decoding – Second Iteration 17 Verification Measurements

Decoding – Third Iteration 18

Decoding – Fourth Iteration 19

SHO-FA v.s. Pick-Up-Sticks 20 Peeling process: Iterative Decoding Observation: Identification Check: VerificationPicking up a “top” stick: Leaf-based decoding

Robust Compressive Sensing 21 Phase error Propagation error …… Pawar, Sameer and Ramchandran, Kannan, “A Hybrid DFT-LDPC Framework for Fast and Robust Compressive Sensing”

Truncated Reconstruction 22 Threshold

Correlated Measurements 23 Phase quantization

Correlated Measurements (First bit) 24 Phase quantization

Correlated Measurements (Second bit) 25

Correlated Measurements (Third bit) 26

Additional Properties Other works – Group Testing – Network Tomography Reduce the number of measurements – Combine Identification and verification More noise models Sparse in different bases Database query ……

THANK YOU 謝謝

2-core in d-uniform hypergraph The 2-core is the largest sub-hypergraph that has minimum degree at least 2. The standard “peeling process” finds the 2- core: while there exists a vertex with degree 1, delete it and the corresponding hyperedges. hyperedge Node degree 1 29

(Almost) S(x)-expansion ≥2|S| |S| 30 n ck