Team LDPC, SoC Lab. CS Dept. National Taiwan University Codes and Decoding on General Graphs Speaker: Yi-hsin Jian.

Slides:



Advertisements
Similar presentations
Noise-Predictive Turbo Equalization for Partial Response Channels Sharon Aviran, Paul H. Siegel and Jack K. Wolf Department of Electrical and Computer.
Advertisements

© 2004 Wayne Wolf Topics Task-level partitioning. Hardware/software partitioning.  Bus-based systems.
(speaker) Fedor Groshev Vladimir Potapov Victor Zyablov IITP RAS, Moscow.
B IPARTITE I NDEX C ODING Arash Saber Tehrani Alexandros G. Dimakis Michael J. Neely Department of Electrical Engineering University of Southern California.
Optimal Analyses for 3  n AB Games in the Worst Case Li-Te Huang and Shun-Shii Lin Dept. of Computer Science & Information Engineering, National Taiwan.
Discrete Optimization in Computer Vision Nikos Komodakis Ecole des Ponts ParisTech, LIGM Traitement de l’information et vision artificielle.
Modern Digital and Analog Communication Systems Lathi Copyright © 2009 by Oxford University Press, Inc. C H A P T E R 15 ERROR CORRECTING CODES.
Improving BER Performance of LDPC Codes Based on Intermediate Decoding Results Esa Alghonaim, M. Adnan Landolsi, Aiman El-Maleh King Fahd University of.
Easy Optimization Problems, Relaxation, Local Processing for a small subset of variables.
1 Channel Coding in IEEE802.16e Student: Po-Sheng Wu Advisor: David W. Lin.
Arbitrary Bit Generation and Correction Technique for Encoding QC-LDPC Codes with Dual-Diagonal Parity Structure Chanho Yoon, Eunyoung Choi, Minho Cheong.
Lecture 15 Hidden Markov Models Dr. Jianjun Hu mleg.cse.sc.edu/edu/csce833 CSCE833 Machine Learning University of South Carolina Department of Computer.
Cellular Communications
TELIN Estimation and detection from coded signals Presented by Marc Moeneclaey, UGent - TELIN dept. Joint research : - UGent.
Part 4 b Forward-Backward Algorithm & Viterbi Algorithm CSE717, SPRING 2008 CUBS, Univ at Buffalo.
Decision Tree Algorithm
Turbo Codes Azmat Ali Pasha.
DNA Research Group 1 Growth Codes: Maximizing Sensor Network Data Persistence Abhinav Kamra, Vishal Misra, Dan Rubenstein Department of Computer Science,
STBC BASED STTC CODES OPTIMIZED DESIGNS FOR THREE TRANSMIT ANTENNA SYSTEMS CANCES Jean-Pierre XLIM - Dépt. C 2 S 2 UMR CNRS 6172 ENSIL Parc ESTER - BP.
Hidden Markov Models K 1 … 2. Outline Hidden Markov Models – Formalism The Three Basic Problems of HMMs Solutions Applications of HMMs for Automatic Speech.
Figure 6.1. A convolutional encoder. Figure 6.2. Structure of a systematic convolutional encoder of rate.
1 Local optimality in Tanner codes June 2011 Guy Even Nissim Halabi.
Low Density Parity Check Codes LDPC ( Low Density Parity Check ) codes are a class of linear bock code. The term “Low Density” refers to the characteristic.
© 2005, it - instituto de telecomunicações. Todos os direitos reservados. Gerhard Maierbacher Scalable Coding Solutions for Wireless Sensor Networks IT.
Processing Along the Way: Forwarding vs. Coding Christina Fragouli Joint work with Emina Soljanin and Daniela Tuninetti.
Interconnect Efficient LDPC Code Design Aiman El-Maleh Basil Arkasosy Adnan Al-Andalusi King Fahd University of Petroleum & Minerals, Saudi Arabia Aiman.
Visual Recognition Tutorial1 Markov models Hidden Markov models Forward/Backward algorithm Viterbi algorithm Baum-Welch estimation algorithm Hidden.
Improving the Performance of Turbo Codes by Repetition and Puncturing Youhan Kim March 4, 2005.
Low Density Parity Check (LDPC) Code Implementation Matthew Pregara & Zachary Saigh Advisors: Dr. In Soo Ahn & Dr. Yufeng Lu Dept. of Electrical and Computer.
Channel Coding and Error Control
Wireless Mobile Communication and Transmission Lab. Theory and Technology of Error Control Coding Chapter 7 Low Density Parity Check Codes.
Fundamentals of Hidden Markov Model Mehmet Yunus Dönmez.
III. Turbo Codes.
Tinoosh Mohsenin and Bevan M. Baas VLSI Computation Lab, ECE Department University of California, Davis Split-Row: A Reduced Complexity, High Throughput.
Exercise in the previous class Consider the following code C. determine the weight distribution of C compute the “three” probabilities (p. 7), and draw.
Distributed computing using Projective Geometry: Decoding of Error correcting codes Nachiket Gajare, Hrishikesh Sharma and Prof. Sachin Patkar IIT Bombay.
Data and Computer Communications by William Stallings Eighth Edition Digital Data Communications Techniques Digital Data Communications Techniques Click.
Wireless Mobile Communication and Transmission Lab. Theory and Technology of Error Control Coding Chapter 5 Turbo Code.
Outline Transmitters (Chapters 3 and 4, Source Coding and Modulation) (week 1 and 2) Receivers (Chapter 5) (week 3 and 4) Received Signal Synchronization.
Turbo Codes COE 543 Mohammed Al-Shammeri. Agenda PProject objectives and motivations EError Correction Codes TTurbo Codes Technology TTurbo decoding.
Real-Time Turbo Decoder Nasir Ahmed Mani Vaya Elec 434 Rice University.
Last time, we talked about:
Part 1: Overview of Low Density Parity Check(LDPC) codes.
Low Density Parity Check codes
Multi-Split-Row Threshold Decoding Implementations for LDPC Codes
An Algorithm for Construction of Error-Correcting Symmetrical Reversible Variable Length Codes Chia-Wei Lin, Ja-Ling Wu, Jun-Cheng Chen Presented by Jun-Cheng.
Semi-Parallel Reconfigurable Architecture for Real-time LDPC decoding Karkooti, M.; Cavallaro, J.R.; Information Technology: Coding and Computing, 2004.
FEC Linear Block Coding
Forschungszentrum Telekommunikation Wien [Telecommunications Research Center Vienna] Göttfried Lächner, Ingmør Lønd, Jössy Säyir Optimization of LDPC codes.
Log-Likelihood Algebra
Memory-efficient Turbo decoding architecture for LDPC codes
1 Using Network Coding for Dependent Data Broadcasting in a Mobile Environment Chung-Hua Chu, De-Nian Yang and Ming-Syan Chen IEEE GLOBECOM 2007 Reporter.
1 Channel Coding: Part III (Turbo Codes) Presented by: Nguyen Van Han ( ) Wireless and Mobile Communication System Lab.
Information Theory & Coding for Digital Communications Prof JA Ritcey EE 417 Source; Anderson Digital Transmission Engineering 2005.
1 Aggregated Circulant Matrix Based LDPC Codes Yuming Zhu and Chaitali Chakrabarti Department of Electrical Engineering Arizona State.
Classical Coding for Forward Error Correction Prof JA Ritcey Univ of Washington.
Channel Coding and Error Control 1. Outline Introduction Linear Block Codes Cyclic Codes Cyclic Redundancy Check (CRC) Convolutional Codes Turbo Codes.
Efficient Huffman Decoding Aggarwal, M. and Narayan, A., International Conference on Image Processing, vol. 1, pp. 936 – 939, 2000 Presenter :Yu-Cheng.
Who am I? Work in Probabilistic Machine Learning Like to teach 
Factor Graphs and the Sum-Product Algorithm
Trellis Codes With Low Ones Density For The OR Multiple Access Channel
2018/9/16 Distributed Source Coding Using Syndromes (DISCUS): Design and Construction S.Sandeep Pradhan, Kannan Ramchandran IEEE Transactions on Information.
An Improved Split-Row Threshold Decoding Algorithm for LDPC Codes
CS 188: Artificial Intelligence Fall 2008
Cyclic Code.
Low-Density Parity-Check Codes
Homework #2 Due May 29 , Consider a (2,1,4) convolutional code with g(1) = 1+ D2, g(2) = 1+ D + D2 + D3 a. Draw the.
III. Turbo Codes.
Error Correction Coding
IV. Convolutional Codes
Presentation transcript:

Team LDPC, SoC Lab. CS Dept. National Taiwan University Codes and Decoding on General Graphs Speaker: Yi-hsin Jian

Team LDPC, SoC Lab. CS Dept. National Taiwan University Outline Introduction Equation and Tanner Graph Configuration and Behavior System and Check Structure Tanner and Trellis Graph Complexity Turbo Code Decoding Algorithms Min-sum Algorithm Sum-product Algorithm Conclusion

Team LDPC, SoC Lab. CS Dept. National Taiwan University Introduction Algebraic Decoding Probabilistic Decoding Decoding Complexity

Team LDPC, SoC Lab. CS Dept. National Taiwan University Equations & Tanner Graph

Team LDPC, SoC Lab. CS Dept. National Taiwan University Configuration and Behavior Configuration space – Valid configurations and Behavior – (Visible) Sites –Component of codeword in Tanner graph

Team LDPC, SoC Lab. CS Dept. National Taiwan University System System (N, W, B) –Set of sites (e.g. N={1,…,6}) –Configuration space (e.g. W=GF(2) 6 ) –Valid configurations/Behaviors (e.g. B={000000,110001,…,101010})

Team LDPC, SoC Lab. CS Dept. National Taiwan University Check Structure Check Structure (Q) for (N,W,B) – =Q is a collection of subset of N such that x belong to W satisfying x E belong to B E for all check sets. (e.g. Q={{1,2,3},{3,4,5},{5,6,1},{2,4,6}}) –B E Called local behavior (e.g. B E ={000,110,101,011})

Team LDPC, SoC Lab. CS Dept. National Taiwan University Trellis & Tanner graph x1x1 x2x2 x3x3 x4x4 x5x5 x6x6 Every path is valid configuration

Team LDPC, SoC Lab. CS Dept. National Taiwan University Complexity Local behavior Site alphabets

Team LDPC, SoC Lab. CS Dept. National Taiwan University Trivial realization Even parity check

Team LDPC, SoC Lab. CS Dept. National Taiwan University Hidden site Not a component of codewords Indicate some state

Team LDPC, SoC Lab. CS Dept. National Taiwan University Example Distinct value for each valid configuration, are unsuitable for decoding

Team LDPC, SoC Lab. CS Dept. National Taiwan University Turbo Codes Key module

Team LDPC, SoC Lab. CS Dept. National Taiwan University Turbo Codes (Tanner) Produce many cycles Share information sequence

Team LDPC, SoC Lab. CS Dept. National Taiwan University Decoding algorithms

Team LDPC, SoC Lab. CS Dept. National Taiwan University Min-Sum Algorithm & Sum-Product Algorithm Min-Sum algorithm is generalization of “Viterbi algorithm” Sum-Product algorithm is generalization of “Forward and backward algorithm”

Team LDPC, SoC Lab. CS Dept. National Taiwan University Min-Sum Algorithm Local cost function (γ s, γ E ) Intermediate cost function (μ s,E, μ E,s ) Initialized to zero for the first iteration In typical channel decoding, this value are set to zero

Team LDPC, SoC Lab. CS Dept. National Taiwan University Min-Sum Algorithm Final cost function (μ s, μ E )

Team LDPC, SoC Lab. CS Dept. National Taiwan University Min-Sum Algorithm Global cost function ( G(x) )

Team LDPC, SoC Lab. CS Dept. National Taiwan University Case (weight 3)

Team LDPC, SoC Lab. CS Dept. National Taiwan University Min-Sum Algorithm (1 of 8)

Team LDPC, SoC Lab. CS Dept. National Taiwan University Min-Sum Algorithm (2 of 8)

Team LDPC, SoC Lab. CS Dept. National Taiwan University Min-Sum Algorithm (3 of 8)

Team LDPC, SoC Lab. CS Dept. National Taiwan University Min-Sum Algorithm (4 of 8)

Team LDPC, SoC Lab. CS Dept. National Taiwan University Min-Sum Algorithm (5 of 8)

Team LDPC, SoC Lab. CS Dept. National Taiwan University Min-Sum Algorithm (6 of 8)

Team LDPC, SoC Lab. CS Dept. National Taiwan University Min-Sum Algorithm (7 of 8)

Team LDPC, SoC Lab. CS Dept. National Taiwan University Min-Sum Algorithm (8 of 8) Decision was made according to this cost info.

Team LDPC, SoC Lab. CS Dept. National Taiwan University Binary Optimization Only interested in the difference between “1” cost and the “0” cost.

Team LDPC, SoC Lab. CS Dept. National Taiwan University Sum-product Algorithm Global cost function( G(x) ) Maximizing this function rather than minimizing

Team LDPC, SoC Lab. CS Dept. National Taiwan University Sum-product Algorithm Local check cost (γ E ) Local site cost (γ s ) Global cost of a configuration x is strictly positive if x is valid.

Team LDPC, SoC Lab. CS Dept. National Taiwan University Sum-product Algorithm Intermediate cost function (μ s,E, μ E,s )

Team LDPC, SoC Lab. CS Dept. National Taiwan University Sum-product Algorithm Final cost function (μ s, μ E )

Team LDPC, SoC Lab. CS Dept. National Taiwan University Case (weight 3)

Team LDPC, SoC Lab. CS Dept. National Taiwan University Conclusion These algorithms are optimal with cycle- free graph Principle of decoding algorithms Graph description Find the right paper which bridges the gap