(speaker) Fedor Groshev Vladimir Potapov Victor Zyablov IITP RAS, Moscow.

Slides:



Advertisements
Similar presentations
Information and Coding Theory
Advertisements

CHANNEL CODING REED SOLOMON CODES.
Data and Computer Communications Tenth Edition by William Stallings Data and Computer Communications, Tenth Edition by William Stallings, (c) Pearson Education.
CS774. Markov Random Field : Theory and Application Lecture 04 Kyomin Jung KAIST Sep
Complexity 16-1 Complexity Andrei Bulatov Non-Approximability.
Cellular Communications
Near Shannon Limit Performance of Low Density Parity Check Codes
1 Algorithms for Large Data Sets Ziv Bar-Yossef Lecture 8 May 4, 2005
Linear-time encodable and decodable error-correcting codes Daniel A. Spielman Presented by Tian Sang Jed Liu 2003 March 3rd.
Asymptotic Enumerators of Protograph LDPCC Ensembles Jeremy Thorpe Joint work with Bob McEliece, Sarah Fogal.
Erasure Correcting Codes
Chapter 11 Error-Control CodingChapter 11 : Lecture edition by K.Heikkinen.
Message Passing for the Coloring Problem: Gallager Meets Alon and Kahale Sonny Ben-Shimon and Dan Vilenchik Tel Aviv University AofA June, 2007 TexPoint.
1 Local optimality in Tanner codes June 2011 Guy Even Nissim Halabi.
1 Scalable Image Transmission Using UEP Optimized LDPC Codes Charly Poulliat, Inbar Fijalkow, David Declercq International Symposium on Image/Video Communications.
Low Density Parity Check Codes LDPC ( Low Density Parity Check ) codes are a class of linear bock code. The term “Low Density” refers to the characteristic.
Code and Decoder Design of LDPC Codes for Gbps Systems Jeremy Thorpe Presented to: Microsoft Research
RAPTOR CODES AMIN SHOKROLLAHI DF Digital Fountain Technical Report.
EEE377 Lecture Notes1 EEE436 DIGITAL COMMUNICATION Coding En. Mohd Nazri Mahmud MPhil (Cambridge, UK) BEng (Essex, UK) Room 2.14.
Randomness in Computation and Communication Part 1: Randomized algorithms Lap Chi Lau CSE CUHK.
Generalized Communication System: Error Control Coding Occurs In Right Column. 6.
Linear-Time Encodable and Decodable Error-Correcting Codes Jed Liu 3 March 2003.
1 Verification Codes Michael Luby, Digital Fountain, Inc. Michael Mitzenmacher Harvard University and Digital Fountain, Inc.
The Role of Specialization in LDPC Codes Jeremy Thorpe Pizza Meeting Talk 2/12/03.
Ger man Aerospace Center Gothenburg, April, 2007 Coding Schemes for Crisscross Error Patterns Simon Plass, Gerd Richter, and A.J. Han Vinck.
Channel Polarization and Polar Codes
CS774. Markov Random Field : Theory and Application Lecture 10 Kyomin Jung KAIST Oct
exercise in the previous class (1)
Analysis of Iterative Decoding
Approximating the MST Weight in Sublinear Time Bernard Chazelle (Princeton) Ronitt Rubinfeld (NEC) Luca Trevisan (U.C. Berkeley)
Computing and Communicating Functions over Sensor Networks A.Giridhar and P. R. Kumar Presented by Srikanth Hariharan.
Wireless Mobile Communication and Transmission Lab. Theory and Technology of Error Control Coding Chapter 7 Low Density Parity Check Codes.
ECE 8443 – Pattern Recognition LECTURE 03: GAUSSIAN CLASSIFIERS Objectives: Normal Distributions Whitening Transformations Linear Discriminants Resources.
1 Introduction to Approximation Algorithms. 2 NP-completeness Do your best then.
Exercise in the previous class p: the probability that symbols are delivered correctly C: 1 00 → → → → What is the threshold.
Zorica Stanimirović Faculty of Mathematics, University of Belgrade
1 (Chapter 15): Concatenated codes Simple (classical, single-level) concatenation Length of concatenated code: n 1 n 2 Dimension of concatenated code:
Andrea Montanari and Ruediger Urbanke TIFR Tuesday, January 6th, 2008 Phase Transitions in Coding, Communications, and Inference.
Prof. Amr Goneid, AUC1 Analysis & Design of Algorithms (CSCE 321) Prof. Amr Goneid Department of Computer Science, AUC Part 8. Greedy Algorithms.
§2 Discrete memoryless channels and their capacity function
§6 Linear Codes § 6.1 Classification of error control system § 6.2 Channel coding conception § 6.3 The generator and parity-check matrices § 6.5 Hamming.
ECE 8443 – Pattern Recognition ECE 8423 – Adaptive Signal Processing Objectives: ML and Simple Regression Bias of the ML Estimate Variance of the ML Estimate.
DIGITAL COMMUNICATIONS Linear Block Codes
Information Theory Linear Block Codes Jalal Al Roumy.
Multi-Edge Framework for Unequal Error Protecting LT Codes H. V. Beltr˜ao Neto, W. Henkel, V. C. da Rocha Jr. Jacobs University Bremen, Germany IEEE ITW(Information.
linear  2.3 Newton’s Method ( Newton-Raphson Method ) 1/12 Chapter 2 Solutions of Equations in One Variable – Newton’s Method Idea: Linearize a nonlinear.
Last time, we talked about:
Part 1: Overview of Low Density Parity Check(LDPC) codes.
Low Density Parity Check codes
Timo O. Korhonen, HUT Communication Laboratory 1 Convolutional encoding u Convolutional codes are applied in applications that require good performance.
1 Design of LDPC codes Codes from finite geometries Random codes: Determine the connections of the bipartite Tanner graph by using a (pseudo)random algorithm.
Raptor Codes Amin Shokrollahi EPFL. BEC(p 1 ) BEC(p 2 ) BEC(p 3 ) BEC(p 4 ) BEC(p 5 ) BEC(p 6 ) Communication on Multiple Unknown Channels.
Channel Coding Theorem (The most famous in IT) Channel Capacity; Problem: finding the maximum number of distinguishable signals for n uses of a communication.
Error-Correcting Code
Giansalvo EXIN Cirrincione unit #4 Single-layer networks They directly compute linear discriminant functions using the TS without need of determining.
CHAPTER 8 CHANNEL CODING: PART 3 Sajina Pradhan
Channel Coding: Part I Presentation II Irvanda Kurniadi V. ( ) Digital Communication 1.
Class Report 林格名 : Reed Solomon Encoder. Reed-Solomom Error Correction When a codeword is decoded, there are three possible outcomes –If 2s + r < 2t (s.
RS – Reed Solomon Error correcting code. Error-correcting codes are clever ways of representing data so that one can recover the original information.
The Viterbi Decoding Algorithm
New Characterizations in Turnstile Streams with Applications
Subject Name: Information Theory Coding Subject Code: 10EC55
Computability and Complexity
Enumerating Distances Using Spanners of Bounded Degree
Analysis of Algorithms
Optimizing LDPC Codes for message-passing decoding.
RS – Reed Solomon List Decoding.
Chris Jones Cenk Kose Tao Tian Rick Wesel
Irregular Structured LDPC Codes and Structured Puncturing
Zeev Dvir (Princeton) Shachar Lovett (IAS)
Presentation transcript:

(speaker) Fedor Groshev Vladimir Potapov Victor Zyablov IITP RAS, Moscow

 Reed-Solomon code-based LDPC (RS-LDPC) block codes are obtained by replacing single parity-check codes in Gallager’s LDPC codes with Reed-Solomon constituent codes.  This paper investigates asymptotic error correcting capabilities of ensembles of random RS-LDPC codes, used over the binary symmetric channel and decoded with a low- complexity hard-decision iterative decoding algorithm.  Estimation of the number decoding algorithm iterations.  It is shown that there exist RS-LDPC codes for which such iterative decoding corrects any error pattern with a number of errors that grows linearly with the code length.  The results are illustrated by numerical examples, for various choices of code parameters. 2

 Parity-check matrix of RS-LDPC codes H 0 :  (n 0, k 0, d 0 ) extended Reed-Solomon codes are constituent codes, d 0 = 3  l random column permutations of H b form layers of H  Code rate is 3

 Bipartite Tanner graph of RS- LDPC codes.  Constraint nodes have degree n 0 and represent constituent RS codes.  Constituent parity-check matrices H 0j,k are all equal up to column permutations.  Variable nodes have degree l and represent code symbols.  Each variable node is connected to exactly one constraint node in each layer. 4

Iterative hard-decision decoding algorithm, whose decoding iterations i = 1,2,…i max consist of the following two steps: 1) For the tentative sequence r (i), where r (1) is the received sequence r, decode independently all constituent RS codes ( lb), which can correct one error. If all the constituent codes have zero syndrome, then output v = r (i) and stop. Otherwise, proceed to step 2. 2) In the each sequence r (i), set to the new value all positions, which are corrected by constituent RS codes. This yields the next updated sequence r (i+1). If r (i+1) = r (i), declare the decoding failure and stop. Otherwise, return to step (1). 5

Lemma1: For decoding algorithm convergence required that, in each iteration the number of errors correctable by the constituent codes is larger than the number of insertion errors. Lemma2: If for any error pattern with  2/3+ , 0<  <1, then the number of correctable errors in any such error pattern is always larger than the number of uncorrectable errors. Lemma3: For any RS-LDPC code from the ensemble C(n 0, l, b), if in each iteration of the algorithm corrected fixed part of errors (  >2/3+  ), then algorithm yields a correct decision after O(log n) iterations, where n = bn 0 is the code length. 6

Theorem: In the ensemble C(n 0, l, b) of RS-LDPC codes, there exist codes (with probability p, where ), which can correct any error pattern of weight up to   n, with decoding complexity O(n log n). The value   is the largest root of the equation where and where  > 2/3 and the maximization is performed over all s such that 7 The proof is similar to proof in the work: V. V. Zyablov and M. S. Pinsker, “Estimation of the error-correction complexity for Gallager low-density codes”1975

Fig. 2. Values of   computed for  =0.67 according to Theorem for several code ensembles of different rates with the fixed constituent code length n 0 = Fig. 1. Values of   computed for  = 0.67 according to Theorem for several code ensembles of rates approximately R  1/2. The maximum is achieved with the constituent code length n 0 = 128.

 We have studied the performance of ensembles of Reed- Solomon code-based LDPC codes, with the distance of RS code d 0 =3, used over the BSC, when the code length n grows to infinity.  It was shown that these codes can be decoded with a simple iterative decoding algorithm whose complexity is O(n*log n).  Also was proved the existence of RS LDPC codes with the fixed constituent code distance (d 0 =3), Compare to the work of A. Barg and G. Zemor, “Error exponents of expander codes” 2002, where was shown estimation of constituent code distance  The maximum fraction of errors , correctable with the iterative decoder, was computed numerically for two types of code ensembles: codes of fixed rate R  1/2 and codes of variable rates with a fixed constituent Reed-Solomon code. 9