Uncorrectable Errors of Weight Half the Minimum Distance for Binary Linear Codes Kenji Yasunaga * Toru Fujiwara + * Kwansei Gakuin University, Japan +

Slides:



Advertisements
Similar presentations
Gillat Kol joint work with Ran Raz Locally Testable Codes Analogues to the Unique Games Conjecture Do Not Exist.
Advertisements

Information and Coding Theory
(speaker) Fedor Groshev Vladimir Potapov Victor Zyablov IITP RAS, Moscow.
List decoding Reed-Muller codes up to minimal distance: Structure and pseudo- randomness in coding theory Abhishek Bhowmick (UT Austin) Shachar Lovett.
An Algorithm for Computing the Local Weight Distribution of Binary Linear Codes Closed under a Group of Permutations Kenji YASUNAGA and Toru FUJIWARA Osaka.
Bounds on Code Length Theorem: Let l ∗ 1, l ∗ 2,..., l ∗ m be optimal codeword lengths for a source distribution p and a D-ary alphabet, and let L ∗ be.
II. Linear Block Codes. © Tallal Elshabrawy 2 Last Lecture H Matrix and Calculation of d min Error Detection Capability Error Correction Capability Error.
Information Theory Introduction to Channel Coding Jalal Al Roumy.
Convergent and Correct Message Passing Algorithms Nicholas Ruozzi and Sekhar Tatikonda Yale University TexPoint fonts used in EMF. Read the TexPoint manual.
Asymptotic Enumerators of Protograph LDPCC Ensembles Jeremy Thorpe Joint work with Bob McEliece, Sarah Fogal.
The 1’st annual (?) workshop. 2 Communication under Channel Uncertainty: Oblivious channels Michael Langberg California Institute of Technology.
Correcting Errors Beyond the Guruswami-Sudan Radius Farzad Parvaresh & Alexander Vardy Presented by Efrat Bank.
Coding for the Correction of Synchronization Errors ASJ Helberg CUHK Oct 2010.
Toyohiro Tsurumaru (Mitsubishi Electric Corporation) Masahito Hayashi (Graduate School of Information Sciences, Tohoku University / CQT National University.
Computing Sketches of Matrices Efficiently & (Privacy Preserving) Data Mining Petros Drineas Rensselaer Polytechnic Institute (joint.
1 Chapter 5 A Measure of Information. 2 Outline 5.1 Axioms for the uncertainty measure 5.2 Two Interpretations of the uncertainty function 5.3 Properties.
15-853Page :Algorithms in the Real World Error Correcting Codes I – Overview – Hamming Codes – Linear Codes.
exercise in the previous class (1)
Hamming Codes 11/17/04. History In the late 1940’s Richard Hamming recognized that the further evolution of computers required greater reliability, in.
MAT 1000 Mathematics in Today's World Winter 2015.
Linear codes 1 CHAPTER 2: Linear codes ABSTRACT Most of the important codes are special types of so-called linear codes. Linear codes are of importance.
Some optimization problems in Coding theory S. M. Dodunekov Institute of Mathematics and Informatics, Bulgarian Academy of Sciences 8 “G. Bonchev” Str.,
The Hat Game 11/19/04 James Fiedler. References Hendrik W. Lenstra, Jr. and Gadiel Seroussi, On Hats and Other Covers, preprint, 2002,
DIGITAL COMMUNICATION Error - Correction A.J. Han Vinck.
Relations between the Local Weight Distributions of a Linear Block Code, Its Extended Code, and Its Even Weight Subcode Kenji YASUNAGA and Toru FUJIWARA.
Information and Coding Theory Linear Block Codes. Basic definitions and some examples. Juris Viksna, 2015.
Exercise in the previous class p: the probability that symbols are delivered correctly C: 1 00 → → → → What is the threshold.
BCH_Code 2004/5/5Yuh-Ming Huang, CSIE, NCNU1 BCH Code a larger class of powerful random error-correcting cyclic codes a remarkable generalization of the.
On the least covering radius of the binary linear codes of dimension 6 Tsonka Baicheva and Iliya Bouyukliev Institute of Mathematics and Informatics, Bulgaria.
The Selection Problem. 2 Median and Order Statistics In this section, we will study algorithms for finding the i th smallest element in a set of n elements.
Coding and Algorithms for Memories Lecture 5 1.
1 Yuan Luo Xi’an Jan Optimum Distance Profiles of Linear Block Codes Shanghai Jiao Tong University.
Basic Characteristics of Block Codes
INTRODUCTION  New tools in computer package for coding theory research and studying QPlus are presented  QPlus includes a DLL library package that implements.
Coding and Algorithms for Memories Lecture 4 1.
Coding Theory. 2 Communication System Channel encoder Source encoder Modulator Demodulator Channel Voice Image Data CRC encoder Interleaver Deinterleaver.
§6 Linear Codes § 6.1 Classification of error control system § 6.2 Channel coding conception § 6.3 The generator and parity-check matrices § 6.5 Hamming.
DIGITAL COMMUNICATIONS Linear Block Codes
Linear codes of good error control performance Tsonka Baicheva Institute of Mathematics and Informatics Bulgarian Academy of Sciences Bulgaria.
1 Private codes or Succinct random codes that are (almost) perfect Michael Langberg California Institute of Technology.
Information and Coding Theory Cyclic codes Juris Viksna, 2015.
Information Theory Linear Block Codes Jalal Al Roumy.
Word : Let F be a field then the expression of the form a 1, a 2, …, a n where a i  F  i is called a word of length n over the field F. We denote the.
Authentication protocol providing user anonymity and untraceability in wireless mobile communication systems Computer Networks Volume: 44, Issue: 2, February.
The parity bits of linear block codes are linear combination of the message. Therefore, we can represent the encoder by a linear system described by matrices.
Perfect and Related Codes
Error Detection and Correction – Hamming Code
Some Computation Problems in Coding Theory
Digital Communications I: Modulation and Coding Course Term Catharina Logothetis Lecture 9.
International Iran conference on Quantum Information September 2007, Kish Island Evaluation of bounds of codes defined over hexagonal and honeycomb lattices.
1 Reliability-Based SD Decoding Not applicable to only graph-based codes May even help with some algebraic structure SD alternative to trellis decoding.
Hartmut Klauck Centre for Quantum Technologies Nanyang Technological University Singapore.
Richard Cleve DC 2117 Introduction to Quantum Information Processing QIC 710 / CS 667 / PH 767 / CO 681 / AM 871 Lecture (2011)
Reed-Solomon Codes Rong-Jaye Chen.
Exercise in the previous class (1) Define (one of) (15, 11) Hamming code: construct a parity check matrix, and determine the corresponding generator matrix.
Codes for Symbol-Pair Read Channels Yuval Cassuto EPFL – ALGO Formerly: Hitachi GST Research November 3, 2010 IPG Seminar.
Hamming Code In 1950s: invented by Richard Hamming
Kenji Yasunaga Toru Fujiwara Osaka University, Japan
The Viterbi Decoding Algorithm
Random Testing: Theoretical Results and Practical Implications IEEE TRANSACTIONS ON SOFTWARE ENGINEERING 2012 Andrea Arcuri, Member, IEEE, Muhammad.
Coding and Algorithms for Memories Lecture 4
Chapter 5. Optimal Matchings
Subject Name: Information Theory Coding Subject Code: 10EC55
II. Linear Block Codes.
Standard Array.
주민등록번호.
tUAN THANH NGUYEN Nanyang Technological University (NTU), Singapore
Theory of Information Lecture 13
Kenji Yasunaga Toru Fujiwara Osaka University
Information security engineering laboratory
Presentation transcript:

Uncorrectable Errors of Weight Half the Minimum Distance for Binary Linear Codes Kenji Yasunaga * Toru Fujiwara + * Kwansei Gakuin University, Japan + Osaka University, Japan 2008 IEEE International Symposium on Information Theory, July 6th to 11th, 2008 Sheraton Centre Toronto Hotel, Toronto, Ontario, Canada

2 Summary of the Work Main Result A lower bound on #(uncorrectable errors of weight ) for binary linear codes. d : the minimum distance of the code A generalization to weight. Main Techniques Monotone error structure (Larger half) Monotone error structure appears in [Peterson, Weldon, 1972]. Larger half was introduced in [Helleseth, Kløve, Levenshtein, 2005].

3 Outline Correctable/Uncorrectable Errors Our Results Monotone Error Structure Proof Sketch of Our Results

4 Outline Correctable/Uncorrectable Errors Our Results Monotone Error Structure Proof Sketch of Our Results

5 Problem Setting Binary linear code C ⊆ {0,1} n Error vector e ∊ {0,1} n If w(e) < d/2 ⇒ e is always correctable. If w(e) ≥ d/2 ⇒ ? w(x) : the Hamming weight of x In this work, we investigate #( correctable errors of weight i ) for i ≥ d/2.

6 Correctable/Uncorrectable Errors Correctable errors E 0 (C) = Correctable by minimum distance decoding. E i 0 (C) : Correctable errors of weight i Uncorrectable errors E 1 (C) = {0,1} n 〵 E 0 (C) E i 1 (C) : Uncorrectable errors of weight i The error probability over BSC p is. Minimum distance decoding Outputs a nearest (w.r.t. Hamming dist.) codeword to the input. Performs ML decoding for BSC. Syndrome decoding is a minimum distance decoding.

7 Syndrome Decoding Coset partitioning Syndrome decoding Output y + v i if y ∈ C i ( y is the input). Coset leaders = Correctable errors. : Coset of C : Coset leader of C i

8 Outline Correctable/Uncorrectable Errors Our Results Monotone Error Structure Proof Sketch of Our Results

9 Previous Results for |E i 1 (C)| For the first-order Reed-Muller code RM m |E d/2 1 (RM m )| [Wu, 1998] |E d/2+1 1 (RM m )| [Yasunaga, Fujiwara, 2007] For binary linear codes Upper bounds on |E i 1 (C)| for every 0 ≤ i ≤ n [Poltyrev 1994], [Helleseth, Kløve 1997], [Helleseth, Kløve, Levenshtein 2005]

10 Our Results A lower bound on for codes satisfying some condition. The condition is not too restrictive.  Long Reed-Muller codes and random linear codes satisfy Given by #(codewords of weight d (and d+1 )). Asymptotically coincides with the corresponding upper bound for Reed-Muller codes and random linear codes. A generalization to for. The bound is weak.

11 Outline Correctable/Uncorrectable Errors Our Results Monotone Error Structure Proof Sketch of Our Results

12 Monotone Error Structure Recall that a coset leader is a minimum weight vector in a coset. There may be more than one minimum weight vector in the same coset. ⇒ Any of them will do. If we take the lexicographically smallest one for all cosets, ⇒ Correctable/uncorrectable errors have a monotone structure.

13 Monotone Error Structure Notation Support of v : S(v) = { i : v i ≠ 0 } v is covered by u : S(v) ⊆ S(u) Monotone error structure v is correctable. ⇒ All vectors that are covered by v are correctable. v is uncorrectable. ⇒ All vectors that cover v are uncorrectable. Example 1100 is correctable. ⇒ 0000, 1000, 0100 are correctable is uncorrectable. ⇒ 1011, 0111, 1111 are uncorrectable.

14 Minimal Uncorrectable Errors Errors have the monotone structure (w.r.t ⊆ ). ⇒ E 1 (C) is characterized by minimal vectors (w.r.t. ⊆ ). Minimal uncorrectable errors M 1 (C) = Uncorrectable errs. that are not covered by other uncorrectable errs. M 1 (C) uniquely determines E 1 (C). Larger half LH(c) of c ∈ C Introduced for characterizing M 1 (C) in [Helleseth et al., 2005]. Combinatorial construction is given in [Helleseth et al., 2005]. M 1 (C) ⊆ LH(C 〵 {0}) ⊆ E 1 (C), where.

15 Outline Correctable/Uncorrectable Errors Previous Results Our Results Monotone Error Structure Proof Sketch of Our Results

16 Proof Sketch of Our Results Objective : To derive a lower bound on. The following equalities hold: [Proof] Since is the smallest weight in E 1 (C), uncorrectable errors of weight do not cover any other uncorrectable errors. ⇒ Derive a lower bound on.

Proof Sketch of Our Results ( d is even ), where A i (C) = { codewords of weight i in C}. Larger halves of two codewords in A d (C) are almost disjoint. for every 17 = = LH( ・ ) c1c1 c2c2 c4c4 c3c3 Ad(C)Ad(C) ≤ |A d (C)| – 1 |LH(c i )| For every c i ∈ A d (C), #(common LH) is less than |A d (C)|.

The Results ( d is even ) When d is even, if holds, then If as then upper and lower bounds asymptotically coincide.  For Reed-Muller codes and random linear codes, the upper and lower bounds asymptotically coincide. 18 Upper bound is from [Helleseth et al. 2005]

The Results ( d is odd ) 19 When d is odd, if holds, then If as then upper and lower bounds asymptotically coincide. Upper bound is from [Helleseth et al. 2005]

A similar argument can be applied to weight. For large i The condition for the bound is more restrictive. The bound is weak. The bound is a lower bound on LH i (C). The difference between LH i (C) and E i 1 (C) is large. A Generalization to Larger Weights 20 For an integer i with ⌈ d/2 ⌉ ≤ i ≤ ⌊ n/2 ⌋, if holds, then where B i = |A 2i−2 (C)| +|A 2i−1 (C)| + |A 2i (C)|.

Conclusion Main results A lower bound on #(correctable errors of weight ) for binary linear codes satisfying some condition. The bound asymptotically coincides with the upper bound for Reed- Muller codes and random linear codes. Monotone error structure & larger half are main tools. A generalization to weight is also obtained.  The generalized bound is weak for large i. Future work A good lower bound for weight. 21

Codes Satisfying the Condition The condition Codes satisfying the condition (n, k) primitive BCH codes for n = 127 and k ≤ 64, n = 63 and k ≤ 24 (n, k) extended primitive BCH codes for n = 127 and k ≤ 64, n = 63 and k ≤ 24 r -th order Reed-Muller codes of length 2 m fixed r and m →∞ Random linear codes for n → ∞ 22 rm 1≥ 4 2≥ 6 3≥ 8 4≥ 10 5≥ 11 6≥ 13 for even d for odd d

23 Proof Sketch of Our Results ( d is even ) x2x2 x1x1

24 Proof Sketch of Our Results ( d is even ) c1c1 c2c2 c4c4 c3c3 Ad(C)Ad(C) A i (C) : the set of codewords with weight i x1x1 x2x2

25 Proof Sketch of Our Results ( d is even ) LH( ・ ) x1x1 x2x2 c1c1 c2c2 c4c4 c3c3 Ad(C)Ad(C) A i (C) : the set of codewords with weight i

26 Proof Sketch of Our Results ( d is even ) x1x1 x2x2 c1c1 c2c2 c4c4 c3c3 LH( ・ ) Ad(C)Ad(C) A i (C) : the set of codewords with weight i

27 Proof Sketch of Our Results ( d is even ) x1x1 x2x2 c1c1 c2c2 c4c4 c3c3 LH( ・ ) Ad(C)Ad(C) A i (C) : the set of codewords with weight i

28 Proof Sketch of Our Results ( d is even ) x1x1 x2x2 c1c1 c2c2 c4c4 c3c3 LH( ・ ) Ad(C)Ad(C) A i (C) : the set of codewords with weight i

29 Proof Sketch of Our Results ( d is even ) |LH(c i )| x1x1 x2x2 c1c1 c2c2 c4c4 c3c3 LH( ・ ) Ad(C)Ad(C) A i (C) : the set of codewords with weight i

30 Proof Sketch of Our Results ( d is even ) |LH(c i )| ≤ |A d (T)| – 1 x1x1 x2x2 c1c1 c2c2 c4c4 c3c3 LH( ・ ) Ad(C)Ad(C) A i (C) : the set of codewords with weight i

31 Proof Sketch of Our Results ( d is even ) For every c i ∈ A d (T), #(common LH) is less than |A d (T)| – 1 Thus, if |LH(c i )| > |A d (T)| – 1, then (|LH(c i )| - |A d (T)|+1) |A d (T)| ≤ |LH d/2 (T)| |LH(c i )| ≤ |A d (T)| – 1 x1x1 x2x2 c1c1 c2c2 c4c4 c3c3 LH( ・ ) Ad(C)Ad(C) A i (C) : the set of codewords with weight i

A Generalization to Larger Weight The lower bound for weight is obtained by considering the vectors of weight in A similar argument can be applied to weight However, for large i, The condition for the bound is more restrictive The bound is weak  The bound is a lower bound on LH i (C)  The difference between LH i (C) and E i 1 (C) is large 32