An Algorithm for Computing the Local Weight Distribution of Binary Linear Codes Closed under a Group of Permutations Kenji YASUNAGA and Toru FUJIWARA Osaka.

Slides:



Advertisements
Similar presentations
Cyclic Code.
Advertisements

Information and Coding Theory
II. Linear Block Codes. © Tallal Elshabrawy 2 Last Lecture H Matrix and Calculation of d min Error Detection Capability Error Correction Capability Error.
Arbitrary Bit Generation and Correction Technique for Encoding QC-LDPC Codes with Dual-Diagonal Parity Structure Chanho Yoon, Eunyoung Choi, Minho Cheong.
Submission May, 2000 Doc: IEEE / 086 Steven Gray, Nokia Slide Brief Overview of Information Theory and Channel Coding Steven D. Gray 1.
Cellular Communications
Chien Hsing James Wu David Gottesman Andrew Landahl.
Asymptotic Enumerators of Protograph LDPCC Ensembles Jeremy Thorpe Joint work with Bob McEliece, Sarah Fogal.
Error detection/correction FOUR WEEK PROJECT 1 ITEMS TO BE DISCUSSED 1.0 OVERVIEW OF CODING STRENGTH (3MINS) Weight/distance of binary vectors Error detection.
The Goldreich-Levin Theorem: List-decoding the Hadamard code
BASiCS Group University of California at Berkeley Generalized Coset Codes for Symmetric/Asymmetric Distributed Source Coding S. Sandeep Pradhan Kannan.
Lattices for Distributed Source Coding - Reconstruction of a Linear function of Jointly Gaussian Sources -D. Krithivasan and S. Sandeep Pradhan - University.
Generalized Communication System: Error Control Coding Occurs In Right Column. 6.
15-853Page :Algorithms in the Real World Error Correcting Codes I – Overview – Hamming Codes – Linear Codes.
On Error Preserving Encryption Algorithms for Wireless Video Transmission Ali Saman Tosun and Wu-Chi Feng The Ohio State University Department of Computer.
Linear codes 1 CHAPTER 2: Linear codes ABSTRACT Most of the important codes are special types of so-called linear codes. Linear codes are of importance.
Syndrome Decoding of Linear Block Code
Analysis of Iterative Decoding
Linear Codes.
DIGITAL COMMUNICATION Error - Correction A.J. Han Vinck.
Rateless Codes with Optimum Intermediate Performance Ali Talari and Nazanin Rahnavard Oklahoma State University, USA IEEE GLOBECOM 2009 & IEEE TRANSACTIONS.
Sequential Soft Decision Decoding of Reed Solomon Codes Hari Palaiyanur Cornell University Prof. John Komo Clemson University 2003 SURE Program.
Relations between the Local Weight Distributions of a Linear Block Code, Its Extended Code, and Its Even Weight Subcode Kenji YASUNAGA and Toru FUJIWARA.
Information and Coding Theory Linear Block Codes. Basic definitions and some examples. Juris Viksna, 2015.
1 (Chapter 15): Concatenated codes Simple (classical, single-level) concatenation Length of concatenated code: n 1 n 2 Dimension of concatenated code:
CODING/DECODING CONCEPTS AND BLOCK CODING. ERROR DETECTION CORRECTION Increase signal power Decrease signal power Reduce Diversity Retransmission Forward.
Uncorrectable Errors of Weight Half the Minimum Distance for Binary Linear Codes Kenji Yasunaga * Toru Fujiwara + * Kwansei Gakuin University, Japan +
Codes Codes are used for the following purposes: - to detect errors - to correct errors after detection Error Control Coding © Erhan A. Ince Types: -Linear.
ERROR CONTROL CODING Basic concepts Classes of codes: Block Codes
MIMO continued and Error Correction Code. 2 by 2 MIMO Now consider we have two transmitting antennas and two receiving antennas. A simple scheme called.
Wireless Mobile Communication and Transmission Lab. Theory and Technology of Error Control Coding Chapter 5 Turbo Code.
1 Yuan Luo Xi’an Jan Optimum Distance Profiles of Linear Block Codes Shanghai Jiao Tong University.
Digital Communications I: Modulation and Coding Course Term Catharina Logothetis Lecture 12.
Basic Characteristics of Block Codes
CS717 Algorithm-Based Fault Tolerance Matrix Multiplication Greg Bronevetsky.
§6 Linear Codes § 6.1 Classification of error control system § 6.2 Channel coding conception § 6.3 The generator and parity-check matrices § 6.5 Hamming.
Linear codes of good error control performance Tsonka Baicheva Institute of Mathematics and Informatics Bulgarian Academy of Sciences Bulgaria.
ADVANTAGE of GENERATOR MATRIX:
Linear Block Code 指導教授:黃文傑 博士 學生:吳濟廷
Information and Coding Theory Cyclic codes Juris Viksna, 2015.
Information Theory Linear Block Codes Jalal Al Roumy.
Channel Coding Binit Mohanty Ketan Rajawat. Recap…  Information is transmitted through channels (eg. Wires, optical fibres and even air)  Channels are.
Intelligent Database Systems Lab 國立雲林科技大學 National Yunlin University of Science and Technology Efficient Optimal Linear Boosting of a Pair of Classifiers.
1 Channel Coding (III) Channel Decoding. ECED of 15 Topics today u Viterbi decoding –trellis diagram –surviving path –ending the decoding u Soft.
Perfect and Related Codes
Some Computation Problems in Coding Theory
Digital Communications I: Modulation and Coding Course Term Catharina Logothetis Lecture 9.
Sequential Soft Decision Decoding of Reed Solomon Codes Hari Palaiyanur Cornell University Prof. John Komo Clemson University 2003 SURE Program.
Compression for Fixed-Width Memories Ori Rottenstriech, Amit Berman, Yuval Cassuto and Isaac Keslassy Technion, Israel.
1 Product Codes An extension of the concept of parity to a large number of words of data 0110… … … … … … …101.
Richard Cleve DC 2117 Introduction to Quantum Information Processing QIC 710 / CS 667 / PH 767 / CO 681 / AM 871 Lecture (2011)
Exercise in the previous class (1) Define (one of) (15, 11) Hamming code: construct a parity check matrix, and determine the corresponding generator matrix.
Block Coded Modulation Tareq Elhabbash, Yousef Yazji, Mahmoud Amassi.
1 Code design: Computer search Low rate: Represent code by its generator matrix Find one representative for each equivalence class of codes Permutation.
ECE 442 COMMUNICATION SYSTEM DESIGN LECTURE 10. LINEAR BLOCK CODES Husheng Li Dept. of EECS The University of Tennessee.
Channel Coding: Part I Presentation II Irvanda Kurniadi V. ( ) Digital Communication 1.
FEC decoding algorithm overview VLSI 자동설계연구실 정재헌.
CS 9633 Machine Learning Support Vector Machines
Hamming Code In 1950s: invented by Richard Hamming
Kenji Yasunaga Toru Fujiwara Osaka University, Japan
The Viterbi Decoding Algorithm
2018/9/16 Distributed Source Coding Using Syndromes (DISCUS): Design and Construction S.Sandeep Pradhan, Kannan Ramchandran IEEE Transactions on Information.
II. Linear Block Codes.
RS – Reed Solomon List Decoding.
Locality Sensitive Hashing
Information Redundancy Fault Tolerant Computing
Cyclic Code.
A Block Based MAP Segmentation for Image Compression
Efficient Processing of Top-k Spatial Preference Queries
Kenji Yasunaga Toru Fujiwara Osaka University
Presentation transcript:

An Algorithm for Computing the Local Weight Distribution of Binary Linear Codes Closed under a Group of Permutations Kenji YASUNAGA and Toru FUJIWARA Osaka University, Osaka, Japan ISITA2004, Parma, Italy

10/12/2004ISITA20042 Outline  Local Weight Distribution  Algorithm for Cyclic Codes  Proposed Algorithm  New Obtained Local Weight Distributions  Summary

3 Local Weight Distribution (LWD) all-zero codeword Zero neighbors The LWD is the weight distribution of zero neighbors. Code C on R n weight Number of codewords The LWD of C Codewords can be seen as the vectors with n-elements. Map all codewords onto R n. Each codeword has its Voronoi region.Zero neighbor.For an (n,k) code C Zero neighbors are codewords whose Voronoi region shares the facet with that of the all-zero codeword.

10/12/2004ISITA20044 What for We Obtain LWD?  The LWD is valuable for the error performance analysis of codes. – Usually, the error probability for soft decision decoding on AWGN channel is given by the union bound (upper bound). To compute the union bound, the weight distribution is used. We can obtain the tighter upper bound than the usual union bound when using the LWD instead of the weight distribution.

5 Known Results for Obtaining LWD  Hamming codes and second-order Reed-Muller codes – The formulas for the LWDs are known[6].  The other codes – Checking every codewords whether it is a zero neighbor or not. Only computable for small codes. An algorithm with reduced complexity for cyclic codes is proposed by Mohri and Morii[4]. [6] A.ashikhmin and A.Barg, “Minimal vectors in linear codes,” IEEE Trans. Inform. Theory, vol.44, no.5, pp , Sept [4] M.Mohri and M.Morii, “On computing the local distance profile of binary cyclic codes,” Proc. of ISITA2002, pp , Oct

6 Algorithm for Cyclic Codes [4] (1/2)  Invariance property :  The number of codewords that need to be checked can be reduced to use this invariance property. A codeword v is a zero neighbor. Any cyclic permutation of v is a zero neighbor.

7 Algorithm for Cyclic Codes [4] (2/2) Code C all-zero codeword Only each of these representative codewords needs to be checked whether it is a zero neighbor or not.  Partition all codewords into sets of codewords with cyclic permutations. The number of codewords that need to be checked can be reduced.

10/12/2004ISITA20048 Proposed Algorithm  Motivation  Our idea  Complexity  Codes for which the algorithm works effectively

9 Motivation  The invariance property can be generalized to that for a group of permutations [2]. A codeword v is a zero neighbor. Any permutation* of v is a zero neighbor. * Under this permutation the code must be closed. We consider using this generalized invariance property. [2] E.Agrell, “Voronoi regions for binary linear block codes,” IEEE Trans. Inform. Theory, vol.42, no.1, pp , Jan

10/12/2004ISITA Advantages/Disadvantages to Use the Invariance Property  Advantage – The number of codewords that need to be checked can be smaller. The extended primitive BCH codes are closed under the affine group of permutations. The number of permutations in the affine group is n(n-1), which is larger than that in cyclic permutations n.  Disadvantage – For such groups of permutations, no efficient way is known to generate the representatives.

11 Our Idea  To overcome the disadvantage,  This idea is used in [7] for computing the weight distribution of extended primitive BCH codes.  In this paper, we show the idea can be applied to LWD. We consider using cosets of the subcodes and partitioning all cosets into sets of cosets. [7] T.Fujiwara and T.Kasami, “The weight distribution of (256,k) extended binary primitive BCH codes with k ≦ 63 and k ≧ 207,” IEICE Technical Report, IT97-46, Sept

10/12/2004ISITA Cosets of a Subcode C’  C as a set of cosets of a subcode C’ Code C v 0 +C’ v i +C’ : coset v i : coset leader v 1 +C’ v 2 +C’ v 3 +C’ v 4 +C’ v 5 +C’ v 6 +C’

10/12/2004ISITA Property  If a coset leader is permuted into a vector in another coset, the weight distributions of zero neighbors in these cosets are the same. v 0 +C’ v 1 +C’

14 Partitioning the Cosets  Partition all cosets into sets of cosets with a group of permutations. – We need to examine the permutations of each coset leaders. Code C v 0 +C’ v 1 +C’ v 2 +C’ v 3 +C’ v 4 +C’ v 5 +C’ v 6 +C’ The distributions of only these representative cosets need to be obtained. The number of codewords that need to be checked can be reduced.

Complexity of the Proposed Algorithm C : an (n, k) code C’ : an (n, k’) subcode of C P : a group of permutations e : the number of representative cosets (obtained after partitioning cosets) (a) Partitioning cosets – O( n(k-k’)2 k-k’ |P| ) (b) Computing the distributions – O( n 2 k ・ e2 k’ ) Complexity of checking one codeword is O(n 2 k). The number of codewords need to be checked is e2 k’. Complexity varies with the selection of C’.

Selection of C’  We should select C’ to minimize (a) partitioning cosets O( n(k-k’)2 k-k’ |P| ) + (b) computing the distributions O( n 2 k ・ e2 k’ ).  Actually, we should care about the space complexity of part (a) (proportional to 2 k-k’ ). Select C’ to minimize the number of codewords that need to be checked (= e2 k ), as long as part (a) is computable and the complexity of (a) is relatively small.

10/12/2004ISITA Codes for which the algorithm works effectively  The proposed algorithm can be applied to the codes that are closed under a group of permutations. CodeAutomorphism group Cyclic codesCyclic permutations Extended primitive BCH codes Affine group Reed-Muller codesGeneral linear group

10/12/2004ISITA New Obtained LWD Code(128,50) extended primitive BCH code (128,64) Reed- Muller code Subcode(128,29) extended primitive BCH code (128,29) Reed- Muller code Complexity (CPU time)* (a) Partition cosets (b) Compute the distributions (a) 3 hours (b) 440 hours (a) Ignorable ** (b) 13 hours * CPU: Opteron Processor 1.6GHz ** An efficient method is known.

19 New Obtained LWD weightNumber of zero neighbors 28186, ,412, ,839, ,723,852, ,267,441, ,744,521,082, ,558,415,333, ,224,645,074, ,311,270,037, ,973,812,770, ,074,613,401, ,408,474,548, ,844,517,328,896 weightNumber of zero neighbors 1694, ,078, ,128,434, ,574,557, ,125,860,315, ,965,599,940, ,482,818,340,782, ,680,095,610,142, ,097,941,223,571, ,752,914,038,641,131, ,787,780,190,808,309, ,329,044,342,046,720 (128,50) extended primitive BCH code (128,64) Reed-Muller code

10/12/2004ISITA Summary  We proposed an algorithm for computing the LWD of codes closed under a group of permutations.  We obtained some new LWDs with using the proposed algorithm.

10/12/2004ISITA Algorithm for Cyclic Codes  Outline 1.Generate (i) the cyclic representatives and (ii) the number of codewords that can be cyclic- permuted into each representative. 2.Check each of representatives whether it is a zero neighbor or not.  Complexity – About 1/n as much as that of brute force method. The method for obtaining (i) and (ii) without complex computation is known. The number of codewords that need to be checked is reduced by about 1/n.

10/12/2004ISITA Outline of the Proposed Algorithm 1. Select a subcode C’. 2. Partition all cosets of C’ into sets of cosets with a group of permutations, and obtain (i) the representative cosets and (ii) the number of cosets in each sets of cosets. 3. Compute the weight distributions of zero neighbors in each representative cosets. 4. Sum up all the distributions.

Comparison of the Complexity The complexity of the proposed algorithm is about 1/64 as much as that of the algorithm for cyclic codes in the case of n=128.  The algorithm for cyclic codes – About 1/n as that for the brute force method. The number of permutations in cyclic permutations is n.  The proposed algorithm – At most 1/n(n-1) as that for the brute force method. The number of permutations in the affine group is n(n-1).

10/12/2004ISITA How tighter upper bound we obtain using LWD?  We can obtain the tighter upper bound to use the LWD instead of the weight distribution.  However, the bounds becomes only a little tighter. They are almost the same.  Because the union bound depends mainly on the numbers of small weight codewords, and the numbers of small weight codewords in LWD are the same as the weight distribution.

10/12/2004ISITA Future works  To reduce the complexity more. – Using the invariance property for codewords in each coset.  To obtain the LWD of a code with using the LWD of its extended one. – Some relations hold for the LWD between an extended code and the original one (see section 6 of the paper).