The 2006 International Seminar of E-commerce Academic and Application Research Tainan, Taiwan, R.O.C. March 1-2,2006 An Application of Coding Theory into.

Slides:



Advertisements
Similar presentations
Mahdi Barhoush Mohammad Hanaysheh
Advertisements

Forward Error Correcting Codes for Forward Error Correcting Codes for Optical Communication Systems University of Technology Dept. of computer Engineering.
Error Control Code.
L. J. Wang 1 Introduction to Reed-Solomon Coding ( Part I )
Information and Coding Theory
Probabilistic verification Mario Szegedy, Rutgers www/cs.rutgers.edu/~szegedy/07540 Lecture 4.
The Math Behind the Compact Disc Linear Algebra and Error-Correcting Codes william j. martin. mathematical sciences. wpi wednesday december fairfield.
Data and Computer Communications Tenth Edition by William Stallings Data and Computer Communications, Tenth Edition by William Stallings, (c) Pearson Education.
9.通信路符号化手法1 (誤り検出と誤り訂正の原理)
線形符号(10章).
Cellular Communications
通信路(7章).
DIGITAL COMMUNICATION Coding
Using Error-Correcting Codes For Text Classification Rayid Ghani Center for Automated Learning & Discovery, Carnegie Mellon University.
実験5 規則波 C0XXXX 石黒 ○○ C0XXXX 杉浦 ○○ C0XXXX 大杉 ○○ C0XXXX 高柳 ○○ C0XXXX 岡田 ○○ C0XXXX 藤江 ○○ C0XXXX 尾形 ○○ C0XXXX 足立 ○○
15-853Page :Algorithms in the Real World Error Correcting Codes I – Overview – Hamming Codes – Linear Codes.
Chapter 5 Inner Product Spaces
A Short Course at Tamkang University Taipei, Taiwan, R.O.C. March An Application of Coding Theory into Experimental Design Shigeichi Hirasawa.
Faculty of Computer Science © 2006 CMPUT 229 Special-Purpose Codes Binary, BCD, Hamming, Gray, EDC, ECC.
Hamming Code Rachel Ah Chuen. Basic concepts Networks must be able to transfer data from one device to another with complete accuracy. Data can be corrupted.
exercise in the previous class (1)
Syndrome Decoding of Linear Block Code
林茂昭 教授 台大電機系 個人專長 錯誤更正碼 數位通訊
Linear Codes.
1 Failure Correction Techniques for Large Disk Array Garth A. Gibson, Lisa Hellerstein et al. University of California at Berkeley.
DIGITAL COMMUNICATION Error - Correction A.J. Han Vinck.
Exercise in the previous class (Apr. 26) For s = (|s|=36), compute  2 -values of s for block length with 1, 2, 3.
Information and Coding Theory Linear Block Codes. Basic definitions and some examples. Juris Viksna, 2015.
Exercise in the previous class p: the probability that symbols are delivered correctly C: 1 00 → → → → What is the threshold.
Error Control Coding and Applications
CODING/DECODING CONCEPTS AND BLOCK CODING. ERROR DETECTION CORRECTION Increase signal power Decrease signal power Reduce Diversity Retransmission Forward.
Error Control Code. Widely used in many areas, like communications, DVD, data storage… In communications, because of noise, you can never be sure that.
Codes Codes are used for the following purposes: - to detect errors - to correct errors after detection Error Control Coding © Erhan A. Ince Types: -Linear.
1 Network Coding and its Applications in Communication Networks Alex Sprintson Computer Engineering Group Department of Electrical and Computer Engineering.
COEN 180 Erasure Correcting, Error Detecting, and Error Correcting Codes.
MIMO continued and Error Correction Code. 2 by 2 MIMO Now consider we have two transmitting antennas and two receiving antennas. A simple scheme called.
Introduction to Coding Theory. p2. Outline [1] Introduction [2] Basic assumptions [3] Correcting and detecting error patterns [4] Information rate [5]
Riyadh Philanthropic Society For Science Prince Sultan College For Woman Dept. of Computer & Information Sciences CS 251 Introduction to Computer Organization.
Error Control Code. Widely used in many areas, like communications, DVD, data storage… In communications, because of noise, you can never be sure that.
CS717 Algorithm-Based Fault Tolerance Matrix Multiplication Greg Bronevetsky.
Coding Theory. 2 Communication System Channel encoder Source encoder Modulator Demodulator Channel Voice Image Data CRC encoder Interleaver Deinterleaver.
§6 Linear Codes § 6.1 Classification of error control system § 6.2 Channel coding conception § 6.3 The generator and parity-check matrices § 6.5 Hamming.
DIGITAL COMMUNICATIONS Linear Block Codes
Hamming codes. Golay codes.
ADVANTAGE of GENERATOR MATRIX:
Linear Block Code 指導教授:黃文傑 博士 學生:吳濟廷
Chapter 31 INTRODUCTION TO ALGEBRAIC CODING THEORY.
Information Theory Linear Block Codes Jalal Al Roumy.
Channel Coding Binit Mohanty Ketan Rajawat. Recap…  Information is transmitted through channels (eg. Wires, optical fibres and even air)  Channels are.
Authentication protocol providing user anonymity and untraceability in wireless mobile communication systems Computer Networks Volume: 44, Issue: 2, February.
The parity bits of linear block codes are linear combination of the message. Therefore, we can represent the encoder by a linear system described by matrices.
Perfect and Related Codes
Some Computation Problems in Coding Theory
Elementary Coding Theory Including Hamming and Reed-Solomom Codes with Maple and MATLAB Richard Klima Appalachian State University Boone, North Carolina.
Digital Communications I: Modulation and Coding Course Term Catharina Logothetis Lecture 9.
Computer Architecture Error Correcting Codes Ralph Grishman Oct (Text pp and B-65-67) NYU.
Error Control Coding. Purpose To detect and correct error(s) that is introduced during transmission of digital signal.
Richard Cleve DC 2117 Introduction to Quantum Information Processing QIC 710 / CS 667 / PH 767 / CO 681 / AM 871 Lecture (2011)
Error Detecting and Error Correcting Codes
Exercise in the previous class (1) Define (one of) (15, 11) Hamming code: construct a parity check matrix, and determine the corresponding generator matrix.
Block Coded Modulation Tareq Elhabbash, Yousef Yazji, Mahmoud Amassi.
Channel Coding: Part I Presentation II Irvanda Kurniadi V. ( ) Digital Communication 1.
Lecture 11 Inner Product Space Last Time - Coordinates and Change of Basis - Applications - Length and Dot Product in R n Elementary Linear Algebra R.
Hamming Code In 1950s: invented by Richard Hamming
Authors: Hung-Yu, Chi-Sung Laih
IERG6120 Lecture 22 Kenneth Shum Dec 2016.
Part 2 Linear block codes
Subject Name: Information Theory Coding Subject Code: 10EC55
Block codes. encodes each message individually into a codeword n is fixed, Input/out belong to alphabet Q of cardinality q. The set of Q-ary n-tuples.
Information Redundancy Fault Tolerant Computing
Presentation transcript:

The 2006 International Seminar of E-commerce Academic and Application Research Tainan, Taiwan, R.O.C. March 1-2,2006 An Application of Coding Theory into Experimental Design Shigeichi Hirasawa Department of Industrial and Management Systems Engineering, School of Science and Engineering, Waseda University - Construction Methods for Unequal Orthogonal Arrays -

No.1 1. Introduction 序論

No Abstract Orthogonal Arrays (OAs) Error-Correcting Codes (ECCs) Experimental DesignCoding Theory ・ relations between OAs and ECCs ・ the table of OAs and Hamming codes ・ the table of OAs + allocation table of OA L 8 etc. Hamming codes, BCH codes RS codes etc. close relation 実験計画 符号理論 直交配列 直交表 L 8

No Outline 1. Introduction 2. Preliminary 3. Relation between ECCs and OAs 4. Unequal Error Protection Codes and OAs 5. Examples of OAs with Unequal Strength 6. Conclusion 序論 準備 結論

No.4 準備 2 . Preliminary

No.5 実験計画法 Experimental Design

No.6 2.1 Experimental Design ( 実験計画 法 ) ・ Factor A (materials) A 0 ( A company ), A 1 ( B company ) ・ Factor B ( machines ) B 0 ( new ), B 1 ( old ) ・ Factor C ( temperatures ) C 0 ( 100 ℃), C 1 ( 200 ℃) a Ratio of Defective Products Ex.) ・ How the level of factors affects a ration of defective products ? ・ Which is the best combination of levels ? 要因 A 要因 B 要因 C Experimental Design

No.7 Complete Array A B C 0 0 0 0 0 1 0 1 0 0 1 1 1 0 0 1 0 1 1 1 0 1 1 1 Experiment ① ② ③ ④ ⑤ ⑥ ⑦ ⑧ experiment with A 0,B 0,C 0 experiments with all combination of levels 完全配列 実験

No.8 A B C 0 0 0 0 1 1 1 0 1 1 1 0 ② ③ ④ Orthogonal Array (OA) : OA(M, n, s,τ) (s=2) strength τ=2 subset (subspace) of complete array Experiment ① every 2 columns contains each 2- tuple exactly same times as row 直交配列 部分空間 強さ

No.9 A B C 0 0 0 0 1 1 1 0 1 1 1 0 ② ③ ④ Experiment ① Orthogonal Array (OA) : OA(M, n, s,τ) (s=2) subset (subspace) of complete array 直交配列 部分空間 strength τ=2 every 2 columns contains each 2- tuple exactly same times as row 強さ

No.10 A B C 0 0 0 0 1 1 1 0 1 1 1 0 ② ③ ④ Experiment ① Orthogonal Array (OA) : OA(M, n, s,τ) (s=2) subset (subspace) of complete array 直交配列 部分空間 strength τ=2 every 2 columns contains each 2- tuple exactly same times as row 強さ

No.11 A B C 0 0 0 0 1 1 1 0 1 1 1 0 ② ③ ④ Experiment ① Orthogonal Array (OA) : OA(M, n, s,τ) (s=2) subset (subspace) of complete array 直交配列 部分空間 strength τ=2 every 2 columns contains each 2- tuple exactly same times as row 強さ

No.12 Parameters of OAs ・ the number of factors n ・ the number of runs M ・ strength τ=2t A B C ① ② ③ ④ 0 0 0 0 1 1 1 0 1 1 1 0 the number of factors n=3 the number of runs M=4 strength τ=2 Construction problem of OAs is to construct OAs with as few as possible number of runs, given the number of factors and strength (n,τ → min M) this can treat t-th order interaction effect trade off Construction Problem of OAs 因子数 実験回数 強さ 因子数 実験回数 強さ

No.13 Generator Matrix of an OA : G Ex.) orthogonal array { 000, 011, 101, 110 } ( ○ , ○ , ○ ) = ( □ , □ ) 0 1 1 1 0 1 OA each k-tuple (k=2) based on { 0,1 } 2 2 k =M generator matrix G ABC ABC Generator Matrix ( 生成行 列 ) To construct OAs is to construct generator matrix

No.14 orthogonal array { 000, 011, 101, 110 } ( 0, 0, 0 ) = ( 0,0 ) 0 1 1 ABC ABC 1 0 1 OA generator matrix G Ex.) To construct OAs is to construct generator matrix Generator Matrix of an OA : G Generator Matrix ( 生成行 列 ) each k-tuple (k=2) based on { 0,1 } 2 2 k =M

No.15 orthogonal array { 000, 011, 101, 110 } ( 0, 1, 1 ) = ( 1,0 ) 0 1 1 ABC ABC 1 0 1 OA To construct OAs is to construct generator matrix generator matrix G Ex.) Generator Matrix of an OA : G Generator Matrix ( 生成行 列 ) each k-tuple (k=2) based on { 0,1 } 2 2 k =M

No.16 orthogonal array { 000, 011, 101, 110 } ( 1, 0, 1 ) = ( 0,1 ) 0 1 1 ABC ABC 1 0 1 OA generator matrix G Ex.) To construct OAs is to construct generator matrix Generator Matrix of an OA : G Generator Matrix ( 生成行 列 ) each k-tuple (k=2) based on { 0,1 } 2 2 k =M

No.17 orthogonal array { 000, 011, 101, 110 } ( 1, 1, 0 ) = ( 1,1 ) 0 1 1 ABC ABC 1 0 1 OA generator matrix G Ex.) To construct OAs is to construct generator matrix Generator Matrix of an OA : G Generator Matrix ( 生成行 列 ) each k-tuple (k=2) based on { 0,1 } 2 2 k =M

No.18 Parameters of OAs and Generator Matrix : G orthogonal arrays { 000, 011, 101, 110 } ・ the number of factors n=3 ・ the number of runs M=4 ・ strength τ=2 0 1 1 1 0 1 G = 3 2 the number of factors n=3 the number of runs M=2 2 any 2 columns are linearly independent strength τ=2 Ex.)

No.19 Parameters of OAs and Generator Matrix orthogonal arrays { 000, 011, 101, 110 } 0 1 1 1 0 1 G = 3 2 any 2 columns are linearly independent Ex.) ≠ ・ the number of factors n=3 ・ the number of runs M=4 ・ strength τ=2 the number of factors n=3 the number of runs M=2 2 strength τ=2

No.20 Parameters of OAs and Generator Matrix orthogonal arrays { 000, 011, 101, 110 } 0 1 1 1 0 1 G = 3 2 any 2 columns are linearly independent Ex.) ≠ ・ the number of factors n=3 ・ the number of runs M=4 ・ strength τ=2 the number of factors n=3 the number of runs M=2 2 strength τ=2

No.21 Parameters of OAs and Generator Matrix orthogonal arrays { 000, 011, 101, 110 } 0 1 1 1 0 1 G = 3 2 any 2 columns are linearly independent Ex.) ≠ ・ the number of factors n=3 ・ the number of runs M=4 ・ strength τ=2 the number of factors n=3 the number of runs M=2 2 strength τ=2

No.22 OAs and ECCs [HSS ‘99] G = n m OAs with generator matrix G ECCs with parity check matrix G ・ the number of factors n ・ the number of runs M=2 m ・ strength τ=2t ・ code length n ・ the number of information symbols k=n-m ・ minimum distance d=2t + 1 this can correct all t errors any τ=2t columns are linearly independent this can treat all t-th order interaction effect

No.23 Coding Theory

No.24 2.2 Coding Theory (符号理論) Coding Theory techniques to achieve reliable communication over noisy channel (ex. CD, cellar phones etc.) 0 → → Ex.) encoder channel decoder noise codewords 符号語

No.25 Error-Correcting Codes subspace of linear vector space 0 1 00 0 11 1 codeword Ex.) 誤り訂正符号 部分空間 符号語

No.26 ・ code length n ・ the number of information symbols k ・ minimum distance d=2t + 1 this can correct t errors trade off 000 0 111 1 the number of information symbols k=1 minimum distance d=3 this can correct 1 error Construction Problem of ECCs : (n, k, d) code Parameters of ECCs Construction problem of ECCs is to construct ECCs with as many as possible number of information symbols, given the code length and minimum distance ( n, d → max k ) 符号長 情報記号数 最小距離

No.27 Parity Check Matrix of ECCs Ex.) (3,1,3) code { 000, 111 } parity check matrix H = = = 0 codeword To construct of linear codes is to construct parity check matrix Parity Check Matrix HxT=0HxT=0

No.28 Parameters of ECCs and Parity Check Matrix ・ code length n=3 ・ the number of information symbols k=1 ・ minimum distance d=3 0 1 1 1 0 1 H = 3 2 code length n=3 the number of information symbols k=3 - 2 any d-1=2 columns are linearly independent minimum distance d=2 +1 Ex.) (3,1,3) code { 000, 111 }

No.29 OAs and ECCs [HSS ‘99] G = n m OAs with generator matrix G ECCs with parity check matrix G ・ the number of factors n ・ the number of runs M=2 m ・ strength τ=2t ・ code length n ・ the number of information symbols n-m ・ minimum distance d=2t + 1 this can correct all t errors any d-1=2t columns are linearly independent this can treat all t order interaction effect

No.30 3 . Relation Between OAs and ECCs 関係

No OAs and ECCs 0 1 1 1 0 1 G = OA with generator matrix G ECC with parity check matrix G

No.32 OAs and ECCs [HSS ‘99] G = n m OAs with generator matrix G ・ the number of factors n ・ the number of runs M=2 m ・ strength τ=2t ・ code length n ・ the number of information symbols k=n-m ・ minimum distance d=2t + 1 this can correct all t errors any 2t columns are linearly independent this can treat all t order interaction effect ECCs with parity check matrix G

No.33 Table of OAs and Hamming Codes 直交表

No Matrix in which any 2 columns are linearly an OA with strength τ=2 , a linear code with minimum distance independent ① 0 0 0 1 1 1 1 0 1 1 0 0 1 1 1 0 1 0 1 0 1 ・・・・・・ G = 3 n=7

No Matrix in which any 2 columns are linearly 0 0 0 1 1 1 1 0 1 1 0 0 1 1 1 0 1 0 1 0 1 G = 3 independent ① ≠ an OA with strength τ=2 , a linear code with minimum distance ・・・・・・ n=7

No Matrix in which any 2 columns are linearly an OA with strength 2 , a linear code with minimum distance 0 0 0 1 1 1 1 0 1 1 0 0 1 1 1 0 1 0 1 0 1 G = 3 independent ② ・ table of OA L 8 ・( 7,4,3 ) Hamming code the number of factors 7 , the number of runs 8 , strength 2 code length 7, the number of information symbols 4, minimum distance ・・・・・・ n=7

No Matrix in which any 2 columns are linearly an OA with strength 2 , a linear code with minimum distance independent ① ・ table of OA L 16 ・( 15,11,3 ) Hamming code the number of factors 15 , the number of runs 16 , strength 2 code length 15, the number of information symbols 11, minimum distance 3 0 0 0 1 1 1 1 0 0 0 0 1 1 1 1 0 1 1 0 0 1 1 0 0 1 1 0 0 1 1 1 0 1 0 1 0 1 0 1 0 1 0 1 0 1 G = 0 0 0 0 0 0 0 1 1 1 1 1 1 1 1 4

No.38 Table of OAs + allocation 直交表割付

No ① ② ③ ④ ⑤ ⑥ ⑦ ⑧ 3.3 Example ( Allocation to L 8 ) L 8 Linear Graph 1 24 35 6 7 線点図

No ② ③ ④ ⑤ ⑥ ⑦ ⑧ 1 24 35 6 7 factor A B D E A×BA×B BADEC C 3.3 Example ( Allocation to L 8 ) L 8 Linear Graph ① 線点図

No Construction Problem ( General Case ) Special Case ・ the number of factors n=5 , ・ strength τ=4 an OA with as few as possible of runs factors A,B,C,D,E this can treat all L=2 order interaction effects ( A×B,A×C, ・・・,D×E ) General Case ・ the number of factors n=5, ・ ? this can treat partial 2order interaction effects ( A×B ) Ex.) an OA with as few as possible of runs

No Generator Matrix ( General Case ) Special Case ( A×B,A×C, ・・・,D×E ) General Case ( A×B ) ABCDE generator matrix G = any 4 columns are linearly independent ABCDE ・ any 4 columns are linearly independent ・ any 3 columns which contain A, B are linearly independent factors A,B,C,D,E Ex.) generator matrix G =

No Meaning of allocation Generator Matrix of L 8 Projective Geometry ( Linear Graph )

No BADEC factor A B D C E if C, D, E are not allocated to this column, any 3 columns which contain A, B are linearly independent A×BA×B Meaning of allocation Generator Matrix of L 8 Projective Geometry ( Linear Graph )

No.45 4 . Unequal Error Protection Codes and OAs

No Unequal Error Protection Codes Unequal Error Protection Codes ( ○, ○, ○ ) codeword error protection levels are equal in each position of a codeword ( ○, ○, ○ ) codeword t+1tt error protection level t in each position error protection level (t 1,t 2,t 3 ) = (t+1, t, t) ttt Error-Correcting Codes Unequal Error Protection Codes error protection levels are unequal in each position of a codeword → minimum distance d=2t +1 → separation d i =2t i +1 this is used to send numerical data

No.47 Construction Problem of Unequal Error Protection Codes Error-Correcting Codes Unequal Error Protection Codes ・ code length n code with as many as possible number information symbols M ・ code length n code with as many as possible number information symbols M ・ minimum distance ・ minimum distance d (d 1,d 2, ・・・,d n )

No.48 Unequal Error Protection Codes and Parity Check Matrix Error-Correcting Codes Unequal Error Protection Codes H=1in ・・ ・ minimum distance d H=1in any d i -1 columns that contain i-th column are linearly independent separation (d 1, ・・・, d i, ・・・, d n ) ・・ ・ any d-1 columns are linearly independent

No Classification of OA ① OA ( General Case ) ② OA with unequal strength (τ 1, τ 2, ・・・, τ n ) → this can treat all τ i /2 = t i -th order interaction effect that contain i-th factor ③ OA with (equal) strength τ → this can treat all τ/2 = t-th order interaction effect Ex.) (factor A,B,C) ① A×B ② A×B, A×C ③ A×B, A×C, B×C ① ③ ②

No Classification of OA ① OA ( General Case ) ② OA with unequal strength (τ 1, τ 2, ・・・, τ n ) Unequal Protection Codes ③ OA with (equal) strength τ Error-Correcting Codes ① ③ ② Unequal Protection Codes Error-Correcting Codes

No Examples of OAs with unequal strength

No.52 OAs from ECC and Unequal Error Protection Codes OAs from BCH Codes OAs from Unequal Error Protection Codes ・ number of factors 63 ・ number of experiments 2 18 ・ strength 6 ・ number of factors 63 ・ number of experiments 2 12 ・ strength (6, 6, ・・・, 6, 4, 4, ・・・, 4) →this can treat all 3-rd order interaction effect →this can treat partial 3-rd order interaction effect 7

No.53 6 . Conclusion

No Conclusion 1. Construction problems ECCs : n, d → max k OAs : n, τ → min M 2. A generator matrix of OAs is equal to a parity check matrix of ECCs. 3. Relations of each columns in construction problems of OAs are more complicate than in those of ECCs.

No.55 参考文 献) [Taka79] I.Takahashi, “Combinatorial Theory and its Applications (in Japanese), ” Iwanami shoten, Tokyo, 1979 [HSS99] A.S.Hedayat , N.J.A.Sloane , and J.Stufken , “ Orthogonal Arrays : Theory and Applications , ” Springer , New York , 1999 . [SMH05] T.Saito, T.Matsushima, and S.Hirasawa, “A Note on Construction of Orthogonal Arrays with Unequal Strength from Error-Correcting Codes,” to appear in IEICE Trans. Fundamentals. [MW67] B.Masnic, and J.K.Wolf, “On Linear Unequal Error protection Codes,” IEEE Trans. Inform Theory, Vol.IT-3, No.4, pp , Oct.1967