1. 2 Overview Some basic math Error correcting codes Low degree polynomials Introduction to consistent readers and consistency tests H.W.

Slides:



Advertisements
Similar presentations
Vector Spaces A set V is called a vector space over a set K denoted V(K) if is an Abelian group, is a field, and For every element vV and K there exists.
Advertisements

5.4 Basis And Dimension.
5.1 Real Vector Spaces.
1. 2 Overview Review of some basic math Review of some basic math Error correcting codes Error correcting codes Low degree polynomials Low degree polynomials.
MaxClique Inapproximability Seminar on HARDNESS OF APPROXIMATION PROBLEMS by Dr. Irit Dinur Presented by Rica Gonen.
Probabilistic verification Mario Szegedy, Rutgers www/cs.rutgers.edu/~szegedy/07540 Lecture 3.
MRA basic concepts Jyun-Ming Chen Spring Introduction MRA (multi- resolution analysis) –Construct a hierarchy of approximations to functions in.
EEE377 Lecture Notes1 EEE436 DIGITAL COMMUNICATION Coding En. Mohd Nazri Mahmud MPhil (Cambridge, UK) BEng (Essex, UK) Room 2.14.
1 2 Introduction In this chapter we examine consistency tests, and trying to improve their parameters: In this chapter we examine consistency tests,
2.III. Basis and Dimension 1.Basis 2.Dimension 3.Vector Spaces and Linear Systems 4.Combining Subspaces.
1. 2 Gap-QS[O(n), ,2|  | -1 ] 3SAT QS Error correcting codesSolvability PCP Proof Map In previous lectures: Introducing new variables Clauses to polynomials.
Basis of a Vector Space (11/2/05)
1. 2 Gap-QS[O(1), ,2|  | -1 ] Gap-QS[O(n), ,2|  | -1 ] Gap-QS*[O(1),O(1), ,|  | -  ] Gap-QS*[O(1),O(1), ,|  | -  ] conjunctions of constant.
1 2 Introduction In this chapter we examine consistency tests, and trying to improve their parameters: –reducing the number of variables accessed by.
Chapter 11 Algebraic Coding Theory. Single Error Detection M = (1, 1, …, 1) is the m  1 parity check matrix for single error detection. If c = (0, 1,
1 2 Introduction We are going to use several consistency tests for Consistent Readers. We are going to use several consistency tests for Consistent Readers.Consistent.
1 The PCP starting point. 2 Overview In this lecture we’ll present the Quadratic Solvability problem. In this lecture we’ll present the Quadratic Solvability.
1 The PCP starting point. 2 Overview In this lecture we’ll present the Quadratic Solvability problem. We’ll see this problem is closely related to PCP.
1 2 Introduction In this lecture we’ll cover: Definition of strings as functions and vice versa Error correcting codes Low degree polynomials Low degree.
Stats & Linear Models.
Induction and recursion
Signal Processing and Representation Theory Lecture 1.
Chapter 5: The Orthogonality and Least Squares
Linear Algebra Chapter 4 Vector Spaces.
Elementary Linear Algebra Anton & Rorres, 9th Edition
Great Theoretical Ideas in Computer Science.
Chapter 5 General Vector Spaces.
Information and Coding Theory Linear Block Codes. Basic definitions and some examples. Juris Viksna, 2015.
Chapter 2: Vector spaces
Section 4.1 Vectors in ℝ n. ℝ n Vectors Vector addition Scalar multiplication.
Chapter 3 Vector Spaces. The operations of addition and scalar multiplication are used in many contexts in mathematics. Regardless of the context, however,
Error Control Code. Widely used in many areas, like communications, DVD, data storage… In communications, because of noise, you can never be sure that.
Great Theoretical Ideas in Computer Science.
Error Control Code. Widely used in many areas, like communications, DVD, data storage… In communications, because of noise, you can never be sure that.
1 Chapter 3 – Subspaces of R n and Their Dimension Outline 3.1 Image and Kernel of a Linear Transformation 3.2 Subspaces of R n ; Bases and Linear Independence.
§6 Linear Codes § 6.1 Classification of error control system § 6.2 Channel coding conception § 6.3 The generator and parity-check matrices § 6.5 Hamming.
Probabilistic verification Mario Szegedy, Rutgers www/cs.rutgers.edu/~szegedy/07540 Lecture 5.
Chap. 4 Vector Spaces 4.1 Vectors in Rn 4.2 Vector Spaces
I.4 Polyhedral Theory 1. Integer Programming  Objective of Study: want to know how to describe the convex hull of the solution set to the IP problem.
AGC DSP AGC DSP Professor A G Constantinides©1 Signal Spaces The purpose of this part of the course is to introduce the basic concepts behind generalised.
Word : Let F be a field then the expression of the form a 1, a 2, …, a n where a i  F  i is called a word of length n over the field F. We denote the.
Basic Concepts of Encoding Codes and Error Correction 1.
Fundamental Concepts of Algebra
Signal & Weight Vector Spaces
4.1 Introduction to Linear Spaces (a.k.a. Vector Spaces)
CSC461: Lecture 13 Coordinates Objectives Introduce concepts such as dimension and basis Introduce concepts such as dimension and basis Introduce coordinate.
5.4 Basis and Dimension The equations can be written by using MathType
Chapter 5 Chapter Content 1. Real Vector Spaces 2. Subspaces 3. Linear Independence 4. Basis and Dimension 5. Row Space, Column Space, and Nullspace 6.
Matrices CHAPTER 8.9 ~ Ch _2 Contents  8.9 Power of Matrices 8.9 Power of Matrices  8.10 Orthogonal Matrices 8.10 Orthogonal Matrices 
1 Objective To provide background material in support of topics in Digital Image Processing that are based on matrices and/or vectors. Review Matrices.
RS – Reed Solomon Error correcting code. Error-correcting codes are clever ways of representing data so that one can recover the original information.
7.3 Linear Systems of Equations. Gauss Elimination
Vector Spaces B.A./B.Sc. III: Mathematics (Paper II) 1 Vectors in Rn
Lecture 7 Vector Space Last Time - Properties of Determinants
Copyright © Cengage Learning. All rights reserved.
Polynomials, Secret Sharing, And Error-Correcting Codes
Polyhedron Here, we derive a representation of polyhedron and see the properties of the generators. We also see how to identify the generators. The results.
Basis and Dimension Basis Dimension Vector Spaces and Linear Systems
RS – Reed Solomon List Decoding.
Polyhedron Here, we derive a representation of polyhedron and see the properties of the generators. We also see how to identify the generators. The results.
Polynomials, Secret Sharing, And Error-Correcting Codes
Affine Spaces Def: Suppose
I.4 Polyhedral Theory (NW)
Maths for Signals and Systems Linear Algebra in Engineering Lectures 4-5, Tuesday 18th October 2016 DR TANIA STATHAKI READER (ASSOCIATE PROFFESOR) IN.
Vector Spaces 1 Vectors in Rn 2 Vector Spaces
I.4 Polyhedral Theory.
PCP Characterization of NP:
MA5242 Wavelets Lecture 1 Numbers and Vector Spaces
Lecture 19 The Vector Space Znp (Section 5.1)
Lecture 1 Introduction and preliminaries (Chapter 0)
Presentation transcript:

1

2 Overview Some basic math Error correcting codes Low degree polynomials Introduction to consistent readers and consistency tests H.W

3 Fields Definition (field): A set F with two binary operations + (addition) and · (multiplication) is called a field if 6  a,b  F, a·b  F 7  a,b,c  F, (a·b)·c=a·(b·c) 8  a,b  F, a·b=b·a 9  1  F,  a  F, a·1=a 10  a  0  F,  a -1  F, a·a -1 =1 1  a,b  F, a+b  F 2  a,b,c  F, (a+b)+c=a+(b+c) 3  a,b  F, a+b=b+a 4  0  F,  a  F, a+0=a 5  a  F,  -a  F, a+(-a)=0 11  a,b,c  F, a·(b+c)=a·b+a·c +,·,0, 1, -a and a -1 are only notations!

4 Finite Fields Definition (finite field): A finite set F with two binary operations + (addition) and · (multiplication) is called a finite field if it is a field. Example: Z p denotes {0,1,...,p-1}. We define + and · as the addition and multiplication modulo p respectively. One can prove that (Z p,+,·) is a field iff p is prime. Throughout the presentations we’ll usually refer to Z p when we’ll mention finite fields.

5 Strings & Functions (1) Let  =  0  2...  n-1, where  i . We can describe the string  as a function  : {0…n-1}  , such that  i  (i) =  i. Let f be a function f : D  R. Then f can be described as a string in R |D|, spelling f’s value on each point of D.

6 Strings & Functions - Example For example, let f be a function f : Z 5  Z 5, and let  = Z 5. f(x) = x 2   = 0, 1, 4, 4, 1

Introduction to Error Correcting Codes Motivation: communication line original message received message “noise” We’d like to still be able to reconstruct the original message

8 Error Correcting Codes Definition (encoding): An encoding E is a function E :  n   m, where m >> n. Definition (  -code): An encoding E is an  -code if  n  (E(  ),E(  ))  1 - , where  (x,y) (the Hamming distance), denotes the fraction of entries on which x and y differ. Note that  :  m  m  R + is indeed a distance function, because it satisfies: (1)  x,y  m  (x,y)  0 and  (x,y)=0 iff x=y (2)  x,y  m  (x,y)=  (y,x) (3)  x,y,z  m  (x,z)  (x,y)+  (y,z)

9  -code: illustration  E  1-  D R

10 Univariate Polynomials Definition (univariate polynomial): a polynomial in x over a field F is a function P:F  F, which can be written as for some series of coefficients a 0,...,a r-1  F. The natural number r is called the degree-bound of the polynomial. Note: A polynomial whose degree-bound is r is of degree at most r-1 !

11 Univariate Interpolation Given x 0,y 0,...,x r-1,y r-1  F there is a single univariate polynomial P and degree-bound r, which satisfies  0  k  r-1 P(x k )=y k (Lagrange’s formula) The process of finding the coefficients of a polynomial given its value in r points is called interpolation. Let’s check the value of this polynomial in x = x t for some 0  t  r-1: Since the degree-bound of this polynomial is r, we in fact proved the correctness of the formula a-b denotes a+(-b) a/b denoted a(b -1 ) 0 ytyt If there are two such polynomials: p 1 & p 2, then p 1 -p 2 is a polynomial with degree-bound r, which has r roots. This contradicts the fundamental theorem of Algebra!

12 A Generic  -code Set F to be the finite field Z p for some prime p, and assume for simplicity that  = F and m = p. Given  n, let E(  ) be the string of the function f  : F  F that satisfies: f  is the unique polynomial of degree-bound n such that f  (i) =  i for all 0  i  n-1.

13 A Generic  -code (2) E(  ) can be interpolated from any n points. Hence, for any , E(  ) and E(  ) may agree on at most n – 1 points. Therefore, E is an (n – 1) / m - code.

14 A Generic  -code - Example p = m = 5, n = 2  = 1, 2  = 3, 1 f  (x) = x + 1f  (x) = 3x + 3 E(  ) = 1, 2, 3, 4, 0E(  ) = 3, 1, 4, 2, 0

15 Strings & Functions (2) We can describe any string as a function f:H d  H (H is a finite field, d is a positive integer). Given a  n we’ll achieve that by choosing H=Z q, where q is the smallest prime greater than |  |, and d=  log q n .

16 Multivariate Polynomials Definition (polynomial): Let F be a field and let d be some positive integer number. A function p:F d  F is a polynomial if it can be written as for some series of coefficients in the field. h is the degree-bound on each one of the variables. The total-degree of the polynomial is max{ i 0 +…+i d-1 : a i 0 … i d-1  0 }.

17  -Codes - Home Assignment We’ve seen that univariate polynomials over a finite field F with degree-bound r are  -codes for  = (r-1)/|F|. For which  multivariate polynomials (over a finite field F, with degree-bound h in each variable and dimension d) are  -codes? Next

18 Curves Definition (curve): Let F be a field and let d be some natural number. A (univariate) curve is a function  :F  F d of the form where p 1,...,p d are univariate polynomials over F. The degree-bound of  is the maximum over the degree-bounds of the polynomials.

19 Vector Spaces Definition (vector space): Let F be a field and V a set. V is a vector space over F if a binary addition + is defined over V and a scalar multiplication · is defined over V and F s.t 1  u,v  V, u+v  V 2  u,v,w  V, (u+v)+w=u+(v+w) 3  u,v  V, u+v=v+u 4  0  V,  v  V, v+0=v 5  v  V,  -v  V, v+(-v)=0 6  v  V,  a  F a·v  V 7  u,v  V,  a  F a(u+v)=au+av 8  v  V,  a,b  F (a+b)v=av+bv 9  v  V,  a,b  F (ab)v=a(bv) 10  v  V, 1·v=v

20 Vector Spaces - Example Let F be a field and let n be a natural number. F n = { (a 1,...,a n ) | a 1,...,a n  F } is a vector space over F where for any (a 1,...,a n ),(b 1,...,b n )  F n (a 1,...,a n ) + (b 1,...,b n ) = (a 1 +b 1,...,a n +b n ) and for any (a 1,...,a n )  F n and c  F c(a 1,...,a n ) = (ca 1,...,ca n )

21 Subspaces Definition (subspace): A subset W of a vector space V (over a field F) is called a subspace of V if W itself is a vector space over the addition and scalar multiplication operations of V.

22 Affine Subspaces Definition (affine subspace): Let V be a vector space. U  V is an affine subspace of V if there exist a subspace W of V and a v  V, such that U = { u |  w  W : u = w + v }

23 Linear Combinations Definition (linear combination): Let V be a vector space over some field F. Let v 1,...,v k  V and let a 1,...,a k  F. The sum a 1 v a k v k is called a linear combination of v 1,...,v k with the coefficients a 1,...,a k. Definition (linear dependent): A set of vectors {v 1,...,v k } in some vector space V over a field F is linear dependent if there exist a 1,...,a k  F and an 1  i  k for which a i  0, s.t a 1 v a k v k =0. Vectors which are not linear dependent are called linear independent.

24 Basis Definition (Span): Let V be a vector space over some field F. Let K  V. Span(K) denotes the subspace of all the linear combination of members of K. Definition (Basis): Let B  {0} be a subset of a vector space V. B is called a basis for V if (a) B is linear independent. (b) Span(B)=V.

25 Dimensions Definition (dimension): The number of vectors in any basis of a vector space is called its dimension. Similarly, the dimension of an affine subspace is the dimension of its corresponding subspace.

26 Restriction of Polynomials Definition (restriction of a polynomial to an affine subspace): Let U be an affine subspace of F d (where F is a field and d is a positive integer). Let p:F d  F be a polynomial. The restriction of p to U is p’:U  F,  u  U p’(u)=p(u). Definition (restriction of a polynomial to a curve): Let  :F  F d be a curve (where F is a field and d is a positive integer). Let p:F d  F be a polynomial. The restriction of p to  is p’(x)=p(  (x)).

27 Restriction of Polynomials - Home Assignment [1] Prove that the restriction of p to U is a polynomial. What are its degree-bound and dimension? [2] The same for . Next

28 Low Degree Extension (LDE) Definition (low degree extension): Let  : H d  H be a string (where H is some finite field). Given a finite field F, which is a superset of H, we define a low degree extension of  to F as a polynomial LDE  : F d  F which satisfies:  LDE  agrees with  on H d (extension).  The degree-bound of LDE  is |H| in each variable (low degree).

29 LDE - Home Assignment Let  {0,1} n. Write down an expression for LDE .

30 Reading a value Goal: To be able to find the value of an LDE in any point (set of points) of F d. LDE x LDE(x)

31 Straightforward Approach x LDE(x) Represent the LDE by its coefficients. Alas, this will require access to |H| d variables, log|F| bits each, each time! the coefficients of the dimension- d, degree-bound- |H| LDE

32 “Tricky” Approach x LDE(x) the value of the LDE in every point in F d Represent the LDE by its values in the points of F d. Now we only need access to one variable (log|F| bits) each time. But now we encounter a new problem: we cannot be sure the values we are given are consistent, i.e. correspond to a single dimension-d, degree- bound-|H| polynomial.

33 Consistent Readers In the upcoming lectures we’ll see how to build readers which: access only a small number of the variables each time. detect inconsistency with high probability. We’ll later weaken this notion

34 v v v v v v v v v v v v v v Consistency Tests Suppose we have a set of variables which represent the LDE in some manner. A consistency test is a set of local tests. If the values of the variables are consistent, all the local tests accept. Otherwise a random test should reject w.h.p.

35 Corresponding Game Prover sets values to all variables in the representation. Verifier picks randomly a single local-test and accepts or rejects according to its output. The error-probability of a test is the fraction of local tests that may accept although the assigned values do not conform to global consistency.

36 Corresponding Game P(0,0,0)P(0,0,1)P(0,0,2)P(0,0,3)P(0,0,4)P(0,0,5)P(0,0,6) P(0,1,0)P(0,1,1)P(0,1,2)P(0,1,3)P(0,1,4)P(0,1,5)P(0,1,6) P(0,2,0)P(0,2,1)P(0,2,2)P(0,2,3)P(0,2,4)P(0,2,5)P(0,2,6) P(0,3,0)P(0,3,1)P(0,3,2)P(0,3,3)P(0,3,4)P(0,3,5)P(0,3,6) P(6,6,0)P(6,6,1)P(6,6,2)P(6,6,3)P(6,6,4)P(6,6,5)P(6,6,6) P(0,0,0)P(0,0,1)P(0,0,2)P(0,0,3)P(0,0,4)P(0,0,5)P(0,0,6) 3 P(0,1,1)P(0,1,2)P(0,1,3)P(0,1,4)P(0,1,5)P(0,1,6) P(0,2,0)P(0,2,1) 5 P(0,2,3)P(0,2,4)P(0,2,5)P(0,2,6) P(0,3,0)P(0,3,1)P(0,3,2)P(0,3,3)P(0,3,4)P(0,3,5)P(0,3,6) P(6,6,0)P(6,6,1)P(6,6,2)P(6,6,3) 2 P(6,6,5)P(6,6,6)