Signal-Space Analysis ENSC 428 – Spring 2008 Reference: Lecture 10 of Gallager.

Slides:



Advertisements
Similar presentations
Vector Spaces A set V is called a vector space over a set K denoted V(K) if is an Abelian group, is a field, and For every element vV and K there exists.
Advertisements

1 D. R. Wilton ECE Dept. ECE 6382 Introduction to Linear Vector Spaces Reference: D.G. Dudley, “Mathematical Foundations for Electromagnetic Theory,” IEEE.
MRA basic concepts Jyun-Ming Chen Spring Introduction MRA (multi- resolution analysis) –Construct a hierarchy of approximations to functions in.
Signal , Weight Vector Spaces and Linear Transformations
Signal , Weight Vector Spaces and Linear Transformations
Chapter 5 Orthogonality
Computer Graphics Recitation 5.
Basic Concepts and Definitions Vector and Function Space. A finite or an infinite dimensional linear vector/function space described with set of non-unique.
Digital Communications I: Modulation and Coding Course Spring Jeffrey N. Denenberg Lecture 3b: Detection and Signal Spaces.
Quantum One: Lecture 8. Continuously Indexed Basis Sets.
Linear Algebra Review By Tim K. Marks UCSD Borrows heavily from: Jana Kosecka Virginia de Sa (UCSD) Cogsci 108F Linear.
Inner product Linear functional Adjoint
GROUPS & THEIR REPRESENTATIONS: a card shuffling approach Wayne Lawton Department of Mathematics National University of Singapore S ,
Linear Algebra Review 1 CS479/679 Pattern Recognition Dr. George Bebis.
Graphics CSE 581 – Interactive Computer Graphics Mathematics for Computer Graphics CSE 581 – Roger Crawfis (slides developed from Korea University slides)
1 February 24 Matrices 3.2 Matrices; Row reduction Standard form of a set of linear equations: Chapter 3 Linear Algebra Matrix of coefficients: Augmented.
BMI II SS06 – Class 3 “Linear Algebra” Slide 1 Biomedical Imaging II Class 3 – Mathematical Preliminaries: Elementary Linear Algebra 2/13/06.
Inner Product Spaces Euclidean n-space: Euclidean n-space: vector lengthdot productEuclidean n-space R n was defined to be the set of all ordered.
Signal Processing and Representation Theory Lecture 1.
Chapter 5: The Orthogonality and Least Squares
CHAPTER FIVE Orthogonality Why orthogonal? Least square problem Accuracy of Numerical computation.
Chapter 5 Orthogonality.
Linear Algebra Chapter 4 Vector Spaces.
Gram-Schmidt Orthogonalization
University of Texas at Austin CS384G - Computer Graphics Fall 2008 Don Fussell Orthogonal Functions and Fourier Series.
Digital Image Processing, 3rd ed. © 1992–2008 R. C. Gonzalez & R. E. Woods Gonzalez & Woods Matrices and Vectors Objective.
AN ORTHOGONAL PROJECTION
Matrices CHAPTER 8.1 ~ 8.8. Ch _2 Contents  8.1 Matrix Algebra 8.1 Matrix Algebra  8.2 Systems of Linear Algebra Equations 8.2 Systems of Linear.
Matrices. Definitions  A matrix is an m x n array of scalars, arranged conceptually as m rows and n columns.  m is referred to as the row dimension.
Quantum One: Lecture Representation Independent Properties of Linear Operators 3.
Elementary Linear Algebra Anton & Rorres, 9th Edition
CHAPTER 5 SIGNAL SPACE ANALYSIS
Unipolar vs. Polar Signaling Signal Space Representation
4.8 Rank Rank enables one to relate matrices to vectors, and vice versa. Definition Let A be an m  n matrix. The rows of A may be viewed as row vectors.
Section 5.1 Length and Dot Product in ℝ n. Let v = ‹v 1­­, v 2, v 3,..., v n › and w = ‹w 1­­, w 2, w 3,..., w n › be vectors in ℝ n. The dot product.
Chap. 5 Inner Product Spaces 5.1 Length and Dot Product in R n 5.2 Inner Product Spaces 5.3 Orthonormal Bases: Gram-Schmidt Process 5.4 Mathematical Models.
Chapter 4 Hilbert Space. 4.1 Inner product space.
Chap. 4 Vector Spaces 4.1 Vectors in Rn 4.2 Vector Spaces
AGC DSP AGC DSP Professor A G Constantinides©1 Signal Spaces The purpose of this part of the course is to introduce the basic concepts behind generalised.
Introduction to Real Analysis Dr. Weihu Hong Clayton State University 8/19/2008.
Digital Communications I: Modulation and Coding Course Term Catharina Logothetis Lecture 9.
Mathematical Tools of Quantum Mechanics
4.8 Rank Rank enables one to relate matrices to vectors, and vice versa. Definition Let A be an m  n matrix. The rows of A may be viewed as row vectors.
2 - 1 Chapter 2A Matrices 2A.1 Definition, and Operations of Matrices: 1 Sums and Scalar Products; 2 Matrix Multiplication 2A.2 Properties of Matrix Operations;
1 Objective To provide background material in support of topics in Digital Image Processing that are based on matrices and/or vectors. Review Matrices.
Chapter 4 Vector Spaces Linear Algebra. Ch04_2 Definition 1. Let be a sequence of n real numbers. The set of all such sequences is called n-space (or.
Beyond Vectors Hung-yi Lee. Introduction Many things can be considered as “vectors”. E.g. a function can be regarded as a vector We can apply the concept.
Inner Product Spaces Euclidean n-space: Euclidean n-space: vector lengthdot productEuclidean n-space R n was defined to be the set of all ordered.
Lecture 11 Inner Product Spaces Last Time Change of Basis (Cont.) Length and Dot Product in R n Inner Product Spaces Elementary Linear Algebra R. Larsen.
Lecture from Quantum Mechanics. "The most beautiful experience we can have is the mysterious. It is the fundamental emotion which stands at the cradle.
Spaces.
Vector Spaces B.A./B.Sc. III: Mathematics (Paper II) 1 Vectors in Rn
Vector Space Examples Definition of vector space
CS479/679 Pattern Recognition Dr. George Bebis
Chapter 1 Linear Equations and Vectors
Matrices and Vectors Review Objective
GROUPS & THEIR REPRESENTATIONS: a card shuffling approach
Chapter 3 Linear Algebra
B.Sc. III Year Mr. Shrimangale G.W.
Objective To provide background material in support of topics in Digital Image Processing that are based on matrices and/or vectors.
Signal & Weight Vector Spaces
Linear Algebra Lecture 38.
Elementary Linear Algebra
Elementary Linear Algebra Anton & Rorres, 9th Edition
Quantum Foundations Lecture 2
Vector Spaces 1 Vectors in Rn 2 Vector Spaces
Linear Algebra Lecture 41.
VI.3 Spectrum of compact operators
MA5242 Wavelets Lecture 1 Numbers and Vector Spaces
Linear Vector Space and Matrix Mechanics
Presentation transcript:

Signal-Space Analysis ENSC 428 – Spring 2008 Reference: Lecture 10 of Gallager

Digital Communication System

Representation of Bandpass Signal Bandpass real signal x(t) can be written as: Note that In-phaseQuadrature-phase

Representation of Bandpass Signal (1) (2)Note that

Relation between and f x fcfc -f c f fcfc ff

Energy of s(t)

Representation of bandpass LTI System

Key Ideas

Examples (1): BPSK

Examples (2): QPSK

Examples (3): QAM

Geometric Interpretation (I)

Geometric Interpretation (II)  I/Q representation is very convenient for some modulation types.  We will examine an even more general way of looking at modulations, using signal space concept, which facilitates Designing a modulation scheme with certain desired properties Constructing optimal receivers for a given modulation Analyzing the performance of a modulation.  View the set of signals as a vector space!

Basic Algebra: Group  A group is defined as a set of elements G and a binary operation, denoted by · for which the following properties are satisfied For any element a, b, in the set, a·b is in the set. The associative law is satisfied; that is for a,b,c in the set (a·b)·c= a·(b·c) There is an identity element, e, in the set such that a·e= e·a=a for all a in the set. For each element a in the set, there is an inverse element a -1 in the set satisfying a· a -1 = a -1 ·a=e.

Group: example  A set of non-singular n×n matrices of real numbers, with matrix multiplication  Note; the operation does not have to be commutative to be a Group.  Example of non-group: a set of non- negative integers, with +

Unique identity? Unique inverse fro each element?  a·x=a. Then, a -1 ·a·x=a -1 ·a=e, so x=e.  x·a=a  a·x=e. Then, a -1 ·a·x=a -1 ·e=a -1, so x=a -1.

Abelian group  If the operation is commutative, the group is an Abelian group. The set of m×n real matrices, with +. The set of integers, with +.

Application?  Later in channel coding (for error correction or error detection).

Algebra: field  A field is a set of two or more elements F={ , ,..} closed under two operations, + (addition) and * (multiplication) with the following properties F is an Abelian group under addition The set F−{0} is an Abelian group under multiplication, where 0 denotes the identity under addition. The distributive law is satisfied: (  +  + 

Immediately following properties   implies  or   For any non-zero    therefore    For a non-zero  its additive inverse is non-zero. 

Examples:  the set of real numbers  The set of complex numbers  Later, finite fields (Galois fields) will be studied for channel coding E.g., {0,1} with + (exclusive OR), * (AND)

Vector space  A vector space V over a given field F is a set of elements (called vectors) closed under and operation + called vector addition. There is also an operation * called scalar multiplication, which operates on an element of F (called scalar) and an element of V to produce an element of V. The following properties are satisfied: V is an Abelian group under +. Let 0 denote the additive identity. For every v,w in V and every  in F, we have  (  v  v)  (  v  v  v   v+w)=  v  w  1*v=v

Examples of vector space  R n over R  C n over C  L 2 over

Subspace.

Linear independence of vectors

Basis

Finite dimensional vector space

 A vector space V is finite dimensional if there is a finite set of vectors u 1, u 2, …, u n that span V.

Finite dimensional vector space

Example: R n and its Basis Vectors

Inner product space: for length and angle

Example: R n

Orthonormal set and projection theorem

Projection onto a finite dimensional subspace Gallager Thm 5.1 Corollary: norm bound Corollary: Bessel’s inequality

Gram –Schmidt orthonormalization

Gram-Schmidt Orthog. Procedure

Step 1 : Starting with s 1 (t)

Step 2 :

Step k :

Key Facts

Examples (1)

cont … (step 1)

cont … (step 2)

cont … (step 3)

cont … (step 4)

Example application of projection theorem Linear estimation

L 2 ([0,T]) (is an inner product space.)

Significance? IQ-modulation and received signal in L 2

On Hilbert space over C. For special folks (e.g., mathematicians) only L 2 is a separable Hilbert space. We have very useful results on 1) isomorphism 2)countable complete orthonormal set Thm If H is separable and infinite dimensional, then it is isomorphic to l 2 (the set of square summable sequence of complex numbers) If H is n-dimensional, then it is isomorphic to C n. The same story with Hilbert space over R. In some sense there is only one real and one complex infinite dimensional separable Hilbert space. L. Debnath and P. Mikusinski, Hilbert Spaces with Applications, 3 rd Ed., Elsevier, 2005.

Hilbert space Def) A complete inner product space. Def) A space is complete if every Cauchy sequence converges to a point in the space. Example: L 2

Orthonormal set S in Hilbert space H is complete if

Only for mathematicians (We don’t need separability.)

Theorem  Every orothonormal set in a Hilbert space is contained in some complete orthonormal set.  Every non-zero Hilbert space contains a complete orthonormal set. (Trivially follows from the above.) ( “non-zero” Hilbert space means that the space has a non-zero element. We do not have to assume separable Hilbert space.)  Reference: D. Somasundaram, A first course in functional analysis, Oxford, U.K.: Alpha Science, 2006.

Only for mathematicians. (Separability is nice.)

Signal Spaces: L 2 of complex functions

Use of orthonormal set

Examples (1)

Signal Constellation

cont …

QPSK

Examples (2)

Example: Use of orthonormal set and basis  Two square functions

Signal Constellation

Geometric Interpretation (III)

Key Observations

Vector XTMR/RCVR Model