Unit 8, lesson 43

Complex Eigenvalues and Real Rotations

How a quarter-turn gets complex eigenvalues and eigenvectors, why the nonreal eigenvalues of a real matrix come in conjugate pairs, and what diagonalization over the complex numbers and the conjugate transpose mean.

  • Video 43
  • Complex Eigenvalues

Turn every arrow in the plane a quarter-turn counterclockwise. Each nonzero arrow ends up perpendicular to where it started, so no line through the origin stays in place and the turn has no real eigenvector. Its characteristic polynomial t2+1t^2 + 1 agrees, since it has no real root. This lesson lets scalars and vector entries be complex, finds the eigenvalues ii and −i-i with their eigenvectors, proves that the nonreal eigenvalues of a real matrix come in conjugate pairs, and separates what complex eigenvectors describe from what the real picture shows. Here and below, a tuple such as (1,−i)(1, -i) stands for a column vector.

Key terms

Quarter-turn rotation matrix

Definition The quarter-turn rotation matrix is

R=[0−110],R = \begin{bmatrix} 0 & -1 \\ 1 & 0 \end{bmatrix},

the standard matrix of the counterclockwise rotation of R2\mathbb{R}^2 about the origin through 90∘90^\circ. It sends (x,y)(x, y) to (−y,x)(-y, x), preserves lengths, and satisfies R2=−IR^2 = -I and R4=IR^4 = I. Its characteristic polynomial is

χR(t)=det⁡(tI−R)=det⁡[t1−1t]=t2+1.\begin{aligned} \chi_R(t) &= \det(tI - R) \\[0.4em] &= \det\begin{bmatrix} t & 1 \\ -1 & t \end{bmatrix} = t^2 + 1. \end{aligned}

Every real tt gives t2+1≥1t^2 + 1 \ge 1, so RR has no real eigenvalue and no nonzero real eigenvector. Preserving lengths is not the reason. The reflection with diagonal entries 11 and −1-1 also preserves lengths, and it has the real eigenlines spanned by e1\mathbf{e}_1 and e2\mathbf{e}_2.

In plain words A quarter-turn moves every line through the origin onto the perpendicular line, so no real direction is kept. The characteristic polynomial reports exactly this by having no real root.

Example The vector (2,1)(2, 1) goes to (−1,2)(-1, 2) and then to (−2,−1)(-2, -1), which is −(2,1)-(2, 1), as R2=−IR^2 = -I predicts. The vector and its first image have dot product 2(−1)+1⋅2=02(-1) + 1 \cdot 2 = 0, so they are perpendicular and not parallel.

Complex coordinate space

Definition For a positive integer nn, the complex coordinate space Cn\mathbb{C}^n is the set of columns with nn complex entries, with entrywise addition and multiplication by complex scalars. As a complex vector space it has dimension nn, with the standard basis e1,…,en\mathbf{e}_1, \dots, \mathbf{e}_n. The real space Rn\mathbb{R}^n sits inside it as the columns with real entries. A real or complex m×nm \times n matrix multiplies a column of Cn\mathbb{C}^n by the usual row by column rule, now with complex arithmetic, so a real n×nn \times n matrix also acts on Cn\mathbb{C}^n. Every z\mathbf{z} in Cn\mathbb{C}^n splits uniquely as z=x+iy\mathbf{z} = \mathbf{x} + i\mathbf{y} with x\mathbf{x} and y\mathbf{y} in Rn\mathbb{R}^n, so one vector of Cn\mathbb{C}^n carries 2n2n real numbers. Two uses of complex numbers must be kept apart. A real pair (x,y)(x, y) can be encoded as the single complex number x+iyx + iy in the complex plane, where multiplication by ii is the quarter-turn. A vector of C2\mathbb{C}^2 is a column of two complex numbers and carries four real numbers. It is an arrow in the real plane R2\mathbb{R}^2 only when both of its entries are real.

In plain words The matrix stays the same, and the space it acts on gets bigger. The new vectors are useful for algebra, but they do not live in the original real plane, and drawing them there as ordinary arrows would invent directions that do not exist.

Example The vector (1,−i)(1, -i) in C2\mathbb{C}^2 equals (1,0)+i(0,−1)(1, 0) + i(0, -1), so its real part is (1,0)(1, 0) and its imaginary part is (0,−1)(0, -1). Its second entry −i-i is not a real coordinate, so it is not the arrow to any point of R2\mathbb{R}^2. The quarter-turn matrix acts on it by the usual rule,

R[1−i]=[0⋅1+(−1)(−i)1⋅1+0⋅(−i)]=[i1].R\begin{bmatrix} 1 \\ -i \end{bmatrix} = \begin{bmatrix} 0 \cdot 1 + (-1)(-i) \\ 1 \cdot 1 + 0 \cdot (-i) \end{bmatrix} = \begin{bmatrix} i \\ 1 \end{bmatrix}.

Complex eigenvalues and eigenvectors

Definition Let AA be an n×nn \times n matrix with real or complex entries. A complex number λ\lambda is an eigenvalue of AA over C\mathbb{C} if there is a nonzero vector v\mathbf{v} in Cn\mathbb{C}^n with Av=λvA\mathbf{v} = \lambda\mathbf{v}, and such a v\mathbf{v} is a complex eigenvector for λ\lambda. As over R\mathbb{R}, the eigenvalues are exactly the roots of χA(t)=det⁡(tI−A)\chi_A(t) = \det(tI - A), now taken in C\mathbb{C}, and the eigenspace of λ\lambda is the null space of A−λIA - \lambda I in Cn\mathbb{C}^n, found by elimination with complex arithmetic. By the fundamental theorem of algebra, χA\chi_A factors into linear factors over C\mathbb{C}, so AA has nn complex eigenvalues counted with algebraic multiplicity. Their sum is the trace of AA and their product is det⁡A\det A. If AA is real and λ\lambda is not real, the eigenspace of λ\lambda contains no nonzero real vector, because Aw=λwA\mathbf{w} = \lambda\mathbf{w} with w\mathbf{w} real and nonzero would force λ\lambda to be real.

In plain words The question stays the same, a number λ\lambda and a nonzero v\mathbf{v} with Av=λvA\mathbf{v} = \lambda\mathbf{v}, but now both may involve complex numbers. Roots of the characteristic polynomial that were missing over R\mathbb{R} appear over C\mathbb{C}.

Example For the quarter-turn matrix the roots of t2+1t^2 + 1 are ii and −i-i. For λ=i\lambda = i, write v=(z1,z2)\mathbf{v} = (z_1, z_2). The first row of (R−iI)v=0(R - iI)\mathbf{v} = \mathbf{0} reads −iz1−z2=0-iz_1 - z_2 = 0, so z2=−iz1z_2 = -iz_1. The second row z1−iz2=0z_1 - iz_2 = 0 then holds automatically, since z1−i(−iz1)=z1+i2z1=0z_1 - i(-iz_1) = z_1 + i^2 z_1 = 0. Taking z1=1z_1 = 1 gives the eigenvector (1,−i)(1, -i), and the computation above shows

R[1−i]=[i1]=i[1−i].R\begin{bmatrix} 1 \\ -i \end{bmatrix} = \begin{bmatrix} i \\ 1 \end{bmatrix} = i\begin{bmatrix} 1 \\ -i \end{bmatrix}.

In the same way λ=−i\lambda = -i has the eigenvector (1,i)(1, i), since R(1,i)=(−i,1)=−i(1,i)R(1, i) = (-i, 1) = -i(1, i). The trace and determinant checks hold, with i+(−i)=0i + (-i) = 0 and i(−i)=1i(-i) = 1. Each eigenspace is a complex line, the set of all complex multiples of its eigenvector, so i(1,−i)=(i,1)i(1, -i) = (i, 1) is another eigenvector for ii.

Diagonalization over the complex numbers

Definition An n×nn \times n matrix AA with real or complex entries is diagonalizable over C\mathbb{C} if A=PDP−1A = PDP^{-1} for an invertible complex n×nn \times n matrix PP and a complex diagonal matrix DD. As over R\mathbb{R}, an invertible PP and a diagonal DD give A=PDP−1A = PDP^{-1} exactly when the columns of PP form an eigenbasis of Cn\mathbb{C}^n whose eigenvalues are the diagonal entries of DD in matching order. So AA is diagonalizable over C\mathbb{C} exactly when its complex eigenspaces have dimensions adding up to nn. Since χA\chi_A always factors over C\mathbb{C}, an equivalent test is that every eigenvalue has geometric multiplicity equal to its algebraic multiplicity, and nn distinct complex eigenvalues are enough. A real matrix that is diagonalizable over R\mathbb{R} is also diagonalizable over C\mathbb{C}, but not conversely, so a claim that a matrix is diagonalizable should name its scalars. If AA and its eigenvalue λ\lambda are both real, elimination on A−λIA - \lambda I uses only real numbers, so the complex eigenspace of λ\lambda has the same dimension as the real one. When the factorization exists, Ak=PDkP−1A^k = PD^kP^{-1} for every integer k≥0k \ge 0.

In plain words Complex scalars can supply eigenvalues and eigenvectors that were missing over R\mathbb{R}, but they cannot raise the dimension of an eigenspace that is too small. The complex factorization still describes the same real matrix.

Example With the two eigenvectors of RR as columns,

P=[11−ii],D=[i00−i],P−1=12[1i1−i].\begin{gathered} P = \begin{bmatrix} 1 & 1 \\ -i & i \end{bmatrix}, \qquad D = \begin{bmatrix} i & 0 \\ 0 & -i \end{bmatrix}, \\[0.4em] P^{-1} = \frac{1}{2}\begin{bmatrix} 1 & i \\ 1 & -i \end{bmatrix}. \end{gathered}

Here det⁡P=i−(−i)=2i≠0\det P = i - (-i) = 2i \ne 0, and the column checks above give RP=PDRP = PD, so R=PDP−1R = PDP^{-1} over C\mathbb{C} even though RR is not diagonalizable over R\mathbb{R}. Squaring DD gives −I-I, so R2=P(−I)P−1=−IR^2 = P(-I)P^{-1} = -I, and D4=ID^4 = I gives R4=IR^4 = I. These are the same facts the real picture shows for two and four quarter-turns.

Conjugate pairs of eigenvalues

Definition The conjugate of a complex vector or matrix is taken entry by entry. Let AA be an n×nn \times n matrix with real entries. If Av=λvA\mathbf{v} = \lambda\mathbf{v} for a nonzero v\mathbf{v} in Cn\mathbb{C}^n, then

Av‾=λ‾ v‾,A\overline{\mathbf{v}} = \overline{\lambda}\,\overline{\mathbf{v}},

so λ‾\overline{\lambda} is also an eigenvalue of AA, with eigenvector v‾\overline{\mathbf{v}}. The proof conjugates both sides of Av=λvA\mathbf{v} = \lambda\mathbf{v}. Conjugation passes through sums and products, A‾=A\overline{A} = A because the entries are real, and v‾≠0\overline{\mathbf{v}} \ne \mathbf{0} because v≠0\mathbf{v} \ne \mathbf{0}. So the nonreal eigenvalues of a real matrix come in pairs λ\lambda and λ‾\overline{\lambda}, and the two members of a pair have the same algebraic multiplicity because χA\chi_A has real coefficients. In particular a real matrix of odd size has at least one real eigenvalue, because its nn eigenvalues, counted with multiplicity, include an even number of nonreal ones. A real eigenvalue is its own conjugate, so the argument gives no new eigenvalue for it. The hypothesis that AA is real is essential. The 1×11 \times 1 matrix with entry ii has the eigenvalue ii but not −i-i.

In plain words For a real matrix, nonreal eigenvalues and their eigenvectors arrive as mirror image pairs. Once one of them is known, conjugating every entry gives the other with no extra work.

Example The real matrix

B=[1−111]B = \begin{bmatrix} 1 & -1 \\ 1 & 1 \end{bmatrix}

has χB(t)=(t−1)2+1\chi_B(t) = (t - 1)^2 + 1, with roots 1+i1 + i and 1−i1 - i. The vector (1,−i)(1, -i) is an eigenvector for 1+i1 + i. Since (1+i)(−i)=1−i(1 + i)(-i) = 1 - i, multiplying out gives

B[1−i]=[1+i1−i]=(1+i)[1−i].B\begin{bmatrix} 1 \\ -i \end{bmatrix} = \begin{bmatrix} 1 + i \\ 1 - i \end{bmatrix} = (1 + i)\begin{bmatrix} 1 \\ -i \end{bmatrix}.

Conjugating gives the eigenvector (1,i)(1, i) for 1−i1 - i. On the real plane, BB sends (x,y)(x, y) to (x−y,x+y)(x - y, x + y). Encoding (x,y)(x, y) as the complex number x+iyx + iy, this is multiplication by 1+i1 + i, a counterclockwise turn through 45∘45^\circ combined with scaling by ∣1+i∣=2\lvert 1 + i \rvert = \sqrt{2}. Two such steps give a quarter-turn with scaling by 22, and indeed B2=2RB^2 = 2R.

Conjugate transpose

Definition The conjugate transpose of an m×nm \times n complex matrix AA is the n×mn \times m matrix A∗=A‾⊤A^{*} = \overline{A}^{\top}, whose entry in row jj and column kk is akj‾\overline{a_{kj}}. For a real matrix the conjugate transpose is the ordinary transpose, A∗=A⊤A^{*} = A^{\top}. It satisfies (AB)∗=B∗A∗(AB)^{*} = B^{*}A^{*} and (A∗)∗=A(A^{*})^{*} = A. For a column v\mathbf{v} in Cn\mathbb{C}^n,

v∗v=∣v1∣2+⋯+∣vn∣2,\mathbf{v}^{*}\mathbf{v} = \lvert v_1 \rvert^2 + \cdots + \lvert v_n \rvert^2,

a real number that is positive for every v≠0\mathbf{v} \ne \mathbf{0}. That is why the standard length and inner product on Cn\mathbb{C}^n use the conjugate transpose, with ∥v∥=v∗v\lVert \mathbf{v} \rVert = \sqrt{\mathbf{v}^{*}\mathbf{v}} and ⟨x,y⟩=x∗y\langle \mathbf{x}, \mathbf{y} \rangle = \mathbf{x}^{*}\mathbf{y}. This inner product is conjugate-linear in the first argument, ⟨cx,y⟩=c‾⟨x,y⟩\langle c\mathbf{x}, \mathbf{y} \rangle = \overline{c}\langle \mathbf{x}, \mathbf{y} \rangle. The plain product v⊤v=v12+⋯+vn2\mathbf{v}^{\top}\mathbf{v} = v_1^2 + \cdots + v_n^2 can be zero, negative or nonreal for a nonzero v\mathbf{v}, so it cannot serve as a squared length.

In plain words In complex space, transpose and conjugate together. Each term vj‾ vj\overline{v_j}\,v_j equals ∣vj∣2\lvert v_j \rvert^2, so the sum measures length the way a real dot product does.

Example Let v=(1,i)\mathbf{v} = (1, i), a nonzero vector. The plain transpose gives v⊤v=1+i2=0\mathbf{v}^{\top}\mathbf{v} = 1 + i^2 = 0. The conjugate transpose is the row with entries 11 and −i-i, and v∗v=1+(−i)i=2\mathbf{v}^{*}\mathbf{v} = 1 + (-i)i = 2, so ∥v∥=2\lVert \mathbf{v} \rVert = \sqrt{2}. The eigenvector matrix PP of RR above satisfies P∗P=2IP^{*}P = 2I, so P−1=12P∗P^{-1} = \tfrac{1}{2}P^{*}, which matches the inverse found earlier.

Check yourself

  1. Show that the matrix AA with rows (0,−4)(0, -4) and (1,0)(1, 0) has no real eigenvalues. Find its complex eigenvalues and check them against the trace and the determinant.
Show the answer

The characteristic polynomial is

χA(t)=det⁡[t4−1t]=t2+4.\chi_A(t) = \det\begin{bmatrix} t & 4 \\ -1 & t \end{bmatrix} = t^2 + 4.

Every real tt gives t2+4≥4t^2 + 4 \ge 4, so there is no real root. Over C\mathbb{C} the roots are 2i2i and −2i-2i, since (2i)2=−4(2i)^2 = -4. Their sum is 00, the trace of AA, and their product is (2i)(−2i)=−4i2=4(2i)(-2i) = -4i^2 = 4, which equals det⁡A=0−(−4)=4\det A = 0 - (-4) = 4.

  1. For the matrix AA of question 1, find an eigenvector u\mathbf{u} for the eigenvalue 2i2i and check it. Then give an eigenvector for −2i-2i without solving again, and compare u⊤u\mathbf{u}^{\top}\mathbf{u} with u∗u\mathbf{u}^{*}\mathbf{u}.
Show the answer

The matrix A−2iIA - 2iI has rows (−2i,−4)(-2i, -4) and (1,−2i)(1, -2i). Write u=(z1,z2)\mathbf{u} = (z_1, z_2). The second row gives z1−2iz2=0z_1 - 2iz_2 = 0, so z1=2iz2z_1 = 2iz_2, and z2=1z_2 = 1 gives u=(2i,1)\mathbf{u} = (2i, 1). The first row also holds, since −2i(2i)−4=4−4=0-2i(2i) - 4 = 4 - 4 = 0. Directly, Au=(−4,2i)A\mathbf{u} = (-4, 2i) and 2i u=(4i2,2i)=(−4,2i)2i\,\mathbf{u} = (4i^2, 2i) = (-4, 2i). Because AA is real, conjugation gives the eigenvector u‾=(−2i,1)\overline{\mathbf{u}} = (-2i, 1) for −2i-2i. Finally u⊤u=(2i)2+1=−3\mathbf{u}^{\top}\mathbf{u} = (2i)^2 + 1 = -3, which is negative and cannot be a squared length, while u∗u=∣2i∣2+1=5\mathbf{u}^{*}\mathbf{u} = \lvert 2i \rvert^2 + 1 = 5, so ∥u∥=5\lVert \mathbf{u} \rVert = \sqrt{5}.

  1. True or false? (a) The matrix TT with rows (i,1)(i, 1) and (0,2)(0, 2) has the eigenvalue ii, so −i-i must also be an eigenvalue. (b) The matrix JJ with rows (2,1)(2, 1) and (0,2)(0, 2) becomes diagonalizable once complex scalars are allowed.
Show the answer

Both are false. In (a), the matrix TT is triangular, so its eigenvalues are its diagonal entries ii and 22. The conjugate pair theorem needs real entries, and TT has the nonreal entry ii. In (b), the characteristic polynomial is (t−2)2(t - 2)^2, so 22 is the only eigenvalue even over C\mathbb{C}. Solving (J−2I)v=0(J - 2I)\mathbf{v} = \mathbf{0} in C2\mathbb{C}^2 gives v2=0v_2 = 0, so the eigenspace is the set of complex multiples of e1\mathbf{e}_1, of dimension 1<21 < 2. Complex scalars can supply missing eigenvalues, but they cannot raise the dimension of a deficient eigenspace.

How this lesson connects

Where this leads in Linear Algebra II