Lesson 114 — Eigenvalues and Eigenvectors
Invariant directions of a linear transformation: Av = λv. Characteristic polynomial, algebraic and geometric multiplicity. The cornerstone of PageRank, quantum mechanics, and PCA.
Used in: Linear Algebra (1st year engineering) · Equiv. Lineare Algebra LK German · Equiv. H2 Math Singapore · Math III advanced Japanese
An eigenvector of is a direction that only stretches or shrinks, without rotating. The scalar is the eigenvalue. Eigenvalues are the roots of the characteristic polynomial .
Rigorous notation, full derivation, hypotheses
Rigorous definition
Eigenvalues and eigenvectors
Characteristic equation
Eigenspace and multiplicities
Fundamental properties
General vector rotates under A (yellow arrow deviates). Eigenvector only changes magnitude, remains on the same line (blue arrow).
Worked examples
Exercise list
40 exercises · 10 with worked solution (25%)
- Ex. 114.1Application
Compute the eigenvalues and eigenvectors of .
Show solution
The matrix is diagonal, so eigenvalues are on the diagonal: and . Eigenvectors: and .Show step-by-step (with the why)
- For a diagonal matrix , the characteristic polynomial is . Why: the determinant of a diagonal matrix is the product of the diagonal.
- Roots: and . No need for quadratic formula.
- Eigenvectors: each coordinate axis. .
Shortcut: diagonal matrix — eigenvalues are on the diagonal and eigenvectors are the canonical basis vectors.
- Ex. 114.2Application
Compute the eigenvalues of and find the corresponding eigenvectors.
Show solution
Polynomial: . Eigenvalues: , . For : eigenvector . For : eigenvector . - Ex. 114.3ApplicationAnswer key
Compute the eigenvalues of .
Show solution
Polynomial: . Eigenvalues: , . Eigenvectors: and . - Ex. 114.4Application
Compute the eigenvalues and eigenvectors of .
Show solution
Polynomial: . Eigenvalues: and . For : . For : . This is the reflection matrix in the angle bisector. - Ex. 114.5Application
Compute the eigenvalues of .
Show solution
Polynomial: . Eigenvalues: and . Verification: ; .Show step-by-step (with the why)
- Set up .
- Compute the determinant: .
- Factor: , roots and .
- Check with sum and product of diagonal elements.
Mental shortcut: for , use the formula directly.
- Ex. 114.6ApplicationAnswer key
Compute the eigenvalues and eigenvectors of .
Show solution
Polynomial: . Eigenvalues: and . Eigenvectors: and , orthogonal (expected for symmetric). - Ex. 114.7ApplicationAnswer key
Analyze the diagonalizability of . Compute algebraic and geometric multiplicity.
Show solution
Upper triangular: eigenvalues on diagonal, , (multiplicity 2). Eigenspace: , . So — not diagonalizable. - Ex. 114.8ApplicationAnswer key
Compute the eigenvalues of .
Show solution
Polynomial: . Factoring: . Eigenvalues: and . Verification: ; . - Ex. 114.9Application
Compute the eigenvalues of .
Show solution
Triangular: eigenvalues (on diagonal). Eigenvectors: of canonical basis. - Ex. 114.10Application
Compute the eigenvalues of .
Show solution
Lower triangular: eigenvalues on diagonal: . Verification: ; . - Ex. 114.11ApplicationAnswer key
Compute the eigenvalues of and determine if it is diagonalizable.
Show solution
Nilpotent of order 2: . Polynomial: . Unique eigenvalue: with . Eigenspace: , — not diagonalizable. - Ex. 114.12ApplicationAnswer key
Compute the eigenvalues of .
Show solution
Matrix of ones: , . So and . Eigenvector of : . Eigenspace of : , dimension 2. Diagonalizable.Show step-by-step (with the why)
- Note that every row of the matrix is , so .
- This implies , so with .
- Sum of all eigenvalues = , so the third eigenvalue is .
- Check: .
Curious fact: rank-1 matrices always have zero eigenvalues and one eigenvalue equal to the trace.
- Ex. 114.13Application
If has eigenvalues and , what are the eigenvalues of ? Compute .
Show solution
If , then . Eigenvalues of : and . So has eigenvalue with multiplicity 2, meaning . - Ex. 114.14Application
A matrix has eigenvalues and . What are the eigenvalues of ?
Show solution
If eigenvalues of are and , then eigenvalues of are and , and eigenvalues of are and . (Polynomial in matrix shifts eigenvalues.) - Ex. 114.15Application
A matrix has eigenvalues , , . Compute and .
Show solution
If eigenvalues are : and . - Ex. 114.16Application
A matrix has and . Compute the eigenvalues.
Show solution
Polynomial: . Eigenvalues and . - Ex. 114.17Application
Prove that if is an eigenvalue of invertible , then is an eigenvalue of .
Show solution
If is an eigenvalue of invertible , then is an eigenvalue of . Proof: .Show step-by-step (with the why)
- Start with with (guaranteed since invertible).
- Apply to both sides: .
- Divide by : .
Remark: the same eigenvector works for both and ; only the eigenvalue changes to its reciprocal.
- Ex. 114.18Application
Compute the eigenvalues of the rotation matrix for .
Show solution
Rotation by : polynomial . Discriminant: . No real eigenvalues. Complex eigenvalues: . - Ex. 114.19Understanding
Explain why a matrix with necessarily has as an eigenvalue.
Show solution
means is singular, so has a nontrivial solution . This means exactly , that is is an eigenvalue. - Ex. 114.20Understanding
Show that and have the same characteristic polynomial (and thus the same eigenvalues).
Show solution
since for any matrix. So and have the same characteristic polynomial and thus the same eigenvalues. But the eigenvectors generally differ. - Ex. 114.21Understanding
If (similar matrices), what can you conclude about the eigenvalues and eigenvectors of and ?
Show solution
If , then . Same polynomial, same eigenvalues. If , then , so the eigenvectors of are . Answer: B. - Ex. 114.22Understanding
If , what are the only possible eigenvalues of ?
Show solution
If and , then , so and . Answer: B. - Ex. 114.23Understanding
What are the eigenvalues of an orthogonal projection (with )?
Show solution
If is orthogonal projection, . Then , so : eigenvalues are or . Vectors in the projected subspace have ; vectors in the complement have . Answer: B. - Ex. 114.24Understanding
Prove that eigenvectors of distinct eigenvalues are linearly independent (case of two eigenvectors).
Show solution
Suppose and with . If , apply : . Subtract times the first equation: . Since and : , so .Show step-by-step (with the why)
- Suppose linear dependence: with .
- Apply : .
- Subtract times the original equation: .
- Since and : , so . Contradiction.
Shortcut: this argument generalizes by induction to any number of eigenvectors of distinct eigenvalues.
- Ex. 114.25Understanding
Show that real eigenvalues of an orthogonal matrix (with ) satisfy .
Show solution
Orthogonal matrices preserve norms: . If , then , so . Real eigenvalues: . - Ex. 114.26Modeling
A Markov chain of two regions (Southeast and Northeast) has transition matrix . Find the stationary distribution via the eigenvector of .
Show solution
Transition matrix: . Stationary distribution: eigenvector of . Solve : → . Normalize: . Long run: 50% rainy, 50% sunny.Show step-by-step (with the why)
- Every stochastic matrix has as an eigenvalue. Why: the sum of each column is 1, so .
- Set up and row-reduce.
- Normalize by the condition .
- Verify: .
Curious fact: this is the foundation of Google's PageRank — the stationary distribution of the Markov chain where pages are states and links are transitions.
- Ex. 114.27Modeling
The Fibonacci sequence is generated by . Compute the eigenvalues and explain the growth of the sequence.
Show solution
Fibonacci polynomial: . Roots: (golden ratio) and . Since , the sequence grows without bound. Since , the $\\psi$-term decays to zero. - Ex. 114.28ModelingAnswer key
For the control system with : verify stability by analyzing the eigenvalues.
Show solution
For , eigenvalues are and (diagonal). Both have negative real part ( and ). So the system is asymptotically stable — all solutions converge to zero. - Ex. 114.29Modeling
A Hessian matrix at a critical point is . Identify the eigenvalues and classify the critical point (maximum/minimum/saddle).
Show solution
Given (diagonal, symmetric): eigenvalues and , both negative. So is negative definite. This means the system is stable and is positive definite (would be a Hessian of a minimum). - Ex. 114.30ModelingAnswer key
For a path graph with 3 nodes (1—2—3), set up the Laplacian , compute the eigenvalues, and identify the number of connected components.
Show solution
Laplacian of path graph with 3 nodes: . Eigenvalues: . The eigenvalue has multiplicity 1 — confirms the graph has 1 connected component. Eigenvector of : .Show step-by-step (with the why)
- Set up the Laplacian where is diagonal of degrees and the adjacency matrix.
- For the path 1-2-3: nodes 1 and 3 have degree 1; node 2 has degree 2.
- Compute .
- Observe: always has (sum of rows is zero). Number of components = multiplicity of .
Curious fact: the second smallest eigenvalue of the Laplacian (Fiedler value) measures how well-connected the graph is — foundation of spectral clustering in machine learning.
- Ex. 114.31ModelingAnswer key
Prove that if is an eigenvalue of with eigenvector , then is an eigenvalue of with the same eigenvector .
Show solution
If is an eigenvalue of with eigenvector , then for : . So is an eigenvalue of , with the same eigenvector. - Ex. 114.32Modeling
In finance, the covariance matrix of two identical stocks with variance and correlation is . Compute the eigenvalues and interpret.
Show solution
The covariance matrix of two stocks with equal variance and correlation is . Eigenvalues: and . Eigenvectors: (common factor) and (differential factor). - Ex. 114.33Challenge
Prove that if is an eigenvalue of with eigenvector , then is an eigenvalue of for every positive integer .
Show solution
Let . Apply : . By induction: . So is an eigenvalue of with the same eigenvector . - Ex. 114.34ChallengeAnswer key
Prove that eigenvalues of an idempotent matrix () are only or .
Show solution
If is idempotent () and , then , so and . Examples: orthogonal projections are idempotent.Show step-by-step (with the why)
- Use (result of previous exercise).
- Use : thus .
- Combine: , that is .
- Since : .
Remark: idempotent matrices are exactly the projections (not necessarily orthogonal).
- Ex. 114.35Challenge
Construct a matrix with eigenvalues and such that is an eigenvector of and is an eigenvector of .
Show solution
Find with eigenvalues , and eigenvectors , . Construct where , . Result: . - Ex. 114.36Challenge
Prove that eigenvectors of a symmetric matrix corresponding to distinct eigenvalues are orthogonal.
Show solution
If symmetric and , with : . Thus . Since : . - Ex. 114.37Proof
Prove that a triangular matrix (upper or lower) has eigenvalues equal to the diagonal elements.
Show solution
Upper triangular matrix with diagonal . The determinant of (also triangular) is the product of the diagonal: . The roots are exactly the diagonal elements.Show step-by-step (with the why)
- Note that is triangular (upper or lower) with diagonal . Why: subtracting from the diagonal of a triangular matrix doesn't change triangular structure.
- The determinant of a triangular matrix is the product of diagonal elements: .
- The roots of are for .
Shortcut: this result holds for upper and lower triangular. Applies immediately to diagonal matrices as a special case.
- Ex. 114.38Proof
Prove (by induction) that eigenvectors corresponding to distinct eigenvalues are linearly independent.
Show solution
Let be eigenvalues of with corresponding eigenvectors , all distinct. Prove by induction on . Base : one nonzero eigenvector is LI by definition. Step: assume are LI. If , apply and use the induction hypothesis to conclude for all . - Ex. 114.39Proof
Prove that every real symmetric matrix has only real eigenvalues.
Show solution
For symmetric and eigenvalue : suppose , . Take the conjugate: (since is real). Then . Since : , so .Show step-by-step (with the why)
- Suppose and .
- Take the inner product of both sides with : .
- Use symmetry of : .
- Therefore , that is .
Remark: this is the spectral theorem for real symmetric matrices — they always have real eigenvalues and orthogonal eigenvectors (see Lesson 116).
- Ex. 114.40Application
For with characteristic polynomial , determine all eigenvalues, their algebraic and geometric multiplicities, and decide if is diagonalizable.
Show solution
Characteristic polynomial given: . Eigenvalues: (algebraic multiplicity 1) and (algebraic multiplicity 2). For : has rank 1 (since and ). So kernel dimension = 2, meaning . For : eigenvector .Show step-by-step (with the why)
- Polynomial given: . Roots: , (double). Why: read the roots directly from the factored polynomial.
- For : compute : each entry is . Result: matrix in which each row is . Rank = 1, so kernel has dimension .
- Since and , we have 3 linearly independent eigenvectors — the matrix is diagonalizable.
Shortcut: to check the dimension of eigenspace, compute rank of by row reduction; .
Sources
- A First Course in Linear Algebra — Robert A. Beezer · 2022 · EN · GNU FDL · §EE and §PEE. Primary source of exercises and rigorous definitions.
- Understanding Linear Algebra — David Austin · 2023 · EN · CC-BY-SA · §4.1–§4.3. Source of geometric examples and applications to Markov chains.
- Linear Algebra Done Right (4th ed.) — Sheldon Axler · 2024 · EN · CC-BY-NC · Ch. 5. Reference for modern approach to multiplicities and eigenspaces.