Section 4 found two ways for diagonalization to fail.
The field can be too small, as for a rotation of . Or there can be
too few eigenvectors, as for , and no change of field
helps. In the second case we should ask for less. The
next simplest shape after a diagonal matrix is an upper
triangular one, and triangular matrices are almost as
good for computation: their eigenvalues, trace and
determinant are visible on the diagonal. This section
proves that an operator has a triangular matrix exactly
when its characteristic polynomial splits, so every
complex matrix is similar to a triangular one. The proof
is the induction on dimension that Section 1 promised:
take one eigenvector, pass to the quotient, and
repeat.
Triangular
matrices and chains of invariant subspaces
As in Section 2, start with the wish and unwind it.
Let be a basis of and . Column
of holds
the coordinates of (Definition 4.1.1).
The matrix is upper triangular when every entry below
the diagonal is
(Definition 0.9.5),
that is, when
is a combination of only. So the first basis vector
must be sent to a multiple of itself, the second into
the plane of the first two, and so on. In the language
of Section 1, each of the growing spans must be
invariant. Chapter 2 proved this as an exercise (Exercise (C1: Upper triangular matrices and invariant subspaces)),
where the word invariant was introduced just
for that problem; here it is again, with one more piece
of information about the diagonal.
Theorem
9.7.1 (Triangular Matrices and Chains of
Invariant Subspaces)
Let be
finite-dimensional with basis , let , and put and for . The
following are equivalent:
- (a) is
upper triangular;
- (b) for every
;
- (c) each is -invariant.
In that case, if are the diagonal entries of , then
for every .
Proof. Write , so that
with unique coefficients (Definition 4.1.1,
Theorem 1.5.1).
(a) (b). If
for
, then
. Conversely, if , it has a
representation using only ; by
uniqueness, for .
(b) (c). For
, , so is invariant by Lemma 9.1.1.
(c) (b). , so by
invariance.
Finally, suppose (a) holds and let . For , . For , , since
. By
linearity, .
A chain of subspaces with
is
often called a flag, after the picture
of a point on a line in a plane in space. The theorem
says: an upper triangular matrix is the same thing as a
flag of invariant subspaces, together with a basis
adapted to it. The last statement says what the diagonal
entry measures.
Modulo the smaller space , the operator
acts on the new
basis vector
as multiplication by .
The operators for which such a basis exists deserve a
name.
Definition
9.7.1 (Triangularizable)
Let be a
finite-dimensional vector space over . An operator is
triangularizable over if there
exists a basis of such that is
upper triangular. A matrix is
triangularizable over if there
exist an invertible
and
an upper triangular with .
As for diagonalizability, is triangularizable
over exactly when
is, by Theorem 4.2.4.
Examples.
- Diagonalizable operators are
triangularizable, since a diagonal matrix is upper
triangular. So are all operators on a space of dimension
, and the zero and
identity operators.
- Differentiation. For on in the
basis , the matrix is upper triangular with zero
diagonal: . The flag is , a
chain of invariant subspaces we met in Section 1. is not diagonalizable
(its only eigenvectors are the constants), but it is
triangularizable.
- Too few eigenvectors. is already triangular,
with flag .
Non-example by minimal change.
Reverse the basis for on : take
. The
spans are , still a
chain of subspaces of dimensions . What fails is
invariance of the first one: . Accordingly, the matrix in this
basis is which is lower triangular, not upper. Being
triangularizable is a property of ; being triangular is a
property of
and a basis.
A triangularizable operator on must have an
invariant line , hence an eigenvector (Proposition 9.1.2). So
the rotation of
by a right
angle, which has no invariant line (Example (A Rotation Has No Invariant Lines)),
is not triangularizable over . An eigenvector to
start the flag is exactly what is needed, and the next
theorem shows that it is also enough, provided
eigenvectors keep existing at every stage.
Quick check. Is
triangularizable over ? If so, find a basis
in which its matrix is upper triangular.
Solution. Yes. We need a first
basis vector that is an eigenvector. The matrix sends
to , so start
with , and
complete with .
In the basis , the image of is and the image of
is , so
the matrix is , which is upper
triangular. (The standard basis gives a lower triangular
matrix:
is not invariant.)
The
Triangularization Theorem
If has a
triangular matrix, its characteristic polynomial is a
product of linear factors, one for each diagonal entry.
The converse is the real content: splitting of is enough to build
the flag.
Theorem
9.7.2 (Triangularization Theorem)
Let be a
finite-dimensional vector space over with , and let
. Then
is
triangularizable over if and only if splits over . The same holds for
and
.
Idea. Take one eigenvector, extend,
recurse. Since
splits, it has a root in , so has an eigenvector
. Put and
extend to a
basis , with
the basis
it induces on .
By Theorem 9.1.3 the
matrix looks like where is the induced operator on the smaller space
. The first
column is already right. If could be made triangular,
the whole matrix would be. Now lives on a space
of dimension ,
and , so splits too:
this is the induction on dimension. The only technical
point is that a basis of lifts to vectors
that, together with , form a basis of
.
Proof. Let be
upper triangular with diagonal entries . The
matrix is upper triangular with
diagonal entries , and Theorem 7.4.6 holds
over (the
remark at the end of Chapter 7, §4). So by Definition 7.10.2,
which splits (Definition 6.4.2).
We
prove, by induction on , that every operator on an -dimensional space whose
characteristic polynomial splits is triangularizable.
For , every
matrix
is upper triangular.
Let , and
assume the statement for spaces of dimension . Since is monic of degree
(Theorem 7.10.2) and
splits, with . As , Theorem 9.2.1 gives an
eigenvector
with . Let . It is -invariant (Proposition 9.1.2),
, and
since . Let be the induced
operator on (Definition 9.1.2), a
space of dimension (Theorem 4.4.5).
splits. The restriction is , whose matrix
in the basis
is , so . By Theorem 9.1.3 (b),
Canceling the non-zero factor (Corollary 0.8.4 (2))
gives , which splits.
Apply the induction hypothesis. There is a
basis of with upper triangular, for some
.
Lift the basis. Let . Suppose . Passing to cosets, and using , gives (Theorem 4.4.4).
Since is a
basis, all .
Then
with ,
so (Theorem 1.1.9). Thus
is a linearly
independent list of vectors in , hence a basis (Theorem 1.6.4).
The matrix. extends the basis
of , and the cosets of the
added vectors form . By Theorem 9.1.3 (b),
where the is a column of zeros. The block
is upper triangular, so
is upper triangular. This completes the induction.
For , apply the result to , using Theorem 4.2.4.
The proof is an algorithm, and its output is a flag.
The first invariant subspace is the eigenline ; the -th is spanned by and the lifts of the
first vectors
of the flag for . The eigenvalue found at each stage is the
next diagonal entry.
Over the complex numbers the hypothesis is
automatic.
Corollary
9.7.3 (Complex Operators Are
Triangularizable)
Every operator on a finite-dimensional complex vector
space
is triangularizable over . Every , , is similar to an
upper triangular matrix in .
So over the
question of Chapter 4 always has at least this answer: a
basis exists in which the matrix has zeros below the
diagonal. A real matrix can always be triangularized as
a complex matrix, but perhaps only with complex
entries.
Warning. Triangularizing
may require leaving the field, and the triangular form
is far from unique. The rotation has , which
does not split over , so no
real invertible makes triangular;
over it becomes
. And a
triangularizable matrix has many triangular forms. and are both triangular forms
of the same operator (the first has distinct eigenvalues
, so it is
diagonalizable, and similar to the second). The
off-diagonal entries change with the flag and the basis,
and even the order of the diagonal entries is not fixed.
Only the diagonal entries, as a list with repetitions,
are determined, as the next theorem shows.
What the
diagonal records
A diagonalization displays the eigenvalues. A
triangularization does too, with their algebraic
multiplicities.
Proof.
(a) was shown in
the proof of Theorem 9.7.2, .
(b) By Theorem 9.2.1, the
eigenvalues are the roots of in , and is a root of
exactly when , that is, when for some
(Theorem 0.7.1). By Theorem 6.4.2, . Each term
is if and otherwise, by Theorem 6.1.3 (b),
since is
not divisible by for degree reasons. So the sum
counts the indices with .
(c) By Definition 4.5.2,
. By Definition 7.5.1 and
Theorem 7.4.6, .
The final statement follows from (b): the number of
times
occurs on the diagonal is , which does
not depend on the basis.
Part (c) recovers Theorem 9.3.3. In
Section 3 it came from comparing coefficients of ; here it is read off
a matrix. For instance, a complex matrix with
is similar to a triangular matrix with
diagonal
in some order, so and , however complicated looks.
The theorem does not say that a
triangular form with distinct diagonal
entries is itself diagonal: is a counterexample. What
does follow is that is then diagonalizable
(Corollary 9.4.2), so
some other basis makes its matrix
diagonal. And an operator with repeated diagonal entries
may or may not be diagonalizable: compare with .
Triangularizing a matrix in practice
For a matrix whose characteristic polynomial splits,
the proof of Theorem 9.7.2 becomes
a procedure.
- Find an eigenvalue and an
eigenvector .
- Extend to
a basis of , choosing the as simple as
possible, for example standard basis vectors.
- Compute the matrix of the induced operator on in the
basis . Its entries are the coordinates of along ,
ignoring the -coordinate.
- Triangularize this matrix in the same way, and
lift each coset back to its representative.
Example
(Triangularizing a Matrix with a Single Eigenvector
Line)
Let Show that is not diagonalizable
but is triangularizable over , and find an
invertible with
upper
triangular.
Solution. The characteristic
polynomial. Expanding along the first row (Theorem 7.6.1 over
), The last determinant is , so . It
splits, so is
triangularizable by Theorem 9.7.2.
Eigenvectors. has
rank , so ,
and is not
diagonalizable (Theorem 9.4.1 (e)).
The system gives and , so with : all
eigenvectors lie on one line.
Step 1. Let , and extend to the basis of
(the matrix
with these columns has determinant ).
Step 2: the induced operator. Express the
images of and
in the basis:
Dropping the -coordinates, the
induced operator on has, in the basis
, the matrix with , as the proof predicts.
Step 3: triangularize . Its second
column says , so is an
eigenvector. In the basis ,
, and the matrix becomes .
Step 4: lift. The basis
of gives
Check. ; ; . These are the columns , , of the
triangular matrix, read in the basis . Also .
The flag is . One can check the plane directly: lies in it again. The diagonal is , as Theorem 9.7.4
requires.
Different choices in Step 2 give different triangular
matrices, with the same diagonal. Chapter 10 shows how
to choose the basis so that the entries above the
diagonal are as simple as possible (the Jordan form).
Chapter 12 shows that over with an inner
product, the basis can even be chosen orthonormal
(Schur’s theorem).
Exercises
A. Check your
understanding
Exercise
(A1)
- (a) Define what it
means for to be triangularizable over .
- (b) State the
Triangularization Theorem.
- (c) For a basis
, which subspaces must be invariant for
to be upper triangular?
- (d) True or false:
every is triangularizable over . Justify your
answer.
- (e) True or false:
every triangularizable matrix is diagonalizable. Justify
your answer.
- (f) Let have
. What are the diagonal entries of any upper
triangular matrix similar to , and what are and ?
Solution.
(a) There are an
invertible and an upper triangular with (Definition 9.7.1).
(b) An operator
on a space of dimension over is triangularizable
over if and only
if its characteristic polynomial splits over (Theorem 9.7.2).
(c) All the spans
, (Theorem 9.7.1).
(d) False. The
rotation has , which does
not split over .
(e) False. is triangular but not
diagonalizable.
(f) By Theorem 9.7.4, the
diagonal is in some order, so and .
B. Practice
Exercise
(B1: Triangularizing matrices)
For each real matrix, find an invertible such that is upper
triangular, and write down .
Solution.
(a) , , so , which
splits. gives the eigenvector . Extend
with : . So with (In size , one eigenvector
already fixes the flag.)
(b) , so is an eigenvector for . Let and
extend to . Then and , so the induced operator has matrix in the basis . Its
characteristic polynomial is , with eigenvectors for and for , that is, and . Lifting
gives the basis . Now so with (expand along the second row). The
diagonal
agrees with .
Exercise
(B2: Nilpotent matrices are strictly triangular)
Let , , with for some . Prove that is similar to a
strictly upper triangular matrix, that
is, an upper triangular matrix with zero diagonal.
Solution. By Corollary 9.7.3, is
upper triangular for some invertible . By Theorem 9.7.4 (b),
each diagonal entry of is an eigenvalue of
. By Exercise (C2: Nilpotent operators)
(a), the only eigenvalue of a nilpotent operator on a
non-zero space is . So every diagonal
entry of is
, and is strictly upper
triangular. (The statement holds over every field, with
a different proof: use the chain to
build the basis.)
Exercise
(B3: Eigenvalues of powers from a triangular
form)
Let , , and let be
upper triangular with diagonal entries .
- (a) Show that the
product of two upper triangular matrices is upper
triangular, with diagonal entries the products of the
corresponding diagonal entries.
- (b) Deduce that
and for every .
- (c) Suppose . Find , and .
Solution.
(a) Let be upper
triangular. The -entry of is . A term can be non-zero only
if and
,
which forces . So the entry is when , and for only survives, giving
.
(b) , by induction on . By (a) and induction,
is upper
triangular with diagonal entries . By Theorem 9.7.4 (a) and
(c), applied to in the basis
given by the columns of , and .
(c) By Theorem 9.7.4, the
diagonal of is
in some
order. By (b), , ,
and . The last agrees with .
C. Going deeper
Exercise
(C1: A second proof of Cayley–Hamilton)
Let be
finite-dimensional with , and let have a basis
with upper
triangular, with diagonal entries . Let
and
.
- (a) Let . Prove by
induction on that
for .
- (b) Deduce that
, without
using the adjugate.
- (c) Deduce the
Cayley–Hamilton Theorem for every , and then
for every .
- (d) Why does this
argument, on its own, not prove the theorem for with
?
Hint: for (a), use the last statement of Theorem 9.7.1.
Solution.
(a) By Theorem 9.7.1, each
is invariant
and . For , . Suppose
for some .
Since , for we get .
(b) By Theorem 9.7.4 (a),
, so by Theorem 6.7.1 (b). By
(a), kills
, so .
(c) Let . By Corollary 9.7.3, has a basis in
which its matrix is upper triangular, and (b) gives
,
so
by Corollary 4.1.3.
For , regard as an element of . The Leibniz
formula gives the same polynomial with real
coefficients, and is computed
from the same entries by the same sums and products; it
is by the complex
case.
(d) Over , has no root
(its values at
and are both
), so it does not
split, and the matrix is not triangularizable over by Theorem 9.7.2. To run
the argument we would need a larger field containing
in which the
polynomial splits, and we have not constructed one. The
adjugate proof of Theorem 9.6.1 needs no
such field. (For instance has this characteristic
polynomial, and indeed over .)
Exercise
(C2: Real operators have small invariant
subspaces)
Let , , regarded also as a complex matrix.
- (a) Let () be a
complex eigenvalue of with eigenvector , where
.
Show that and .
- (b) Deduce that
is -invariant, and has
dimension or
.
- (c) Deduce that
every operator on a real vector space with
has an invariant subspace of dimension or .
- (d) For , check that is an eigenvector for , and find the invariant
plane of (b).
Solution.
(a) The
eigenvalue exists by Theorem 9.2.4. Since
has real
entries, with . On the other hand, . A vector of determines its real
and imaginary parts entry by entry, so and
.
(b) By (a), and lie in , so
is invariant by
Lemma 9.1.1. Since
, at least
one of is
non-zero, so , and since
is spanned by two vectors.
(c) Choose a
basis of , let , and let be as in (b). Let
be the coordinate isomorphism (Corollary 2.5.5). Then
is a
subspace of the same dimension as , and for ,
(Theorem 4.1.1),
so .
(d) With and :
and . So , and
is an
eigenvector for
(here , , matching (a)). The
invariant plane is , which is the plane . Over
, also has the
eigenvalue with
eigenvector , an invariant line.
Exercise
(C3: Traces of powers detect nilpotency)
Let , , with for . The goal is to prove that .
- (a) Let be the
diagonal entries of a triangular form of . Show that
for .
- (b) Suppose some
. Let
() be the
distinct non-zero values among the , and let be the number
of indices with
. Show
that for .
- (c) Show that the
matrix
with -entry
is
invertible, and derive a contradiction from (b).
- (d) Conclude that
every , that
, and
that .
- (e) Show that the
statement fails over .
Hint: for (c), factor the matrix as a transposed
Vandermonde matrix times a diagonal matrix.
Solution.
(a) By Corollary 9.7.3 a
triangular form exists, and by Exercise (B3: Eigenvalues of powers from a triangular form)
(b), , which is by hypothesis.
(b) Indices with
contribute
nothing to for . Grouping the other indices by their value,
. Since , (a) applies for .
(c) Let be the matrix with
-entry . The Vandermonde
matrix has -entry , so has -entry , and
multiplying column by gives . Since the are distinct, is invertible (Corollary 7.8.2),
hence so is
(Theorem 7.4.5); since
the are
non-zero, the diagonal matrix is invertible. So is invertible. By (b),
, so in . But each is a positive
integer, which is non-zero in . This contradiction
shows that no
is non-zero.
(d) By (c), all
, so by Theorem 9.7.4 (a). By
Theorem 9.6.1, .
(e) Over , has for every , but . The
step that fails is (c): the positive integer is in . Compare Exercise (C2: When commutes with ), where in
characteristic
the same conclusion was reached for a commutator by a
route that avoids eigenvalues.