Chapter 16 §07 proved that the eigenvalues of a
matrix move continuously with the matrix, but only after
quoting a theorem it did not prove: the roots of a monic
polynomial move continuously with its coefficients (Theorem 16.7.3). This
section proves that theorem, with nothing more than the
compactness of closed bounded sets. It then asks two
quantitative questions the qualitative theorem cannot
answer. How far can an eigenvalue move when the matrix
moves by a given amount, with no hypothesis on the
matrix at all? And how many eigenvalues does a region of
the plane hold? The second question finishes the story
of Gershgorin’s discs begun in Section 1: an isolated
disc holds exactly one eigenvalue.
Throughout, matrices are complex and eigenvalues are
listed with algebraic multiplicity, so that has
exactly of them
(Corollary 6.5.5). Two
imported facts of analysis are used, and each is named
where it acts: compactness, fact (A3) of Chapter 16’s
introduction, and the intermediate value theorem, fact
(A5).
A bound
for the roots
The proof of continuity will take a sequence of
polynomials and follow their roots. For that to work,
the roots must not escape to infinity, and the first
step is a bound on the roots in terms of the
coefficients.
Lemma
20.3.1 (Cauchy’s Bound for the Roots)
Let and
let
be monic. Put . Then every root
of satisfies
Idea. A root satisfies . If is large, the left side is much bigger
than every single term on the right, and there are only
terms; summing
the geometric series on the right makes this
precise.
Proof. If
there is nothing to prove, so suppose .
Since , we
have , and the triangle
inequality (Theorem 0.6.4) gives
where the equality sums a geometric series
with ratio . Dividing by
and multiplying by gives ,
as claimed.
The bound depends only on the size of the
coefficients, and that is what the next proof needs.
Polynomials whose coefficients stay bounded have roots
that stay bounded.
Quick check. Show that the in the bound cannot be
dropped: find a monic polynomial with a root of modulus
larger than .
Solution. Take , with
. Its roots
are , and . The bound does hold.
The roots
move continuously
Here is the theorem of Chapter 16 (Theorem 16.7.3), restated in
full under its own label, since from now on it is a
proved result.
Theorem
20.3.2 (Continuous Dependence of the Roots on
the Coefficients)
Let and
let be monic, with roots listed with multiplicity. Let . Then
there is with the following property. If is monic of the same degree
and for every , then the roots of
, listed with
multiplicity, can be numbered so that
for .
Idea. The hard direction, from
coefficients to roots, has no formula. The easy
direction does: expanding writes each
coefficient as a polynomial in the roots. So argue by
contradiction and let compactness supply the missing
formula.
① A bad sequence has root vectors that stay bounded, by
Cauchy’s bound. ② By compactness, a subsequence of root
vectors converges to some 𝛎. ③
Coefficients are polynomials in roots, so has the limiting coefficients, which are
those of . ④
Unique factorization says 𝛎 is a rearrangement
of . ⑤ That rearrangement is a good
numbering for the late , which were supposed
to have none.
Proof. Suppose the conclusion fails
for some . Then no works; in
particular fails for every integer . So there is a
monic with for every , whose roots admit
no numbering within of . By
Corollary 6.5.5 (a),
for some
𝛎, which lists the
roots of with
multiplicity.
The root vectors are bounded. Put . Then , so by Lemma 20.3.1 every
, and 𝛎. By compactness, fact (A3), the
sequence 𝛎 has a
subsequence 𝛎
converging in
to some 𝛎. Since 𝛎𝛎, each
coordinate converges: .
The limit is a root vector of . Expanding the
product gives , where
each is a fixed
polynomial with integer coefficients in (it is
the sum of all
products of
of the with
distinct indices). Hence 𝛎. Along the subsequence, the
algebra of limits gives 𝛎𝛎, while by
the choice of .
Limits are unique, so 𝛎 for every
, that is, Each factor is monic of degree , hence irreducible, so
both sides are factorizations of into monic
irreducibles. By the uniqueness in Theorem 6.3.5 (b),
there is a permutation of with
for every .
The contradiction. For each , , so there is with for all . Take . Then
the list is a numbering of the
roots of ,
with multiplicity, within of . This
contradicts the choice of , and proves the
theorem.
Chapter 16 quoted this statement as Theorem 16.7.3 and left its
proof to this section. The proof needed nothing beyond
compactness and unique factorization, and Corollary 16.7.4, with
everything Chapter 16 built on it, now rests on a proved
theorem.
Each hypothesis of the theorem did a job in the
proof. Monic of the same degree gave
both the bound on the roots and the factorization of
with exactly
linear factors.
Numbered so that is where the
permutation
went. It was produced by unique factorization and
depends on the subsequence, which is exactly the freedom
that Proposition 16.7.2 says
cannot be removed.
How far:
Elsner’s bound
The theorem says that a small enough perturbation
moves the roots a little, and it gives no rate. Chapter
16’s example Example (A Jordan block’s eigenvalues move like )
showed that no bound of the form can hold. What
does hold, for every matrix, is a bound by the
-th root of . The proof
bounds one determinant in two ways: from below by the
eigenvalues, and from above by Hadamard’s
inequality.
Theorem
20.3.3 (Elsner’s Spectral Variation
Bound)
Let , and let be the eigenvalues of . Then every eigenvalue
of satisfies (For the first factor is .)
Idea. The quantity is , and it is at least the
-th power of the
smallest factor. Bound the determinant above by
Hadamard’s inequality, after rotating to an orthonormal
basis whose first vector is an eigenvector of . The first column is
then , which is small. The other columns are merely
bounded. So one small factor meets bounded ones, and
taking -th roots
produces the exponent .
Proof. Let be an eigenvector of
for with . By Corollary 11.2.3,
extend to an
orthonormal basis of with , and let be the unitary matrix
with these columns. Then , so by Theorem 7.5.4 and Theorem 7.4.5.
By Corollary 12.1.5
applied to , whose eigenvalues are the , listed
with the same multiplicities (Theorem 9.10.1, with
),
and by Theorem 7.5.4, The -th
column of is . Hadamard’s inequality Theorem 13.6.4 (b)
bounds the determinant by the product of the column
lengths.
For , , so by Theorem 16.3.2 (a). For
, the
triangle inequality (Corollary 11.1.6)
gives , and by Theorem 16.4.1. Writing
, each factor on the left
is at least ,
so Taking non-negative -th roots, which
preserves inequalities between non-negative reals, gives
the claim.
The bound needs no hypothesis on : no diagonalizability,
no normality. It is a Hölder modulus of
continuity with exponent . The next
example shows that the exponent cannot be improved, and
that is the quantitative form of the instability that
Chapter 10 §03 warned about.
Example
(The Jordan block meets Elsner’s bound)
Let and
, and put and . Compare the
movement of the eigenvalues with Elsner’s bound, and
show that no bound of the form with can hold
for all .
Solution. The eigenvalues.
The matrix is
the one of Example (A Jordan block’s eigenvalues move like )
with , where
was computed. So the eigenvalues of
are the complex -th roots of , each of
modulus , while
has the single
eigenvalue . Every
eigenvalue has moved exactly .
The norms. has the single
non-zero entry , so (Theorem 16.3.3 (c)). Next,
and for
, so for
with equality at . Hence , and the
same computation with gives
.
The comparison. Elsner’s bound is , and the actual movement
is . The
bound is attained up to a factor .
The exponent is optimal. If a bound
held for these pairs with , then
, that is,
, for every .
But , so the left side tends to as . No
such exists.
Put numbers on it. For and , a
change in the sixteenth decimal place of one entry, the
eigenvalues of move to the
circle of radius . This pays the debt of Chapter 10 §03,
whose warning said that the Jordan form is not stable
under small changes of the matrix and that Chapter 20
returns to this point. Elsner’s theorem says how
unstable the eigenvalues can be: never worse than . The
Jordan block says that this worst case happens.
Arithmetic that keeps about sixteen significant digits
commits errors of about this relative size at every
step. So what such a computation returns are, at best,
the eigenvalues of some matrix within about of , and these may
be spread around a circle of radius . The computation
cannot tell a nilpotent Jordan block from a
diagonalizable matrix with sixteen distinct eigenvalues.
This is the numerical reason the Jordan form is not
computed in floating-point arithmetic.
Counting
eigenvalues in a region
Section 1 showed that every eigenvalue lies in the
union of the Gershgorin discs (Theorem 20.1.1), and
left open how many lie in each part of that union. The
tool for counting is a principle in the spirit of one
the proof of Proposition 16.7.2 already
used: an integer-valued function that varies
continuously cannot change. We apply it to the
number of eigenvalues in a region, while the matrix
moves along a segment.
Lemma
20.3.4 (Eigenvalue Counts Are Constant Along a
Path)
Let , and put for . Let be sets at positive
distance: there is with
for all and
. Suppose
that for every , every
eigenvalue of
lies in .
Then the number of eigenvalues of
in , counted with algebraic
multiplicity, does not depend on . In particular .
Idea. The eigenvalues cannot jump
across the gap between and , because they move
continuously and are never allowed inside the gap. So
near each the
count is unchanged, and a function that is locally
constant on an interval is constant. The last step is
the intermediate value theorem: a continuous function
with integer values cannot pass from one integer to
another without taking the values in between.
Proof. Fix . By Corollary 16.7.4, applied to
with the
tolerance and the
norm , there is
such
that every with
has its eigenvalues numbered so that
, where are the eigenvalues of . Now , so whenever , which holds for all close enough to .
For such ,
number the eigenvalues of in this way. Both
and lie in , and a point of
is at distance at
least from every
point of . Since
, the two lie in the same
one of the two sets: if and only if . Counting
indices, .
So is constant
on a neighborhood of each point of . In particular
is continuous: if
, then
for
all large .
Suppose for some , say ; the other case is symmetric. By the
intermediate value theorem, fact (A5), applied to on , there is with ,
which is not an integer. This contradiction shows for every
, and
proves the lemma.
Now the counting theorem. The trick is to shrink the
off-diagonal part of to zero. At the start
of the path the matrix is diagonal and its eigenvalues
are the disc centers, which we can count by looking.
Theorem
20.3.5 (Gershgorin’s Counting Theorem)
Let , let have elements with , and
put If , then contains exactly eigenvalues of and contains exactly , counted with
algebraic multiplicity.
Idea. Let and slide from to along .
The discs of
have the same centers and radii , so they grow
from points into the discs of and never leave . By Theorem 20.1.1 the
eigenvalues never leave either, and Lemma 20.3.4 carries
the count from , where it is , to .
Proof. The two unions are at
positive distance. Let and . The discs
and are disjoint, so
; otherwise the point on
the segment from to at distance from would lie in both.
For
and ,
the triangle inequality (Theorem 0.6.4) gives
Call the middle quantity . The minimum of the finitely many
is positive,
and every point of is at distance at least
from every point
of .
The path. Let and
for .
The diagonal entries of are the , and its
off-diagonal entries are , so and . By Theorem 20.1.1
applied to ,
every eigenvalue of lies in . By Lemma 20.3.4 with
and , the number of
eigenvalues of in is the same at and at .
The count at . is diagonal, so by Theorem 7.4.6, and
its eigenvalue list is .
For , is the center of
, so . For , , hence . So
exactly entries
of the list lie in .
Therefore has exactly eigenvalues in . All eigenvalues lie in
, and , so
the other lie
in . This proves
the theorem.
The case
is the one used most, and for a real matrix it says
something about reality as well.
Corollary
20.3.6 (An Isolated Disc Holds One
Eigenvalue)
Let with , and suppose is disjoint from
for every
.
- (a) contains exactly
one eigenvalue of , and it is
algebraically simple.
- (b) If is
real, that eigenvalue is real, and it
lies in the interval .
Proof.
(a) Take . Then is disjoint
from the union of
the other discs, because it is disjoint from each of
them. By Theorem 20.3.5, contains exactly
one eigenvalue counted with algebraic multiplicity, so
that eigenvalue has algebraic
multiplicity .
(b) Suppose . By Theorem 9.2.5, is also an eigenvalue of . The center is real, so , and
too. Then contains two
distinct eigenvalues, contradicting (a). So is real, and a
real number within of lies in the stated
interval.
Scaling (Proposition 20.1.3)
and counting work together. Scaling moves the radii
around without changing the eigenvalues, and a disc that
scaling manages to isolate then holds exactly one
eigenvalue.
Example
(Isolating a real eigenvalue by scaling)
Let Show that has exactly one
eigenvalue
with , and that it is real.
Solution. The unscaled discs do
not decide it. The row radii are , , , so the discs are
, and .
The first and the third meet at , since . So no disc
is isolated, and Theorem 20.3.5 does
not apply.
Scale. Take . By Proposition 20.1.3,
has the
same eigenvalues as , and its entry is : Its discs are ,
and . The first is disjoint from the
other two, because and .
Count. By Corollary 20.3.6,
applied to the real matrix , the disc
contains exactly one eigenvalue, it is simple
and real, and it lies in . The other two eigenvalues lie in
or , outside .
A check by hand. Expanding along the first
column, . Then
and , consistent with a real root in . (It is about
. The other two
roots are the non-real pair ,
approximately, so here Gershgorin has isolated the only
real eigenvalue.)
Quick check. A real matrix has
three pairwise disjoint Gershgorin discs. What can you
say about its eigenvalues, and is it diagonalizable?
Solution. By Corollary 20.3.6,
each disc contains exactly one eigenvalue, which is
real. The discs are disjoint, so the three eigenvalues
are distinct and real, and the matrix is diagonalizable
over by Corollary 9.4.2.
Warning. The count is for
the union, not for each disc in it. Take . Its discs are ,
and the single point . The union of the
first two is disjoint from the third, and it does
contain two eigenvalues, . But both lie in the second disc, and the
first disc contains none. Inside a cluster of
overlapping discs, the counting theorem says nothing
about the individual discs.
From
one-sided to matched
Elsner’s bound is one-sided. It says
that every eigenvalue of is near
some eigenvalue of , and it does not
forbid two eigenvalues of from crowding near the
same eigenvalue of while another
eigenvalue of is
left alone. The counting lemma turns it into a statement
about a numbering. The price is a
factor that grows with .
Theorem
20.3.7 (Elsner’s Matching Bound)
Let have eigenvalues and , and
put Then the can be numbered so
that for every .
Idea. Slide from to along a segment. By Theorem 20.3.3, every
matrix on the way has its eigenvalues in the discs of
radius about the
. Group
those discs into clusters that do not touch one another.
By Lemma 20.3.4 a
cluster built from of the holds exactly
eigenvalues of
, so we can pair
within clusters. A cluster of discs has diameter at
most , which
gives the factor .
Proof. The conclusion is symmetric
in and , and so is , so we may assume . For put .
Then
and . By Theorem 20.3.3
applied to and
, and since
the exponents and are non-negative,
every eigenvalue of lies within of some .
Clusters. Call indices and linked
if , and put two indices in
the same cluster if a chain of links
joins them. The clusters partition . For a
cluster let be the set of with for some , and let be the union of the
for the
other clusters . If and , then and are not linked, so for
within of and within of , Taking the minimum over the finitely many such
pairs, and
are at positive
distance; and if
is the only cluster, is empty, there is no
pair to check, and the requirement holds with any . Every
eigenvalue of every lies in .
Counting. At the eigenvalues are the . Those with
lie in
, and the others
lie in , hence
not in ; so
has exactly
eigenvalues in .
By Lemma 20.3.4, so does
. Each
lies in exactly
one , since the
are pairwise
disjoint and cover every eigenvalue. So we may number
the ’s so that,
for each cluster ,
those in
receive the indices in .
Distances. Let , with . Since , there is
with . A chain of links from to inside can be chosen without
repeating an index, so it has at most links, each of
length at most ,
and . Hence This proves the theorem.
The factor is not the best possible, and bounds with a
factor independent of are known; we will not
need them. What matters is the shape: a matching
distance of order , with no hypothesis on either matrix.
Sections 4 and 5 replace the exponent by , and the price is a
hypothesis on :
diagonalizable in Section 4, and normal in Section
5.
Exercises
A. Check your
understanding
Exercise
(A1)
- (a) State Theorem 20.3.2,
including both hypotheses on .
- (b) Which imported
fact of analysis does the proof of Theorem 20.3.2 use,
and at which step? Which one does Lemma 20.3.4
use?
- (c) True or false:
if , then every eigenvalue of lies within of an eigenvalue
of . Justify your
answer.
- (d) True or false:
if
and is disjoint from , then contains exactly
one eigenvalue. Justify your answer.
- (e) What is the
difference between the conclusions of Theorem 20.3.3 and Theorem 20.3.7?
Solution.
(a) See Theorem 20.3.2. The
polynomial must
be monic and of the same
degree
as .
(b) Compactness,
fact (A3), supplies a convergent subsequence of the
bounded root vectors 𝛎. The lemma
uses the intermediate value theorem, fact (A5), to show
that a locally constant integer-valued function on is
constant.
(c) False. Take
and
, so . By Example (The Jordan block meets Elsner’s bound)
with , the
eigenvalues of
are , at
distance
from the only eigenvalue of .
(d) False. In the
warning after Corollary 20.3.6,
is
disjoint from , yet contains neither
eigenvalue .
The counting theorem counts in the union.
(e) The first is
one-sided: every eigenvalue of is within of
some eigenvalue of , and several may be
near the same one. The second gives a
numbering pairing each with its own , within .
B. Practice
Exercise
(B1: Cauchy’s bound)
Let .
- (a) Use Lemma 20.3.1 to bound
the moduli of the roots of .
- (b) Find the roots
exactly, and compare.
Solution.
(a) Here , so every root has .
(b) , so the roots are and , of moduli and . The bound is true but crude,
because the constant term dominates .
Exercise
(B2: Counting with discs)
Let
- (a) Show that has exactly one
eigenvalue with , and that it is real.
- (b) Explain why the
Gershgorin discs cannot decide whether the other two
eigenvalues are real.
- (c) Use the trace to
locate the sum of the other two eigenvalues in an
interval.
Solution.
(a) The row radii
are , , , so the discs are
, and .
The first is disjoint from the other two, since and
. By Corollary 20.3.6, it
contains exactly one eigenvalue, which is simple, real,
and in .
(b) The other two
eigenvalues lie in , a union of two overlapping discs that
contains both real and non-real points. The counting
theorem only says that this union holds two eigenvalues.
A conjugate pair and two real numbers are both
consistent with that. (In fact they are the non-real
pair , approximately.)
(c) By Corollary 12.1.4,
. Since ,
the sum is real and lies in
.
C. Going deeper
Exercise
(C1: Stability is an open condition)
- (a) Let be monic of degree
with every root
in the open disc . Prove that there is such that
every monic of
degree whose
coefficients are within of those of also has every root in
.
- (b) Deduce that the
set of with is
open: for each such there is with whenever
.
Solution.
(a) Let be
the roots of and
put , which is positive
since there are finitely many roots, each of modulus
less than . Let
be given by
Theorem 20.3.2 for
this .
If is within
, number its
roots so that . Then for every .
(b) Let , so every
root of lies
in (Definition 16.4.1). Take
from (a) for
. The
coefficients of are polynomials in
the entries of ,
as noted after Lemma 16.7.1, so that lemma
gives
such that makes every coefficient of within of the
corresponding coefficient of . For such , (a) puts every
eigenvalue of in
the open unit disc, and because
there are finitely many of them.
Exercise
(C2: Why one-sided bounds do not give a matching)
For lists and of
complex numbers and , say that the list of ’s is -close to the
list of ’s
if every is
within of some
.
- (a) Let . Prove that if each
list is -close to
the other, then the can be numbered so
that for .
- (b) Show that (a)
fails for :
give two lists of length , each -close to the other,
such that every numbering has .
- (c) Explain why the
proof of Theorem 20.3.7 needs
Lemma 20.3.4, and
cannot simply apply Theorem 20.3.3 twice,
once in each direction.
Solution.
(a) By
hypothesis, is within of some ; number the ’s so that this one is
, so . The other one, , is within of or of . If of , we are done.
If not, then and . Now is within of some , and not of , so . Renumber by swapping and . Then and .
(b) Take and . Every entry of each list occurs in the
other, so each is -close to the other. But
the ’s contain
twice and the
’s only
once, so every numbering pairs some with some , and .
(c) Applying Theorem 20.3.3 to
and to
gives
exactly the two-sided closeness of (a) with , since is symmetric in and . By (b), two-sided
closeness does not produce a numbering once , because it
ignores multiplicities. The counting lemma supplies the
missing information: each cluster of discs holds as many
eigenvalues of ,
counted with multiplicity, as it holds eigenvalues of
.
Exercise
(C3: Sharpening Cauchy’s bound by rescaling)
Let , let
be monic, and
let .
- (a) Prove that is monic of degree , with coefficients
, and
that is a root of
if and only if
is a root of
. Hence deduce
that every root
of satisfies
- (b) Apply (a) with
to , and compare the bound with the one Lemma 20.3.1 gives
directly and with the roots found in Exercise (B1: Cauchy’s bound).
Solution.
(a) Substituting
and dividing
by ,
which is monic of degree with the stated
coefficients. Since , the identity shows
that if
and only if . Now let be a root of . Then is a root of , so by Lemma 20.3.1 applied
to , whose
coefficient maximum is , we get . Multiplying by gives the
bound.
(b) For the coefficients of
are , and , so and every root of
has . Applied to itself, Lemma 20.3.1 gives
only , as in Exercise (B1: Cauchy’s bound)
(a). The true moduli are and , so the rescaled bound
is closer, and the trade-off is visible in the formula:
enlarging shrinks
every but multiplies the whole
bound by .