20.3  Continuity of Roots

Chapter 16 §07 proved that the eigenvalues of a matrix move continuously with the matrix, but only after quoting a theorem it did not prove: the roots of a monic polynomial move continuously with its coefficients (Theorem 16.7.3). This section proves that theorem, with nothing more than the compactness of closed bounded sets. It then asks two quantitative questions the qualitative theorem cannot answer. How far can an eigenvalue move when the matrix moves by a given amount, with no hypothesis on the matrix at all? And how many eigenvalues does a region of the plane hold? The second question finishes the story of Gershgorin’s discs begun in Section 1: an isolated disc holds exactly one eigenvalue.

Throughout, matrices are complex and eigenvalues are listed with algebraic multiplicity, so that A∈Mn(C) has exactly n of them (Corollary 6.5.5). Two imported facts of analysis are used, and each is named where it acts: compactness, fact (A3) of Chapter 16’s introduction, and the intermediate value theorem, fact (A5).

20.3.1. A bound for the roots

The proof of continuity will take a sequence of polynomials and follow their roots. For that to work, the roots must not escape to infinity, and the first step is a bound on the roots in terms of the coefficients.

Lemma 20.3.1 (Cauchy’s Bound for the Roots)

Let n≥1 and let p(x)=xn+cn−1xn−1+⋯+c1x+c0∈C[x] be monic. Put M=max0≤j≤n−1|cj|. Then every root z∈C of p satisfies |z|≤1+M.

Idea. A root satisfies zn=−(cn−1zn−1+⋯+c0). If |z| is large, the left side is much bigger than every single term on the right, and there are only n terms; summing the geometric series on the right makes this precise.

Proof. If |z|≤1 there is nothing to prove, so suppose |z|>1. Since p(z)=0, we have zn=−∑j=0n−1cjzj, and the triangle inequality (Theorem 0.6.4) gives |z|n≤M∑j=0n−1|z|j=M|z|n−1|z|−1≤M|z|n|z|−1, where the equality sums a geometric series with ratio |z|≠1. Dividing by |z|n>0 and multiplying by |z|−1>0 gives |z|−1≤M, as claimed.

The bound depends only on the size of the coefficients, and that is what the next proof needs. Polynomials whose coefficients stay bounded have roots that stay bounded.

Quick check. Show that the 1 in the bound cannot be dropped: find a monic polynomial with a root of modulus larger than M=maxj|cj|.

Solution. Take p(x)=x2−x−1, with M=1. Its roots are (1±5)/2, and (1+5)/2≈1.618>1. The bound 1+M=2 does hold.

20.3.2. The roots move continuously

Here is the theorem of Chapter 16 (Theorem 16.7.3), restated in full under its own label, since from now on it is a proved result.

Theorem 20.3.2 (Continuous Dependence of the Roots on the Coefficients)

Let n≥1 and let p(x)=xn+cn−1xn−1+⋯+c1x+c0∈C[x] be monic, with roots μ1,…,μn∈C listed with multiplicity. Let ε>0. Then there is δ>0 with the following property. If q(x)=xn+bn−1xn−1+⋯+b1x+b0 is monic of the same degree n and |bj−cj|<δ for every j, then the roots ν1,…,νn of q, listed with multiplicity, can be numbered so that |νi−μi|<ε for i=1,…,n.

Idea. The hard direction, from coefficients to roots, has no formula. The easy direction does: expanding (x−ν1)⋯(x−νn) writes each coefficient as a polynomial in the roots. So argue by contradiction and let compactness supply the missing formula.

① A bad sequence qk→p has root vectors that stay bounded, by Cauchy’s bound. ② By compactness, a subsequence of root vectors converges to some ν∈Cn. ③ Coefficients are polynomials in roots, so (x−ν1)⋯(x−νn) has the limiting coefficients, which are those of p. ④ Unique factorization says ν is a rearrangement of (μ1,…,μn). ⑤ That rearrangement is a good numbering for the late qk, which were supposed to have none.

Proof. Suppose the conclusion fails for some ε>0. Then no δ works; in particular δ=1/k fails for every integer k≥1. So there is a monic qk(x)=xn+∑j<nbj(k)xj with |bj(k)−cj|<1/k for every j, whose roots admit no numbering within ε of μ1,…,μn. By Corollary 6.5.5 (a), qk=(x−ν1(k))⋯(x−νn(k)) for some ν(k)=(ν1(k),…,νn(k))∈Cn, which lists the roots of qk with multiplicity.

The root vectors are bounded. Put M=maxj|cj|. Then |bj(k)|<M+1, so by Lemma 20.3.1 every |νi(k)|≤M+2, and ‖ν(k)‖2≤n(M+2). By compactness, fact (A3), the sequence (ν(k)) has a subsequence (ν(kl))l≥1 converging in Cn to some ν=(ν1,…,νn). Since |νi(kl)−νi|≤‖ν(kl)−ν‖2, each coordinate converges: νi(kl)→νi.

The limit is a root vector of p. Expanding the product (x−z1)⋯(x−zn) gives xn+∑j<nsj(z1,…,zn)xj, where each sj is a fixed polynomial with integer coefficients in z1,…,zn (it is ± the sum of all products of n−j of the zi with distinct indices). Hence bj(k)=sj(ν(k)). Along the subsequence, the algebra of limits gives sj(ν(kl))→sj(ν), while bj(kl)→cj by the choice of qk. Limits are unique, so sj(ν)=cj for every j, that is, (x−ν1)(x−ν2)⋯(x−νn)=p(x)=(x−μ1)(x−μ2)⋯(x−μn). Each factor x−a is monic of degree 1, hence irreducible, so both sides are factorizations of p into monic irreducibles. By the uniqueness in Theorem 6.3.5 (b), there is a permutation π of {1,…,n} with νπ(i)=μi for every i.

The contradiction. For each i, νπ(i)(kl)→νπ(i)=μi, so there is Li with |νπ(i)(kl)−μi|<ε for all l≥Li. Take l≥maxiLi. Then the list νπ(1)(kl),…,νπ(n)(kl) is a numbering of the roots of qkl, with multiplicity, within ε of μ1,…,μn. This contradicts the choice of qkl, and proves the theorem.

Chapter 16 quoted this statement as Theorem 16.7.3 and left its proof to this section. The proof needed nothing beyond compactness and unique factorization, and Corollary 16.7.4, with everything Chapter 16 built on it, now rests on a proved theorem.

Each hypothesis of the theorem did a job in the proof. Monic of the same degree gave both the bound on the roots and the factorization of qk with exactly n linear factors. Numbered so that is where the permutation π went. It was produced by unique factorization and depends on the subsequence, which is exactly the freedom that Proposition 16.7.2 says cannot be removed.

Remark. The proof is an instance of a move worth naming: compactness plus uniqueness. To show that x depends continuously on y when only the inverse relation y=F(x) is explicit, take a sequence, extract a convergent subsequence by compactness, and use the uniqueness of the solution of y=F(x) to identify its limit. Here F sends a root vector to the coefficients, and “unique” means unique up to order.

20.3.3. How far: Elsner’s bound

The theorem says that a small enough perturbation moves the roots a little, and it gives no rate. Chapter 16’s example Example (A Jordan block’s eigenvalues move like ε1/k) showed that no bound of the form L‖E‖ can hold. What does hold, for every matrix, is a bound by the n-th root of ‖E‖. The proof bounds one determinant in two ways: from below by the eigenvalues, and from above by Hadamard’s inequality.

Theorem 20.3.3 (Elsner’s Spectral Variation Bound)

Let A,B∈Mn(C), and let λ1,…,λn be the eigenvalues of A. Then every eigenvalue μ of B satisfies min1≤i≤n|λi−μ|≤(‖A‖2+‖B‖2)1−1/n‖A−B‖21/n. (For n=1 the first factor is 1.)

Idea. The quantity ∏i|λi−μ| is |det(A−μI)|, and it is at least the n-th power of the smallest factor. Bound the determinant above by Hadamard’s inequality, after rotating to an orthonormal basis whose first vector is an eigenvector x of B. The first column is then (A−μI)x=(A−B)x, which is small. The other n−1 columns are merely bounded. So one small factor meets n−1 bounded ones, and taking n-th roots produces the exponent 1/n.

Proof. Let x be an eigenvector of B for μ with ‖x‖2=1. By Corollary 11.2.3, extend (x) to an orthonormal basis (u1,…,un) of Cn with u1=x, and let U be the unitary matrix with these columns. Then U∗U=I, so |detU|2=detU∗detU=1 by Theorem 7.5.4 and Theorem 7.4.5.

By Corollary 12.1.5 applied to A−μI, whose eigenvalues are the λi−μ, listed with the same multiplicities (Theorem 9.10.1, with q(x)=x−μ), and by Theorem 7.5.4, ∏i=1n|λi−μ|=|det(A−μI)|=|det((A−μI)U)|. The j-th column of (A−μI)U is (A−μI)uj. Hadamard’s inequality Theorem 13.6.4 (b) bounds the determinant by the product of the column lengths.

For j=1, (A−μI)x=Ax−Bx=(A−B)x, so ‖(A−μI)u1‖2≤‖A−B‖2 by Theorem 16.3.2 (a). For j≥2, the triangle inequality (Corollary 11.1.6) gives ‖(A−μI)uj‖2≤‖A‖2+|μ|, and |μ|≤ρ(B)≤‖B‖2 by Theorem 16.4.1. Writing δ=mini|λi−μ|, each factor on the left is at least δ, so δn≤∏i=1n|λi−μ|≤‖A−B‖2(‖A‖2+‖B‖2)n−1. Taking non-negative n-th roots, which preserves inequalities between non-negative reals, gives the claim.

The bound needs no hypothesis on A: no diagonalizability, no normality. It is a Hölder modulus of continuity with exponent 1/n. The next example shows that the exponent cannot be improved, and that is the quantitative form of the instability that Chapter 10 §03 warned about.

Example (The Jordan block meets Elsner’s bound)

Let n≥2 and 0<ε≤1, and put A=Jn(0) and B=Jn(0)+εene1⊤. Compare the movement of the eigenvalues with Elsner’s bound, and show that no bound of the form C(‖A‖2+‖B‖2)1−α‖A−B‖2α with α>1/n can hold for all A,B∈Mn(C).

Solution. The eigenvalues. The matrix B is the one of Example (A Jordan block’s eigenvalues move like ε1/k) with k=n, where pB(x)=xn−ε was computed. So the eigenvalues of B are the n complex n-th roots of ε, each of modulus ε1/n, while A has the single eigenvalue 0. Every eigenvalue has moved exactly ε1/n.

The norms. A−B=−εene1⊤ has the single non-zero entry −ε, so ‖A−B‖2=ε (Theorem 16.3.3 (c)). Next, Be1=εen and Bej=ej−1 for j≥2, so for x=(x1,…,xn) ‖Bx‖22=ε2|x1|2+∑j=2n|xj|2≤‖x‖22, with equality at x=e2. Hence ‖B‖2=1, and the same computation with ε=0 gives ‖A‖2=1.

The comparison. Elsner’s bound is 21−1/nε1/n, and the actual movement is ε1/n. The bound is attained up to a factor 21−1/n<2.

The exponent is optimal. If a bound C21−αεα held for these pairs with α>1/n, then ε1/n≤C21−αεα, that is, ε1/n−α≤21−αC, for every ε∈(0,1]. But 1/n−α<0, so the left side tends to ∞ as ε→0+. No such C exists.

Put numbers on it. For n=16 and ε=10−16, a change in the sixteenth decimal place of one entry, the eigenvalues of J16(0) move to the circle of radius (10−16)1/16=10−1. This pays the debt of Chapter 10 §03, whose warning said that the Jordan form is not stable under small changes of the matrix and that Chapter 20 returns to this point. Elsner’s theorem says how unstable the eigenvalues can be: never worse than ‖E‖1/n. The Jordan block says that this worst case happens. Arithmetic that keeps about sixteen significant digits commits errors of about this relative size at every step. So what such a computation returns are, at best, the eigenvalues of some matrix within about 10−16 of J16(0), and these may be spread around a circle of radius 0.1. The computation cannot tell a nilpotent Jordan block from a diagonalizable matrix with sixteen distinct eigenvalues. This is the numerical reason the Jordan form is not computed in floating-point arithmetic.

20.3.4. Counting eigenvalues in a region

Section 1 showed that every eigenvalue lies in the union of the Gershgorin discs (Theorem 20.1.1), and left open how many lie in each part of that union. The tool for counting is a principle in the spirit of one the proof of Proposition 16.7.2 already used: an integer-valued function that varies continuously cannot change. We apply it to the number of eigenvalues in a region, while the matrix moves along a segment.

Lemma 20.3.4 (Eigenvalue Counts Are Constant Along a Path)

Let A0,A1∈Mn(C), and put A(t)=(1−t)A0+tA1 for t∈[0,1]. Let K,L⊆C be sets at positive distance: there is d>0 with |z−w|≥d for all z∈K and w∈L. Suppose that for every t∈[0,1], every eigenvalue of A(t) lies in K∪L. Then the number N(t) of eigenvalues of A(t) in K, counted with algebraic multiplicity, does not depend on t. In particular N(0)=N(1).

Idea. The eigenvalues cannot jump across the gap between K and L, because they move continuously and are never allowed inside the gap. So near each t0 the count is unchanged, and a function that is locally constant on an interval is constant. The last step is the intermediate value theorem: a continuous function with integer values cannot pass from one integer to another without taking the values in between.

Proof. Fix t0∈[0,1]. By Corollary 16.7.4, applied to A(t0) with the tolerance d and the norm ‖⋅‖2, there is δ>0 such that every B with ‖B−A(t0)‖2<δ has its eigenvalues μi numbered so that |μi−λi|<d, where λ1,…,λn are the eigenvalues of A(t0). Now A(t)−A(t0)=(t−t0)(A1−A0), so ‖A(t)−A(t0)‖2<δ whenever |t−t0|‖A1−A0‖2<δ, which holds for all t close enough to t0.

For such t, number the eigenvalues μi of A(t) in this way. Both λi and μi lie in K∪L, and a point of K is at distance at least d from every point of L. Since |μi−λi|<d, the two lie in the same one of the two sets: μi∈K if and only if λi∈K. Counting indices, N(t)=N(t0).

So N is constant on a neighborhood of each point of [0,1]. In particular N is continuous: if tk→t0, then N(tk)=N(t0) for all large k. Suppose N(s)≠N(0) for some s∈(0,1], say N(s)>N(0); the other case is symmetric. By the intermediate value theorem, fact (A5), applied to N on [0,s], there is t with N(t)=N(0)+12, which is not an integer. This contradiction shows N(s)=N(0) for every s∈[0,1], and proves the lemma.

Now the counting theorem. The trick is to shrink the off-diagonal part of A to zero. At the start of the path the matrix is diagonal and its eigenvalues are the disc centers, which we can count by looking.

Theorem 20.3.5 (Gershgorin’s Counting Theorem)

Let A∈Mn(C), let S⊆{1,…,n} have k elements with 1≤k≤n−1, and put U=⋃i∈SDi(A),V=⋃i∉SDi(A). If U∩V=∅, then U contains exactly k eigenvalues of A and V contains exactly n−k, counted with algebraic multiplicity.

Idea. Let D=diag(a11,…,ann) and slide from D to A along A(t)=(1−t)D+tA. The discs of A(t) have the same centers and radii tri(A), so they grow from points into the discs of A and never leave U∪V. By Theorem 20.1.1 the eigenvalues never leave either, and Lemma 20.3.4 carries the count from t=0, where it is k, to t=1.

Proof. The two unions are at positive distance. Let i∈S and j∉S. The discs Di(A) and Dj(A) are disjoint, so |aii−ajj|>ri(A)+rj(A); otherwise the point on the segment from aii to ajj at distance min{ri(A),|aii−ajj|} from aii would lie in both. For z∈Di(A) and w∈Dj(A), the triangle inequality (Theorem 0.6.4) gives |z−w|≥|aii−ajj|−ri(A)−rj(A)>0. Call the middle quantity dij. The minimum d of the finitely many dij is positive, and every point of U is at distance at least d from every point of V.

The path. Let D=diag(a11,…,ann) and A(t)=(1−t)D+tA for t∈[0,1]. The diagonal entries of A(t) are the aii, and its off-diagonal entries are taij, so ri(A(t))=tri(A)≤ri(A) and Di(A(t))⊆Di(A). By Theorem 20.1.1 applied to A(t), every eigenvalue of A(t) lies in ⋃iDi(A(t))⊆U∪V. By Lemma 20.3.4 with K=U and L=V, the number of eigenvalues of A(t) in U is the same at t=0 and at t=1.

The count at t=0. A(0)=D is diagonal, so pD(x)=∏i(x−aii) by Theorem 7.4.6, and its eigenvalue list is a11,…,ann. For i∈S, aii is the center of Di(A), so aii∈U. For i∉S, aii∈V, hence aii∉U. So exactly k entries of the list lie in U.

Therefore A(1)=A has exactly k eigenvalues in U. All n eigenvalues lie in U∪V, and U∩V=∅, so the other n−k lie in V. This proves the theorem.

The case k=1 is the one used most, and for a real matrix it says something about reality as well.

Corollary 20.3.6 (An Isolated Disc Holds One Eigenvalue)

Let A∈Mn(C) with n≥2, and suppose Di(A) is disjoint from Dj(A) for every j≠i.

  • (a) Di(A) contains exactly one eigenvalue of A, and it is algebraically simple.
  • (b) If A is real, that eigenvalue is real, and it lies in the interval [aii−ri(A),aii+ri(A)].

Proof.

  • (a) Take S={i}. Then U=Di(A) is disjoint from the union V of the other discs, because it is disjoint from each of them. By Theorem 20.3.5, Di(A) contains exactly one eigenvalue counted with algebraic multiplicity, so that eigenvalue λ has algebraic multiplicity 1.

  • (b) Suppose λ∉R. By Theorem 9.2.5, λ―≠λ is also an eigenvalue of A. The center aii is real, so |λ―−aii|=|λ−aii―|=|λ−aii|≤ri(A), and λ―∈Di(A) too. Then Di(A) contains two distinct eigenvalues, contradicting (a). So λ is real, and a real number within ri(A) of aii lies in the stated interval.

Scaling (Proposition 20.1.3) and counting work together. Scaling moves the radii around without changing the eigenvalues, and a disc that scaling manages to isolate then holds exactly one eigenvalue.

Example (Isolating a real eigenvalue by scaling)

Let A=(73−10−1−3111). Show that A has exactly one eigenvalue λ with |λ−7|≤2, and that it is real.

Solution. The unscaled discs do not decide it. The row radii are r1=4, r2=3, r3=2, so the discs are |z−7|≤4, |z+1|≤3 and |z−1|≤2. The first and the third meet at z=3, since 7−1=4+2. So no disc is isolated, and Theorem 20.3.5 does not apply.

Scale. Take D=diag(2,1,1). By Proposition 20.1.3, D−1AD has the same eigenvalues as A, and its (i,j) entry is aijdj/di: D−1AD=(73/2−1/20−1−3211). Its discs are |z−7|≤2, |z+1|≤3 and |z−1|≤3. The first is disjoint from the other two, because 7−(−1)=8>2+3 and 7−1=6>2+3.

Count. By Corollary 20.3.6, applied to the real matrix D−1AD, the disc |z−7|≤2 contains exactly one eigenvalue, it is simple and real, and it lies in [5,9]. The other two eigenvalues lie in |z+1|≤3 or |z−1|≤3, outside [5,9].

A check by hand. Expanding along the first column, pA(x)=x3−7x2+3x−4. Then pA(5)=−39<0 and pA(9)=185>0, consistent with a real root in (5,9). (It is about 6.64. The other two roots are the non-real pair 0.18±0.75i, approximately, so here Gershgorin has isolated the only real eigenvalue.)

Quick check. A real 3×3 matrix has three pairwise disjoint Gershgorin discs. What can you say about its eigenvalues, and is it diagonalizable?

Solution. By Corollary 20.3.6, each disc contains exactly one eigenvalue, which is real. The discs are disjoint, so the three eigenvalues are distinct and real, and the matrix is diagonalizable over R by Corollary 9.4.2.

Warning. The count is for the union, not for each disc in it. Take A=(0104000010). Its discs are |z|≤1, |z|≤4 and the single point {10}. The union of the first two is disjoint from the third, and it does contain two eigenvalues, ±2. But both lie in the second disc, and the first disc contains none. Inside a cluster of overlapping discs, the counting theorem says nothing about the individual discs.

20.3.5. From one-sided to matched

Elsner’s bound is one-sided. It says that every eigenvalue of B is near some eigenvalue of A, and it does not forbid two eigenvalues of B from crowding near the same eigenvalue of A while another eigenvalue of A is left alone. The counting lemma turns it into a statement about a numbering. The price is a factor that grows with n.

Theorem 20.3.7 (Elsner’s Matching Bound)

Let A,B∈Mn(C) have eigenvalues λ1,…,λn and μ1,…,μn, and put R=(‖A‖2+‖B‖2)1−1/n‖A−B‖21/n. Then the μi can be numbered so that |λi−μi|≤(2n−1)R for every i.

Idea. Slide from A to B along a segment. By Theorem 20.3.3, every matrix on the way has its eigenvalues in the discs of radius R about the λi. Group those discs into clusters that do not touch one another. By Lemma 20.3.4 a cluster built from m of the λi holds exactly m eigenvalues of B, so we can pair within clusters. A cluster of m discs has diameter at most 2mR, which gives the factor 2n−1.

Proof. The conclusion is symmetric in A and B, and so is R, so we may assume ‖A‖2≤‖B‖2. For t∈[0,1] put A(t)=(1−t)A+tB. Then ‖A(t)‖2≤(1−t)‖A‖2+t‖B‖2≤‖B‖2 and ‖A−A(t)‖2=t‖A−B‖2≤‖A−B‖2. By Theorem 20.3.3 applied to A and A(t), and since the exponents 1−1/n and 1/n are non-negative, every eigenvalue of A(t) lies within R of some λi.

Clusters. Call indices i and j linked if |λi−λj|≤2R, and put two indices in the same cluster if a chain of links joins them. The clusters partition {1,…,n}. For a cluster C let KC be the set of z with |z−λi|≤R for some i∈C, and let LC be the union of the KC′ for the other clusters C′. If i∈C and j∉C, then i and j are not linked, so for z within R of λi and w within R of λj, |z−w|≥|λi−λj|−2R>0. Taking the minimum over the finitely many such pairs, KC and LC are at positive distance; and if C is the only cluster, LC is empty, there is no pair to check, and the requirement holds with any d>0. Every eigenvalue of every A(t) lies in KC∪LC.

Counting. At t=0 the eigenvalues are the λj. Those with j∈C lie in KC, and the others lie in LC, hence not in KC; so A(0) has exactly |C| eigenvalues in KC. By Lemma 20.3.4, so does A(1)=B. Each μ lies in exactly one KC, since the KC are pairwise disjoint and cover every eigenvalue. So we may number the μ’s so that, for each cluster C, those in KC receive the indices in C.

Distances. Let i∈C, with m=|C|. Since μi∈KC, there is j∈C with |μi−λj|≤R. A chain of links from j to i inside C can be chosen without repeating an index, so it has at most m−1 links, each of length at most 2R, and |λj−λi|≤2(m−1)R. Hence |μi−λi|≤R+2(m−1)R=(2m−1)R≤(2n−1)R. This proves the theorem.

The factor 2n−1 is not the best possible, and bounds with a factor independent of n are known; we will not need them. What matters is the shape: a matching distance of order ‖A−B‖1/n, with no hypothesis on either matrix. Sections 4 and 5 replace the exponent 1/n by 1, and the price is a hypothesis on A: diagonalizable in Section 4, and normal in Section 5.

20.3.6. Exercises

A. Check your understanding

Exercise (A1)
  • (a) State Theorem 20.3.2, including both hypotheses on q.
  • (b) Which imported fact of analysis does the proof of Theorem 20.3.2 use, and at which step? Which one does Lemma 20.3.4 use?
  • (c) True or false: if ‖B−A‖2≤10−8, then every eigenvalue of B lies within 10−8 of an eigenvalue of A. Justify your answer.
  • (d) True or false: if A∈M3(C) and D1(A)∪D2(A) is disjoint from D3(A), then D1(A) contains exactly one eigenvalue. Justify your answer.
  • (e) What is the difference between the conclusions of Theorem 20.3.3 and Theorem 20.3.7?

Solution.

  • (a) See Theorem 20.3.2. The polynomial q must be monic and of the same degree n as p.

  • (b) Compactness, fact (A3), supplies a convergent subsequence of the bounded root vectors ν(k). The lemma uses the intermediate value theorem, fact (A5), to show that a locally constant integer-valued function on [0,1] is constant.

  • (c) False. Take A=J2(0) and B=J2(0)+10−8e2e1⊤, so ‖B−A‖2=10−8. By Example (The Jordan block meets Elsner’s bound) with n=2, the eigenvalues of B are ±10−4, at distance 10−4 from the only eigenvalue 0 of A.

  • (d) False. In the warning after Corollary 20.3.6, D1∪D2 is disjoint from D3={10}, yet D1={|z|≤1} contains neither eigenvalue ±2. The counting theorem counts in the union.

  • (e) The first is one-sided: every eigenvalue of B is within R of some eigenvalue of A, and several may be near the same one. The second gives a numbering pairing each μi with its own λi, within (2n−1)R.

B. Practice

Exercise (B1: Cauchy’s bound)

Let p(x)=x3−3x2+4x−12.

  • (a) Use Lemma 20.3.1 to bound the moduli of the roots of p.
  • (b) Find the roots exactly, and compare.

Solution.

  • (a) Here M=max{3,4,12}=12, so every root has |z|≤13.

  • (b) p(x)=x2(x−3)+4(x−3)=(x−3)(x2+4), so the roots are 3 and ±2i, of moduli 3 and 2. The bound 13 is true but crude, because the constant term 12 dominates M.

Exercise (B2: Counting with discs)

Let A=(101−11220−21).

  • (a) Show that A has exactly one eigenvalue λ1 with |λ1−10|≤2, and that it is real.
  • (b) Explain why the Gershgorin discs cannot decide whether the other two eigenvalues are real.
  • (c) Use the trace to locate the sum of the other two eigenvalues in an interval.

Solution.

  • (a) The row radii are r1=2, r2=3, r3=2, so the discs are |z−10|≤2, |z−2|≤3 and |z−1|≤2. The first is disjoint from the other two, since 10−2=8>2+3 and 10−1=9>2+2. By Corollary 20.3.6, it contains exactly one eigenvalue, which is simple, real, and in [8,12].

  • (b) The other two eigenvalues lie in {|z−2|≤3}∪{|z−1|≤2}, a union of two overlapping discs that contains both real and non-real points. The counting theorem only says that this union holds two eigenvalues. A conjugate pair and two real numbers are both consistent with that. (In fact they are the non-real pair 1.43±1.99i, approximately.)

  • (c) By Corollary 12.1.4, λ1+λ2+λ3=trA=13. Since 8≤λ1≤12, the sum λ2+λ3=13−λ1 is real and lies in [1,5].

C. Going deeper

Exercise (C1: Stability is an open condition)
  • (a) Let p be monic of degree n with every root in the open disc {|z|<1}. Prove that there is δ>0 such that every monic q of degree n whose coefficients are within δ of those of p also has every root in {|z|<1}.
  • (b) Deduce that the set of A∈Mn(C) with ρ(A)<1 is open: for each such A there is η>0 with ρ(B)<1 whenever ‖B−A‖2<η.

Solution.

  • (a) Let μ1,…,μn be the roots of p and put ε=1−maxi|μi|, which is positive since there are finitely many roots, each of modulus less than 1. Let δ be given by Theorem 20.3.2 for this ε. If q is within δ, number its roots so that |νi−μi|<ε. Then |νi|<|μi|+ε≤1 for every i.

  • (b) Let ρ(A)<1, so every root of pA lies in {|z|<1} (Definition 16.4.1). Take δ from (a) for p=pA. The coefficients of pB are polynomials in the entries of B, as noted after Lemma 16.7.1, so that lemma gives η>0 such that ‖B−A‖2<η makes every coefficient of pB within δ of the corresponding coefficient of pA. For such B, (a) puts every eigenvalue of B in the open unit disc, and ρ(B)<1 because there are finitely many of them.

Exercise (C2: Why one-sided bounds do not give a matching)

For lists (λ1,…,λn) and (μ1,…,μn) of complex numbers and r≥0, say that the list of μ’s is r-close to the list of λ’s if every μj is within r of some λi.

  • (a) Let n=2. Prove that if each list is r-close to the other, then the μj can be numbered so that |λi−μi|≤r for i=1,2.
  • (b) Show that (a) fails for n=3: give two lists of length 3, each 0-close to the other, such that every numbering has maxi|λi−μi|=2.
  • (c) Explain why the proof of Theorem 20.3.7 needs Lemma 20.3.4, and cannot simply apply Theorem 20.3.3 twice, once in each direction.

Solution.

  • (a) By hypothesis, λ2 is within r of some μj; number the μ’s so that this one is μ2, so |λ2−μ2|≤r. The other one, μ1, is within r of λ1 or of λ2. If of λ1, we are done. If not, then |μ1−λ2|≤r and |μ1−λ1|>r. Now λ1 is within r of some μj, and not of μ1, so |λ1−μ2|≤r. Renumber by swapping μ1 and μ2. Then |λ1−μ1|≤r and |λ2−μ2|≤r.

  • (b) Take (λ1,λ2,λ3)=(0,2,2) and (μ1,μ2,μ3)=(0,0,2). Every entry of each list occurs in the other, so each is 0-close to the other. But the μ’s contain 0 twice and the λ’s only once, so every numbering pairs some μi=0 with some λi=2, and maxi|λi−μi|=2.

  • (c) Applying Theorem 20.3.3 to (A,B) and to (B,A) gives exactly the two-sided closeness of (a) with r=R, since R is symmetric in A and B. By (b), two-sided closeness does not produce a numbering once n≥3, because it ignores multiplicities. The counting lemma supplies the missing information: each cluster of discs holds as many eigenvalues of B, counted with multiplicity, as it holds eigenvalues of A.

Exercise (C3: Sharpening Cauchy’s bound by rescaling)

Let n≥1, let p(x)=xn+cn−1xn−1+⋯+c1x+c0∈C[x] be monic, and let s>0.

  • (a) Prove that q(y):=p(sy)/sn is monic of degree n, with coefficients cj/sn−j, and that z is a root of p if and only if z/s is a root of q. Hence deduce that every root z of p satisfies |z|≤s(1+max0≤j≤n−1|cj|sn−j).
  • (b) Apply (a) with s=3 to p(x)=x3−3x2+4x−12, and compare the bound with the one Lemma 20.3.1 gives directly and with the roots found in Exercise (B1: Cauchy’s bound).

Solution.

  • (a) Substituting x=sy and dividing by sn>0, q(y)=p(sy)sn=snyn+∑j<ncjsjyjsn=yn+∑j<ncjsn−jyj, which is monic of degree n with the stated coefficients. Since sn≠0, the identity q(z/s)=p(z)/sn shows that q(z/s)=0 if and only if p(z)=0. Now let z be a root of p. Then z/s is a root of q, so by Lemma 20.3.1 applied to q, whose coefficient maximum is Ms=maxj|cj|/sn−j, we get |z|/s=|z/s|≤1+Ms. Multiplying by s>0 gives the bound.

  • (b) For s=3 the coefficients of q are −3/3=−1, 4/9 and −12/27=−4/9, so M3=1 and every root of p has |z|≤3(1+1)=6. Applied to p itself, Lemma 20.3.1 gives only |z|≤13, as in Exercise (B1: Cauchy’s bound) (a). The true moduli are 3 and 2, so the rescaled bound is closer, and the trade-off is visible in the formula: enlarging s shrinks every |cj|/sn−j but multiplies the whole bound by s.

Found a typo or a mistake? Report it, or read this page’s source

The text of this book is licensed under CC BY-NC-SA 4.0.