11.10  Orthogonal Polynomials

Section 2 ran Gram–Schmidt on (1,x,x2) with ⟨p,q⟩=∫−11pq, and stopped at degree 2 only because the space did (Example (Gram–Schmidt on 1,x,x2)). Nothing in the process cared. Feed it (1,x,x2,x3,…) and it returns an infinite orthogonal sequence, one polynomial of each degree. Three things make such sequences worth a section. Each member is computable from the two before it. Each member of degree k has k distinct real roots inside the interval. And those roots are the best possible points at which to sample a function to estimate its integral. The first fact rests on one small identity; the other two rest on the first.

Throughout this section the field is R.

11.10.1. Two ways to make an inner product on polynomials

Both constructions we need appeared in Section 1.

From a weight. Fix an interval with endpoints −∞≤a<b≤∞ and a weight w: a function continuous and strictly positive on the open interval (a,b), with ∫ab|t|kw(t)dt finite for every k∈N. Define ⟨p,q⟩=∫abp(t)q(t)w(t)dt. Finiteness of the moments makes this a real number for all p,q∈R[x], and bilinearity and symmetry come from linearity of the integral. For positivity, let p≠0. Then p2w is continuous and ≥0 on (a,b), and >0 off the finitely many roots of p (Corollary 6.1.4), so ⟨p,p⟩>0. That last step is the one calculus fact this section leans on: a continuous non-negative function on an interval whose integral is 0 vanishes identically. As in Definition 11.1.1 it follows from the local fact that a continuous function non-zero at a point stays bounded away from 0 on a small interval around it, which then contributes a positive amount to the integral.

From nodes. Fix distinct c0<⋯<cn in R and put ⟨p,q⟩=∑i=0np(ci)q(ci). Section 1 checked that this is an inner product on R[x]≤n, positivity coming from the root bound. It is not one on R[x]: the polynomial (x−c0)⋯(x−cn) is non-zero and pairs with itself to give 0. So in the node case everything below stops at degree n.

The two constructions share one property, and it is the engine of the section.

Proposition 11.10.1 (Multiplication by x is symmetric)

Let ⟨⋅,⋅⟩ be an inner product on R[x] coming from a weight, or the node inner product on R[x]≤n. Then ⟨xp,q⟩=⟨p,xq⟩ for all polynomials p,q in the space (in the node case, for all p,q of degree at most n−1, so that xp and xq still lie in it).

Proof. In the weight case both sides equal ∫abtp(t)q(t)w(t)dt, and in the node case both sides equal ∑i=0ncip(ci)q(ci).

The proof is one line, but the statement is not a triviality: multiplication by x moves from one slot to the other for free. That is exactly the identity ⟨Tu,v⟩=⟨u,Tv⟩ defining a self-adjoint operator (Definition 11.6.2), and it is the reason the recurrence below has three terms instead of k+2.

Warning. Multiplication by x is not an operator on R[x]≤n. It raises degree, so it maps that space out of itself; on R[x] it is an operator, but there the space is infinite-dimensional, and Definition 11.6.2 was stated for a finite-dimensional one. “Self-adjoint” is here a name for Proposition 11.10.1, not a literal application of the definition. It is the identity, not the name, that the proofs use.

11.10.2. Orthogonal polynomial sequences

Applied to the independent list (1,x,x2,…), Gram–Schmidt never stalls. What comes out is one polynomial of each degree, pairwise orthogonal, and that combination deserves a name.

An orthogonal polynomial sequence is one polynomial of every degree, no two of them pairing to anything but zero.

Definition 11.10.1 (Orthogonal Polynomial Sequence)

Let ⟨⋅,⋅⟩ be an inner product on R[x], or on R[x]≤n. An orthogonal polynomial sequence for it is a sequence p0,p1,p2,… of polynomials (a finite list p0,…,pn in the second case) such that

  • (OP1) deg⁡pk=k for every index k;
  • (OP2) ⟨pj,pk⟩=0 whenever j≠k.

The sequence is monic if every pk has leading coefficient 1.

In words. (OP1) says one polynomial of each degree: no gaps, no repeats, no accidental drop in degree. (OP2) says the members are pairwise orthogonal. Together they say more than either alone, because by (OP1) the list (p0,…,pk−1) is a basis of R[x]≤k−1, so (OP2) upgrades to ⟨pk,q⟩=0for every q∈R[x]≤k−1, and that is the form in which the condition always gets used.

Two things need checking: that such a sequence exists, and that fixing the scale pins it down.

Proposition 11.10.2 (Existence and uniqueness of the monic sequence)

Let ⟨⋅,⋅⟩ be an inner product on R[x]. For each k∈N there is exactly one monic pk of degree k with ⟨pk,q⟩=0 for every q∈R[x]≤k−1. These pk form the unique monic orthogonal polynomial sequence, and (p0,…,pk) is an orthogonal basis of R[x]≤k for every k. The same holds on R[x]≤n for k≤n.

Idea. Existence is Gram–Schmidt, once we know the k-th output really has degree k; it does, because it lies in R[x]≤k but not in the span of its predecessors, which is R[x]≤k−1. Uniqueness is the standard move: two candidates differ by a polynomial of lower degree that is orthogonal to everything of lower degree, hence to itself.

Proof. Existence. The list (1,x,…,xk) is independent, so Theorem 11.2.2 applies and returns an orthonormal list (e0,…,ek) with span(e0,…,ej)=span(1,x,…,xj)=R[x]≤j for every j≤k. Fix j. Then ej∈R[x]≤j, and ej∉R[x]≤j−1=span(e0,…,ej−1), since an orthonormal list is independent (Theorem 11.1.4). Hence deg⁡ej=j exactly. Let aj≠0 be its leading coefficient and put pj=ej/aj, monic of degree j. For q∈R[x]≤j−1=span(e0,…,ej−1) we get ⟨pj,q⟩=0 by orthogonality of the list.

Uniqueness. Suppose p and p′ are both monic of degree k and orthogonal to every element of R[x]≤k−1. Their leading terms cancel, so p−p′∈R[x]≤k−1. Therefore ⟨p−p′,p−p′⟩=⟨p,p−p′⟩−⟨p′,p−p′⟩=0, and positive definiteness gives p=p′.

Finally, (p0,…,pk) is an orthogonal list of non-zero vectors, hence independent (Theorem 11.1.4), with k+1=dim⁡R[x]≤k members, hence a basis (Theorem 1.6.4).

Examples. For ⟨p,q⟩=∫−11pq the first three monic members are 1, x, x2−13 (Example (Gram–Schmidt on 1,x,x2)); these are the monic Legendre polynomials. For the node inner product with nodes −1,0,1 on R[x]≤2 we have ⟨1,1⟩=3, ⟨x,1⟩=0, ⟨x,x⟩=2, ⟨x2,1⟩=2, ⟨x2,x⟩=0, so p0=1, p1=x, p2=x2−23 — and there the sequence ends, since R[x]≤2 holds nothing of degree 3. The degenerate member is always p0=1, the only monic polynomial of degree 0, with an empty condition on it.

A non-example by minimal change. Replace the Legendre p2=x2−13 by p~2=x2+x−13. Still monic of degree 2, so (OP1) survives; but ⟨p~2,x⟩=⟨x,x⟩=23≠0, so (OP2) fails. Adding a multiple of a lower member is exactly the freedom orthogonality removes.

Why monic? Rescaling each pk by a non-zero λk gives another orthogonal polynomial sequence, so a normalization has to be chosen, and traditions differ: the classical Legendre polynomials Pk are fixed by Pk(1)=1, and Gram–Schmidt as run in Section 2 fixes ‖pk‖=1. Monic is the convenient choice here, because it is the one for which the recurrence below needs no extra factor.

Warning. The sequence belongs to the inner product, not to the polynomials. “The orthogonal polynomials” is meaningless without a weight and an interval. Exercise B2 of Section 2 (Exercise (B2: Gram–Schmidt on polynomials)) ran the same process with ∫01 instead of ∫−11 and got 1, x−12, x2−x+16: same degrees, different polynomials.

Quick check. For ⟨p,q⟩=∫−11pq, how many polynomials of degree 2 with ‖p‖=1 are orthogonal to R[x]≤1? Write them down.

Solution. Exactly two. If p has degree 2 and p⊥R[x]≤1, let λ≠0 be its leading coefficient; then p/λ is monic of degree 2 and still orthogonal to R[x]≤1, so p/λ=x2−13 by Proposition 11.10.2. Thus p=λ(x2−13), and ‖p‖=1 leaves λ=±1/‖x2−13‖. Since Example (Gram–Schmidt on 1,x,x2) computed ‖x2−13‖2=845, the two answers are ±104(3x2−1). Fixing the scale by the norm leaves a sign; fixing it by “monic” leaves nothing.

11.10.3. The three-term recurrence

Computing pn by Gram–Schmidt costs one inner product for every earlier member, so reaching degree n costs about n2/2 integrals. Almost all of them return 0. The next theorem says which ones do not, and reduces the cost to two integrals per step.

Theorem 11.10.3 (Three-Term Recurrence)

Let (pk) be the monic orthogonal polynomial sequence of Proposition 11.10.2, for an inner product satisfying Proposition 11.10.1. For a weight on an interval this covers every k; for the node inner product on n nodes, where Proposition 11.10.1 holds only up to degree n−1, read the statement for k+1≤n. Put p−1=0 and, for k≥0, ak=⟨xpk,pk⟩⟨pk,pk⟩,bk=⟨pk,pk⟩⟨pk−1,pk−1⟩  (k≥1). Then p0=1, p1=x−a0, and pk+1=(x−ak)pk−bkpk−1for every k≥1. Moreover bk>0 for every k≥1.

Idea. The polynomial xpk is monic of degree k+1, so it is pk+1 plus something of degree at most k, and that something expands in the orthogonal basis (p0,…,pk) with coefficients ⟨xpk,pj⟩/⟨pj,pj⟩ (Corollary 11.3.4). The point is that almost every coefficient is 0: move the x across with Proposition 11.10.1, and the coefficient becomes ⟨pk,xpj⟩, which vanishes as soon as deg⁡(xpj)=j+1 is still below k. Only j=k and j=k−1 can survive.

Proof. p0=1 is the unique monic polynomial of degree 0, and p1=x−a0 is the unique monic polynomial of degree 1 with ⟨p1,p0⟩=0, since ⟨x−a0,1⟩=⟨x,1⟩−a0⟨1,1⟩=0 exactly for a0=⟨x⋅1,1⟩/⟨1,1⟩.

Now fix k≥1. By Proposition 11.10.2, (p0,…,pk+1) is an orthogonal basis of R[x]≤k+1, and xpk lies in that space. By Corollary 11.3.4 applied inside R[x]≤k+1, xpk=∑j=0k+1cjpj,cj=⟨xpk,pj⟩⟨pj,pj⟩. Both xpk and pk+1 are monic of degree k+1, and every other term of the sum has degree at most k; comparing coefficients of xk+1 gives ck+1=1.

Let j≤k−2. By Proposition 11.10.1, ⟨xpk,pj⟩=⟨pk,xpj⟩, and deg⁡(xpj)=j+1≤k−1, so xpj∈R[x]≤k−1 and the pairing is 0 by Proposition 11.10.2. Hence cj=0 for every j≤k−2, and xpk=pk+1+ckpk+ck−1pk−1, which rearranges to pk+1=(x−ck)pk−ck−1pk−1.

It remains to identify the two coefficients. By definition ck=⟨xpk,pk⟩/⟨pk,pk⟩=ak. For the other, xpk−1 is monic of degree k, so xpk−1−pk has degree at most k−1 and therefore pairs to 0 with pk. Hence, using Proposition 11.10.1 again, ⟨xpk,pk−1⟩=⟨pk,xpk−1⟩=⟨pk,pk⟩, so ck−1=⟨pk,pk⟩/⟨pk−1,pk−1⟩=bk. Finally bk is a quotient of ‖pk‖2 by ‖pk−1‖2, both strictly positive because pk and pk−1 are non-zero, so bk>0.

Two inner products per step generate the whole sequence. The positivity of bk is not decoration either: it is the sign that drives the interlacing argument of Exercise (C1: Interlacing roots).

Remark. If the interval is symmetric, (a,b)=(−c,c), and the weight is even, w(−t)=w(t), then ak=0 for every k and pk(−x)=(−1)kpk(x). Induct on k: p0=1 is even, and a0=⟨x,1⟩/⟨1,1⟩=0 because tw(t) is odd, so p1=x is odd. If pk−1 and pk have parities (−1)k−1 and (−1)k, then tpk(t)2w(t) is odd, so ak=0, and pk+1=xpk−bkpk−1 is a combination of two polynomials of parity (−1)k+1.

Example (The monic Legendre polynomials, continued)

For ⟨p,q⟩=∫−11pq, Example (Gram–Schmidt on 1,x,x2) gave p0=1, p1=x, p2=x2−13, with ⟨p0,p0⟩=2, ⟨p1,p1⟩=23 and ⟨p2,p2⟩=845. Use Theorem 11.10.3 to obtain p3, and check the recurrence reproduces p2.

Solution. The weight w=1 is even on (−1,1), so every ak=0 by the remark above. Then b1=⟨p1,p1⟩⟨p0,p0⟩=2/32=13,b2=⟨p2,p2⟩⟨p1,p1⟩=8/452/3=415. The recurrence at k=1 gives p2=x⋅x−13⋅1=x2−13, which is what Gram–Schmidt produced. At k=2, p3=x(x2−13)−415x=x3−35x. Check. ⟨p3,1⟩=⟨p3,x2⟩=0 because the integrands are odd, and ⟨p3,x⟩=∫−11(t4−35t2)dt=25−35⋅23=0. So p3⊥R[x]≤2, as it should be. Two integrals produced a polynomial that Gram–Schmidt would have charged three for, and the saving grows with the degree.

11.10.4. Where the roots are

The roots of p2=x2−13 are ±1/3≈±0.577, and those of p3=x3−35x are 0 and ±3/5≈±0.775. All five lie inside (−1,1), where the weight lives. No coincidence. The argument first needs one fact about real polynomials, in which multr(f) is the multiplicity of r as a root of f (Definition 6.4.1).

Lemma 11.10.4 (Even multiplicities mean no sign change)

Let I⊆R be an open interval and let f∈R[x] be non-zero. If multr(f) is even for every r∈I, then f≥0 throughout I, or f≤0 throughout I.

Proof. By Theorem 6.4.3 over R, write f=(x−d1)m1⋯(x−dl)mlg, where d1,…,dl are the distinct real roots of f, mi=multdi(f), and g has no real root. Separate the factors according to whether di∈I: f=h⋅(∏di∈I(x−di)mi),h=g⋅∏di∉I(x−di)mi. Each mi with di∈I is even by hypothesis, so the second factor is the square of a real polynomial and is ≥0 everywhere. The polynomial h has no root in I: its roots are the di outside I, and g has none. Being continuous and nowhere zero on the interval I, h has constant sign there by the intermediate value theorem. Hence f has that same sign throughout I, weakly, with equality only at the di inside I.

Theorem 11.10.5 (Roots of an Orthogonal Polynomial)

Let w be a weight on (a,b), let ⟨p,q⟩=∫abpqw, and let (pk) be the monic orthogonal polynomial sequence. For every k≥1, the polynomial pk has k distinct real roots, and every one of them lies in the open interval (a,b).

Idea. Suppose pk changed sign at only a few points c1,…,cm of (a,b), with m<k. Build the polynomial q=(x−c1)⋯(x−cm). It is cheap — degree at most k−1 — so pk is orthogonal to it. But q was designed to change sign at exactly the points where pk does, so the product pkq changes sign nowhere, and a function of one sign that is not identically zero cannot integrate to zero against a positive weight. The contradiction forces m≥k, and k distinct roots is all a polynomial of degree k can hold.

Proof. Fix k≥1. Let c1<⋯<cm be the roots of pk in (a,b) whose multiplicity is odd (possibly m=0), and set q=(x−c1)⋯(x−cm), with q=1 when m=0.

Suppose, for contradiction, that m≤k−1. Then q∈R[x]≤k−1, so ⟨pk,q⟩=0 by Proposition 11.10.2.

Put f=pkq, a non-zero polynomial (Theorem 0.8.3). Let r∈(a,b) be a root of f. By Theorem 6.4.2, multr(f)=multr(pk)+multr(q). If r=ci for some i, then multr(q)=1 and multr(pk) is odd by the choice of the ci, so the sum is even. If r is none of the ci, then q(r)≠0, so multr(q)=0 and multr(pk) is even, again by the choice of the ci. Either way multr(f) is even.

By Lemma 11.10.4, f≥0 throughout (a,b) or f≤0 throughout (a,b); replacing q by −q if necessary, which changes neither ⟨pk,q⟩=0 nor deg⁡q, we may assume f≥0 there. Then fw is continuous and ≥0 on (a,b), and it is >0 off the finitely many roots of f, because w>0. By the calculus fact recalled when the inner product was set up — a continuous non-negative function with integral 0 vanishes identically — an integrand of that shape cannot integrate to 0. Therefore ⟨pk,q⟩=∫abf(t)w(t)dt>0, contradicting ⟨pk,q⟩=0.

Hence m≥k. Each ci is a root of pk, and pk is non-zero of degree k, so m≤k by Corollary 6.1.4; thus m=k and pk has k distinct roots c1,…,ck, all in (a,b). By Corollary 6.1.4 again, (x−c1)⋯(x−ck) divides pk, and both are monic of degree k, so pk=(x−c1)⋯(x−ck). In particular each root is simple and pk has no roots outside (a,b), real or complex. This proves the theorem.

So the weight hands us k points inside its interval, chosen by the inner product rather than by us. The next subsection says what they are good for.

Quick check. The monic Laguerre polynomial of degree 2 for the weight w(t)=e−t on (0,∞) is p2=x2−4x+2. Check that Theorem 11.10.5 is not lying.

Solution. The roots are 2±2, that is ≈0.586 and ≈3.414: real, distinct, and both in (0,∞). An unbounded interval is no obstacle, since the theorem asks only that the weight be positive with finite moments, and ∫0∞tke−tdt=k!.

11.10.5. Gaussian quadrature

Chapter 6 wrote ∫01p as a fixed combination of p(0), p(12) and p(1), valid for every p∈R[x]≤2 (Example (Integrals and Slopes from Values)). The construction works for any prescribed nodes: integrate the Lagrange interpolation formula (Theorem 6.6.1) and k distinct nodes give a rule exact on R[x]≤k−1.

But a k-point rule has 2k numbers at its disposal, k nodes and k coefficients, and only k of them were spent. Spending the nodes too should buy degree 2k−1. Where to put them is the question, and the answer is the one place we have not chosen: the roots of pk.

Theorem 11.10.6 (Gaussian Quadrature)

Let w be a weight on (a,b) with ⟨p,q⟩=∫abpqw, let k≥1, and let t1<⋯<tk be the roots of the monic orthogonal polynomial pk, which lie in (a,b) by Theorem 11.10.5. Let ℓ1,…,ℓk∈R[x]≤k−1 be the Lagrange polynomials for these nodes (Definition 6.6.1) and set αi=∫abℓi(t)w(t)dt(i=1,…,k). Then every αi is strictly positive, and ∫abf(t)w(t)dt=∑i=1kαif(ti) for every f∈R[x]≤2k−1.

Idea. Two moves, one for each side of the identity. On the left, divide f by pk: f=qpk+r. The degree bookkeeping — deg⁡f≤2k−1 against deg⁡pk=k — forces deg⁡q≤k−1, which is exactly the condition under which ∫qpkw=⟨pk,q⟩ vanishes. So the integral of f is the integral of its remainder. On the right, pk vanishes at every node, so the sum also only sees the remainder. And the remainder has degree at most k−1, which is precisely the range on which k nodes reproduce a polynomial exactly. The two sides meet there.

Proof. Let f∈R[x]≤2k−1. Since pk≠0, Theorem 6.1.1 gives q,r∈R[x] with f=qpk+r,deg⁡r<k. If q=0 then q∈R[x]≤k−1 trivially. Otherwise qpk=f−r has degree at most 2k−1, while deg⁡(qpk)=deg⁡q+k by Theorem 0.8.3; hence deg⁡q≤k−1. Either way q∈R[x]≤k−1, so Proposition 11.10.2 gives ⟨pk,q⟩=0, that is, ∫abqpkw=0. Therefore (∗)∫abfw=∫abqpkw+∫abrw=∫abrw. At each node, pk(ti)=0, so (∗∗)f(ti)=q(ti)pk(ti)+r(ti)=r(ti)(i=1,…,k). Since deg⁡r≤k−1 and t1,…,tk are k distinct points, Theorem 6.6.1 (b) gives r=∑ir(ti)ℓi. Integrating against w and using the definition of αi, ∫abrw=∑i=1kr(ti)αi=∑i=1kαif(ti), the last step by (∗∗). Combining with (∗) proves the quadrature identity.

For positivity, fix j and apply the identity to f=ℓj2, which is legitimate because deg⁡ℓj2=2k−2≤2k−1. By Theorem 6.6.1 (a), ℓj(ti)=δij, so the right-hand side collapses to αj, while the left-hand side is ⟨ℓj,ℓj⟩=‖ℓj‖2. Since ℓj≠0, positive definiteness gives αj=‖ℓj‖2>0.

Each hypothesis did one job. Orthogonality to lower degrees killed the quotient on the left; the nodes being roots of pk killed it again on the right. That is also why the nodes cannot be moved: shift one and the second cancellation fails. Exercise (C2: The ceiling is 2k − 1) shows 2k−1 is a ceiling, not just what this proof happens to reach.

Example (Two-point Gauss–Legendre)

Take w=1 on (−1,1) and k=2. Find the nodes and weights, and test the resulting rule on f=1+2x+3x2+4x3 and on f=x4.

Solution. The monic p2 is x2−13 (Example (Gram–Schmidt on 1,x,x2)), so the nodes are t1=−1/3 and t2=1/3. The Lagrange polynomials are ℓ1=(x−t2)/(t1−t2) and ℓ2=(x−t1)/(t2−t1), with t1−t2=−2/3. Since ∫−11tdt=0 and ∫−111dt=2, α1=0−2t2t1−t2=−2/3−2/3=1, and α2=1 by the same computation with the roles swapped. The rule is ∫−11f(t)dt=f(−13)+f(13)for f∈R[x]≤3. Two evaluations, no coefficients to remember, every cubic exactly.

The cubic test. Exactly, ∫−11(1+2t+3t2+4t3)dt=2+0+3⋅23+0=4. By the rule, f(−1/3)=2−1039 and f(1/3)=2+1039, whose sum is 4. The odd parts cancel and the constant and quadratic parts contribute 1+1 and 1+1.

The quartic test. Exactly, ∫−11t4dt=25. By the rule, (1/3)4+(1/3)4=29. These differ, so degree 4=2k is already out of reach. Compare Example (Integrals and Slopes from Values), where the nodes were fixed in advance and three of them guaranteed exactness only up to degree 2 — guaranteed by the construction, that is; that particular symmetric rule happens to integrate cubics exactly as well, which is luck of the symmetry and not something the construction promises.

Warning. “Exact” means exact on polynomials. Theorem 11.10.6 says nothing about ∫abfw for a general f, and nothing about what happens as k grows; on a non-polynomial the rule returns an approximation whose error is a question for analysis. What linear algebra delivers is exactness on a subspace, and the reason that subspace is the largest available.

11.10.6. The classical families

Four weights account for most of the orthogonal polynomials that occur in practice. The table records them; the entries are statements, and Exercise (B2: Two rows of the table) asks you to verify two of the rows by integration.

Family Interval Weight w(t) p1 p2
Legendre (−1,1) 1 x x2−13
Chebyshev (−1,1) (1−t2)−1/2 x x2−12
Hermite (−∞,∞) e−t2 x x2−12
Laguerre (0,∞) e−t x−1 x2−4x+2

The last two columns give the monic members of degrees 1 and 2; p0=1 in every row. The Chebyshev weight is unbounded at ±1 and the Hermite and Laguerre intervals are unbounded, so in those three rows the integrals defining the inner product are improper; they converge, which is the finiteness condition our definition of a weight demanded. The first three weights are even on symmetric intervals, so their ak all vanish and their members alternate in parity; the Laguerre weight is not, and a0=1 there. Section 9 of this chapter meets the Chebyshev family again from the Fourier side, where the substitution t=cos⁡θ turns its awkward weight into dθ.

11.10.7. Exercises

A. Check your understanding

Exercise (A1)
  • (a) Define what it means for p0,p1,p2,… to be a monic orthogonal polynomial sequence for an inner product on R[x].
  • (b) State the three-term recurrence, including the formulas for ak and bk and the starting values.
  • (c) True or false: bk>0 for every k≥1. Justify your answer.
  • (d) For ⟨p,q⟩=∫−11pq, how many roots does p7 have, of what kind, and where?
  • (e) True or false: for every inner product on R[x] one has ⟨xp,q⟩=⟨p,xq⟩. Justify your answer.
  • (f) How many nodes does a Gaussian rule need in order to integrate every polynomial of degree at most 11 exactly?

Solution.

  • (a) A sequence with deg⁡pk=k and leading coefficient 1 for every k, and ⟨pj,pk⟩=0 whenever j≠k (Definition 11.10.1).

  • (b) With p−1=0, p0=1 and p1=x−a0, one has pk+1=(x−ak)pk−bkpk−1 for k≥1, where ak=⟨xpk,pk⟩/⟨pk,pk⟩ and bk=⟨pk,pk⟩/⟨pk−1,pk−1⟩ (Theorem 11.10.3).

  • (c) True. Both ⟨pk,pk⟩=‖pk‖2 and ⟨pk−1,pk−1⟩=‖pk−1‖2 are strictly positive, since pk and pk−1 are non-zero and the inner product is positive definite.

  • (d) Seven roots, all real, all distinct, all in the open interval (−1,1) (Theorem 11.10.5). In particular p7 has no complex roots and no repeated ones.

  • (e) False. Take the coefficient inner product ⟨p,q⟩=∑kukvk on R[x], where p=∑kukxk and q=∑kvkxk (Example (A functional with no Riesz vector)). Then ⟨x⋅1,x⟩=⟨x,x⟩=1, while ⟨1,x⋅x⟩=⟨1,x2⟩=0. The identity is a property of the weight and node constructions (Proposition 11.10.1), not of inner products in general.

  • (f) Six. A k-point rule is exact up to degree 2k−1, and 2⋅6−1=11.

B. Practice

Exercise (B1: A weighted interval)

On R[x] put ⟨p,q⟩=∫01p(t)q(t)tdt. Compute the monic p0, p1 and p2, and verify directly that p2⊥R[x]≤1.

Solution. The moments are ⟨xk,1⟩=∫01tk+1dt=1/(k+2), so 12,13,14,15 for k=0,1,2,3.

p0=1. Then a0=⟨x,1⟩/⟨1,1⟩=(1/3)/(1/2)=23, so p1=x−23, and ⟨p1,p1⟩=14−43⋅13+49⋅12=14−29=136. Next ⟨xp1,p1⟩=∫01(t4−43t3+49t2)dt=15−13+427=2135, so a1=2/1351/36=815,b1=1/361/2=118, and Theorem 11.10.3 gives p2=(x−815)(x−23)−118=x2−65x+310. Verification. ⟨p2,1⟩=∫01(t3−65t2+310t)dt=14−25+320=0, and ⟨p2,x⟩=∫01(t4−65t3+310t2)dt=15−310+110=0. Since (1,x) spans R[x]≤1, this is the whole check.

Exercise (B2: Two rows of the table)

Verify the degree-1 and degree-2 entries of the table for two of the classical families.

  • (a) Chebyshev: w(t)=(1−t2)−1/2 on (−1,1). You may use, without proof, that ∫−11(1−t2)−1/2dt=π and ∫−11t2(1−t2)−1/2dt=π/2.
  • (b) Laguerre: w(t)=e−t on (0,∞). You may use, without proof, that ∫0∞tke−tdt=k!.

Solution.

  • (a) The weight is even, so ⟨xj,xi⟩=0 whenever i+j is odd. Hence ⟨x,1⟩=0, and x is monic of degree 1 and orthogonal to R[x]≤0, so p1=x by Proposition 11.10.2. Write p2=x2+βx+γ. Then ⟨p2,x⟩=⟨x2,x⟩+β⟨x,x⟩+γ⟨1,x⟩=0+β⋅π2+0, forcing β=0; and ⟨p2,1⟩=π2+0+γπ=0, forcing γ=−12. So p2=x2−12.

  • (b) The moments are ⟨xk,1⟩=k!, so 1,1,2,6 for k=0,1,2,3. For p1=x+β: ⟨p1,1⟩=1+β=0, so p1=x−1. For p2=x2+βx+γ, the two conditions ⟨p2,1⟩=0 and ⟨p2,x⟩=0 read 2+β+γ=0,6+2β+γ=0. Subtracting gives β=−4, then γ=2. So p2=x2−4x+2, whose roots 2±2 we already located in the Quick check above.

Exercise (B3: One more Legendre polynomial)

Continue Example (The monic Legendre polynomials, continued): compute ⟨p3,p3⟩ for p3=x3−35x, then use Theorem 11.10.3 to find p4. Verify that ⟨p4,1⟩=⟨p4,x2⟩=0.

Solution. ⟨p3,p3⟩=∫−11(t6−65t4+925t2)dt=27−65⋅25+925⋅23=27−625=8175. Since the weight is even, a3=0, and b3=⟨p3,p3⟩/⟨p2,p2⟩=(8/175)/(8/45)=935. Hence p4=x(x3−35x)−935(x2−13)=x4−67x2+335. Verification. ⟨p4,1⟩=25−67⋅23+335⋅2=14−20+635=0, and ⟨p4,x2⟩=27−67⋅25+335⋅23=10−12+235=0. Orthogonality to x and x3 is automatic by parity.

Exercise (B4: A two-point rule on the unit interval)

Work on (0,1) with w=1. Exercise B2 of Section 2 (Exercise (B2: Gram–Schmidt on polynomials)) found the monic orthogonal polynomials 1, x−12, x2−x+16.

  • (a) Write down the two-point Gaussian rule for ∫01f.
  • (b) Check it on f=x3, and show that it fails on f=x4.

Solution.

  • (a) The nodes are the roots of x2−x+16, namely t1,2=12∓36,t2−t1=33, both in (0,1), as Theorem 11.10.5 promises. With ℓ1=(x−t2)/(t1−t2) and ∫01tdt=12, α1=12−t2t1−t2=−3/6−3/3=12, and α2=12 likewise. So ∫01f=12(f(t1)+f(t2)) for f∈R[x]≤3.

  • (b) Write t1,2=12∓u with u=3/6, so u2=112. The odd powers of u cancel in a sum over t1 and t2, so t13+t23=2(18+3⋅12⋅112)=2⋅14=12, and half of that is 14=∫01t3dt. For the quartic, t14+t24=2(116+6⋅14⋅112+1144)=2⋅28144=718, so the rule returns 736, whereas ∫01t4dt=15. The rule is exact to degree 3=2k−1 and no further.

C. Going deeper

Exercise (C1: Interlacing roots)

Let w be a weight on (a,b) and let (pk) be its monic orthogonal polynomial sequence. The roots of pk are said to interlace those of pk+1 when exactly one root of pk lies strictly between each pair of consecutive roots of pk+1. This is true for every k; prove the first two cases by hand.

  • (a) Let r be the root of p1 and s1<s2 the roots of p2. Prove that s1<r<s2.
  • (b) Let u1<u2<u3 be the roots of p3. Prove that u1<s1<u2<s2<u3.

Hint: evaluate the three-term recurrence at a root.

Solution.

  • (a) By Theorem 11.10.3 with k=1, p2=(x−a1)p1−b1p0=(x−a1)(x−r)−b1. Evaluating at r gives p2(r)=−b1<0, since b1>0. By Theorem 11.10.5, p2=(x−s1)(x−s2) with s1<s2 real, and this product is negative exactly on (s1,s2). Hence s1<r<s2.

  • (b) By Theorem 11.10.3 with k=2, p3=(x−a2)p2−b2p1. At a root of p2 the first term dies, so p3(si)=−b2p1(si)=−b2(si−r)(i=1,2). By (a), s1−r<0 and s2−r>0, and b2>0, so p3(s1)>0 and p3(s2)<0.

By Theorem 11.10.5, p3=(x−u1)(x−u2)(x−u3) with u1<u2<u3. Such a product is negative on (−∞,u1), positive on (u1,u2), negative on (u2,u3), and positive on (u3,∞). So p3(s1)>0 puts s1 in (u1,u2) or in (u3,∞), and p3(s2)<0 puts s2 in (−∞,u1) or in (u2,u3). The option s1>u3 is impossible: it would give s2>s1>u3, where p3 is positive, contradicting p3(s2)<0. The option s2<u1 is impossible too: it would give s1<s2<u1, where p3 is negative, contradicting p3(s1)>0. Hence u1<s1<u2 and u2<s2<u3, which is the assertion.

The general case is not proved this way. The coefficients ak and bk assemble into a symmetric tridiagonal matrix whose characteristic polynomial is pk, and the interlacing then follows from the interlacing theorem for the eigenvalues of a symmetric matrix and its leading submatrices, which is Chapter 17’s business.

Exercise (C2: The ceiling is 2k − 1)

Let w be a weight on (a,b) and let k≥1.

  • (a) Let t1,…,tk be any k distinct real numbers and α1,…,αk any real numbers. Prove that there is an f∈R[x]≤2k with ∫abfw≠∑iαif(ti).
  • (b) Hence deduce that the Gaussian rule of Theorem 11.10.6 is exact on R[x]≤2k−1 and on no larger space R[x]≤d.

Solution.

  • (a) Put g=(x−t1)⋯(x−tk) and f=g2, a polynomial of degree 2k. Every node is a root of g, so f(ti)=0 for every i and the right-hand side is 0, whatever the αi are. The left-hand side is ∫abg2w=⟨g,g⟩, and g≠0, so ⟨g,g⟩>0 by positive definiteness. The two sides differ.

  • (b) Exactness on R[x]≤2k−1 is Theorem 11.10.6. Suppose the rule were exact on R[x]≤d for some d≥2k. Since R[x]≤2k⊆R[x]≤d, it would then be exact on every polynomial of degree at most 2k. But its nodes are k distinct real numbers (Theorem 11.10.5), so (a) supplies a polynomial of degree 2k on which it is not. Hence no such d exists, and 2k−1 is the largest degree for which the rule is exact. The concrete instance k=2, f=x4 is the failure computed in Example (Two-point Gauss–Legendre).

Found a typo or a mistake? Report it, or read this page’s source

The text of this book is licensed under CC BY-NC-SA 4.0.