18.2  Carathéodory’s Theorem

By Theorem 18.1.3, the convex hull of a set S consists of the convex combinations of points of S, with any number of points allowed. For a hundred points in the plane, that description permits a single point of the hull to be an average of all hundred at once. A picture says that this is wasteful: the hundred points spread out into a polygon, the polygon can be cut into triangles with corners among the points, and every point of the polygon lies in one of those triangles, so three points always suffice. This section proves the general statement. In a space of dimension n, every point of a convex hull is a convex combination of at most n+1 points of the set, and the bound cannot be lowered. Two consequences follow. The hull of a compact set is compact, which §08 uses. And from the same counting argument come Radon’s theorem and Helly’s theorem, which describe how convex sets in Rn can intersect.

As in §01, all spaces are real. Carathéodory’s theorem needs a finite dimension and nothing else; the compactness corollary needs, in addition, a norm, and any norm will do.

18.2.1. When there are too many points

The proof we want has a simple plan. If a point is written as a convex combination of too many points, find a way to shift the weights so that the point stays where it is while one weight falls to zero. That point can then be dropped. Two things are needed: a precise meaning of “too many”, and a way to shift the weights without moving the point.

Both come from one observation. If ∑iλixi=0 and ∑iλi=0, then for every real s, ∑i(ti−sλi)xi=∑itixiand∑i(ti−sλi)=∑iti. So the weights ti−sλi describe the same point, and they still add up to 1. A relation of this shape is what we need a word for.

A list of points is affinely dependent when some combination with coefficients adding to zero, not all of them zero, cancels out.

Definition 18.2.1 (Affine Independence)

Let V be a real vector space and let (x0,x1,…,xm) be a list in V, m≥0. The list is affinely independent if, for all real λ0,…,λm, ∑i=0mλixi=0  and  ∑i=0mλi=0⟹λ0=λ1=⋯=λm=0. It is affinely dependent otherwise. A relation ∑iλixi=0 with ∑iλi=0 and the λi not all zero is an affine dependence.

In words: this is linear independence (Definition 1.4.1) with one extra hypothesis, that the coefficients add up to zero. The extra hypothesis makes the condition easier to satisfy, and it makes the notion blind to the choice of origin. Translating every point by p changes ∑iλixi by (∑iλi)p=0, so a translated list is affinely dependent exactly when the original is.

Some small cases:

  • A single point (x0) is always affinely independent: λ0=0 is forced by the sum condition alone.
  • Two points (x0,x1) are affinely dependent exactly when they are equal: the condition forces λ1=−λ0, and then λ0(x0−x1)=0 has a solution λ0≠0 if and only if x0=x1.
  • Three collinear points are affinely dependent: (0,0),(1,1),(2,2) satisfy 1⋅(0,0)−2⋅(1,1)+1⋅(2,2)=0, with 1−2+1=0.

A non-example by minimal change. The list (0,e1,e2) in R2 is affinely independent: the e1- and e2-coordinates of λ00+λ1e1+λ2e2=0 give λ1=λ2=0, and then the sum condition gives λ0=0. Move the third point to 2e1. The list (0,e1,2e1) still spans the same line as (0,e1), but now 1⋅0−2e1+1⋅(2e1)=0 with 1−2+1=0: the three points have fallen onto one line, and the implication in the definition fails.

Warning. Affine independence is not linear independence. The list (0,e1,e2) in R2 is linearly dependent, since it contains 0, yet it was just shown to be affinely independent. A triangle is an affinely independent list of three points in a two-dimensional space, which linear independence would never allow. That is why the bound in this section is n+1, and not n. The implication does run one way: a linearly independent list is affinely independent, since an affine dependence is in particular a linear relation with coefficients not all zero.

The next lemma converts affine dependence into linear dependence of differences, which is what allows a dimension count.

Lemma 18.2.1 (Affine Dependence by Differences)

Let V be a real vector space and x0,…,xm∈V.

  • (a) The list (x0,…,xm) is affinely independent if and only if the list (x1−x0,…,xm−x0) is linearly independent.
  • (b) If dim⁡V=n, every affinely independent list in V has at most n+1 entries. Equivalently, every list of n+2 or more points of V is affinely dependent.

Idea. The sum condition determines λ0 from the other coefficients, and eliminating it turns an affine relation among the points into a linear relation among the differences, and back.

Proof.

  • (a) Suppose ∑i=0mλixi=0 and ∑i=0mλi=0. Then λ0=−∑i≥1λi, and substituting, ∑i=1mλi(xi−x0)=∑i=0mλixi=0. Conversely, if ∑i=1mλi(xi−x0)=0, then setting λ0=−∑i≥1λi gives an affine relation ∑i=0mλixi=0 with ∑i=0mλi=0. These two passages are inverse to each other, and (λ0,…,λm) is not all zero exactly when (λ1,…,λm) is not all zero, because λ0 is determined by the others. So affine dependences of the points correspond to linear relations, not all zero, among the differences, and one exists exactly when the other does.

  • (b) If (x0,…,xm) is affinely independent, then by (a) the m differences xi−x0 are linearly independent, so m≤n by Theorem 1.6.3 (a). The list has m+1≤n+1 entries.

18.2.2. The theorem

Now the plan can be carried out. The statement is sharper than the count: the points can be taken affinely independent, and the count is a consequence.

Theorem 18.2.2 (Carathéodory’s Theorem)

Let V be a real vector space with dim⁡V=n, and let S⊆V. Every point of convS is a convex combination of an affinely independent list of points of S. In particular, every point of convS is a convex combination of at most n+1 points of S.

Idea. Count, then drop a point. Write x with as few points as possible, so that every weight is positive. If the points were affinely dependent, the weights ti−sλi would describe the same x for every s. Start at s=0 and increase s. The weights with λi>0 decrease, and there is at least one of these, because the λi add up to zero without all being zero. Stop at the first moment a weight reaches 0: all the weights are still ≥0, and one point has become unnecessary. That contradicts minimality.

Proof. Let x∈convS. By Theorem 18.1.3, x is a convex combination of finitely many points of S. Among all ways of writing it so, choose one, x=∑i=0mtixi,xi∈S,  (t0,…,tm)∈Δm+1, with the number m+1 of points as small as possible. Then every ti>0: a zero weight could be deleted, and the remaining weights would still be non-negative and add up to 1, giving a shorter expression.

Suppose, for a contradiction, that (x0,…,xm) is affinely dependent, and let ∑iλixi=0, ∑iλi=0 be an affine dependence. The λi are not all zero and add up to 0, so at least one of them is positive. Put s=min{tiλi:λi>0}, a minimum over a non-empty finite set, and let j be an index where it is attained; s>0 since each ti>0. Define ti′=ti−sλi. Then:

  • ti′≥0 for every i. If λi≤0, then ti′≥ti>0, since s>0. If λi>0, then s≤ti/λi by the choice of s, so sλi≤ti.
  • tj′=tj−(tj/λj)λj=0.
  • ∑iti′=∑iti−s∑iλi=1 and ∑iti′xi=∑itixi−s∑iλixi=x.

So x is a convex combination of the m points xi, i≠j, contradicting the minimality of m+1. Hence (x0,…,xm) is affinely independent. By Lemma 18.2.1 (b) it has at most n+1 entries. This proves the theorem.

In the plane, then, every point of the hull of any set S lies in a triangle whose corners are points of S, possibly a degenerate one (a segment or a single point). In R3 it lies in a tetrahedron with corners in S. The proof is constructive: given any convex combination, it says how to shorten it, one point at a time.

Example (Dropping a point in the plane)

In R2 let x0=(0,0), x1=(3,0), x2=(0,3), x3=(2,2), and let x=14(x0+x1+x2+x3)=(54,54). Write x as a convex combination of three of these points by the method of the proof.

Solution. Four points in R2 are affinely dependent by Lemma 18.2.1 (b). To find a dependence, solve ∑iλixi=0 and ∑iλi=0: the two coordinate equations read 3λ1+2λ3=0 and 3λ2+2λ3=0. Taking λ3=3 gives λ1=λ2=−2, and then λ0=−(λ1+λ2+λ3)=1. Check: 1⋅(0,0)−2(3,0)−2(0,3)+3(2,2)=(−6+6,−6+6)=0, and 1−2−2+3=0.

The positive coefficients are λ0=1 and λ3=3, with ratios t0/λ0=14 and t3/λ3=112. So s=112, attained at j=3, and the new weights are t′=(14−112, 14+212, 14+212, 14−312)=(16, 512, 512, 0). Check: 512(3,0)+512(0,3)=(54,54)=x, and 212+512+512=1. So x=16x0+512x1+512x2 lies in the triangle with corners x0,x1,x2, and x3 has been dropped.

The minimum matters. Using the other positive coefficient, s=14, would make the weight of x3 equal to 14−34=−12<0: the point would still be described correctly, but not as a convex combination.

Diagram. Labels: mathbf x_0, mathbf x_1, mathbf x_2, mathbf x_3 (dropped), mathbf x, mathbf x is an average of all four points,\\ and already lies in the shaded triangle of three

The bound n+1 cannot be improved, and the standard simplex shows it.

Example (The bound is attained)

In Rn, let S={0,e1,…,en} and let c=1n+1(0+e1+⋯+en)=1n+11. Show that c∈convS is not a convex combination of any n points of S.

Solution. The point c is a convex combination of the n+1 points of S, each with weight 1n+1. A convex combination of n of the points leaves one out. If it leaves out ej, the combination is t00+∑i≠jtiei, whose j-th coordinate is 0, while cj=1n+1≠0. If it leaves out 0, the combination is ∑itiei=(t1,…,tn), whose coordinates add up to 1, while those of c add up to nn+1≠1. Either way it is not c.

The bound can be far from attained for a particular set, however, and it is worth seeing one.

Example (Two points suffice for a circle)

Let S={x∈R2:‖x‖2=1} be the unit circle. Show that convS is the closed unit disc B2, and that every point of B2 is a convex combination of two points of S.

Solution. B2 is convex (Example (The first convex sets) (d)) and contains S, so convS⊆B2 by Definition 18.1.4. Conversely, let (a,b)∈B2, so a2+b2≤1, and put c=1−a2, which is real since |a|≤1. The points (a,c) and (a,−c) lie on S, and |b|≤c because b2≤1−a2. With t=c+b2c when c>0, t(a,c)+(1−t)(a,−c)=(a, (2t−1)c)=(a,b), and 0≤t≤1 because −c≤b≤c. When c=0, we have a=±1 and b=0, and (a,b) is itself a point of S. So every point of the disc lies on a vertical chord of the circle, and B2⊆convS by Theorem 18.1.3.

Quick check. A point of R3 is given as a convex combination of seven points of a set S. What is the smallest number of points of S that Theorem 18.2.2 guarantees will suffice? Can one always manage with three?

Solution. Four, since n+1=4 for n=3. Three do not always suffice: by Example (The bound is attained) with n=3, the point 14(1,1,1) is a convex combination of 0,e1,e2,e3 and of no three of them.

Remark. The only place the proof used dim⁡V=n was the final count, through Lemma 18.2.1 (b), and all that count needs is a space containing the differences of the points. If S lies in an affine subspace of dimension d, then n+1 can be replaced by d+1; Exercise (C1: Carathéodory in the affine hull) carries this out. A set of points on a line in R100 needs only two at a time.

18.2.3. The hull of a compact set

The first use of the theorem is a statement about limits. Recall from Corollary 16.2.5 that a subset K of a finite-dimensional real space with a norm is compact if every sequence in K has a subsequence converging to a point of K. Compactness is what lets later sections take a maximum, or a nearest point, over a hull, and it is not obvious that a hull keeps it. A convex combination may use arbitrarily many points, so a sequence of combinations could use more and more of them, and there would be no single compact set of parameters from which to extract a convergent subsequence. Carathéodory’s bound removes that possibility: every point of the hull is described by exactly n+1 points of K and n+1 weights.

Corollary 18.2.3 (The Hull of a Compact Set Is Compact)

Let V be a finite-dimensional real vector space with a norm, and let K⊆V be compact.

  • (a) convK is compact.
  • (b) If K is non-empty, then every linear functional φ on V attains a maximum on convK, and maxx∈convKφ(x)=maxx∈Kφ(x).

Idea. For (a), write each term of a sequence in convK as a combination of exactly n+1 points of K, using Theorem 18.2.2 and padding with zero weights. That turns one sequence into n+2 sequences: one of weight vectors in Δn+1, and n+1 of points of K. Extract a convergent subsequence from each in turn, a subsequence of the previous one each time, and pass to the limit in the combination. For (b), a linear functional cannot do better on an average than on the best of the points averaged.

Proof. Let n=dim⁡V.

  • (a) If K=∅, then convK=∅, which is compact vacuously. Otherwise let (yk) be a sequence in convK. By Theorem 18.2.2, each yk is a convex combination of at most n+1 points of K; repeating one of those points with weight 0 if necessary, we may write yk=∑i=0ntk,ixk,i,xk,i∈K,  tk=(tk,0,…,tk,n)∈Δn+1.

    Step 1: the weights. Δn+1 is closed in Rn+1 by Proposition 18.1.6 (b), (c), and bounded, since each coordinate of a point of it lies in [0,1]. By the compactness of closed bounded sets in Rn+1, fact (A3) of Chapter 16’s introduction, some subsequence of (tk) converges to a point t=(t0,…,tn)∈Δn+1. In particular tk,i→ti along it for each i, since |tk,i−ti|≤‖tk−t‖2.

    Step 2: the points. Along that subsequence, the sequence (xk,0) lies in K, so by compactness of K a further subsequence has xk,0→x0∈K. Along it, a further subsequence has xk,1→x1∈K, and so on through i=n. A subsequence of a convergent sequence converges to the same limit, so along the final subsequence, which we index by k again, tk→t and xk,i→xi for every i.

    Step 3: the limit. Put y=∑i=0ntixi, which lies in convK by Theorem 18.1.3. By (N3) and (N2) of Definition 16.1.1, along the final subsequence, ‖yk−y‖≤∑i=0n‖tk,ixk,i−tixi‖≤∑i=0n(|tk,i−ti|‖xk,i‖+ti‖xk,i−xi‖), where the second line writes tk,ixk,i−tixi=(tk,i−ti)xk,i+ti(xk,i−xi). Each ‖xk,i‖≤‖xi‖+‖xk,i−xi‖ is bounded, since the last term tends to 0. So every term on the right tends to 0, and yk→y∈convK along the subsequence. Hence convK is compact.

  • (b) By Lemma 18.1.5, φ is continuous. By the extreme value theorem, fact (A4) of Chapter 16’s introduction, applied to φ on the non-empty compact set K, there is x∗∈K with φ(x)≤M=φ(x∗) for every x∈K. Now let y=∑itixi be any point of convK, with xi∈K and t∈Δm (Theorem 18.1.3). By linearity, and since every ti≥0, φ(y)=∑itiφ(xi)≤∑itiM=M. So M bounds φ on convK, and it is attained there, at x∗∈K⊆convK. This proves the corollary.

For instance, φ(x,y)=x+2y takes the values 0,3,6 at the corners (0,0),(3,0),(0,3) of the triangle in Example (Dropping a point in the plane); as in the proof of (b), at a point ∑itixi of the triangle it takes the average 3t1+6t2≤6 of these values, so its maximum over the triangle is 6, attained at (0,3). At the interior point x=(54,54) it takes 154=16⋅0+512⋅3+512⋅6, an average of the corner values and so no larger than the largest.

To maximize a linear functional over the hull of finitely many points it is enough to evaluate it at those points (Exercise (B3: Linear functionals on a polygon)). §08 extends this to every compact convex set, and §09 shows that a bounded feasible region of §06 is such a hull.

Warning. The hull of a closed set need not be closed. In R2, let S={(0,1)}∪{(x,0):x∈R}, a point together with a line. S is closed, by Proposition 18.1.6 (b), (c). Its hull is convS={(x,y):0≤y<1}∪{(0,1)}. Indeed a convex combination of points of S with total weight y on (0,1) has second coordinate y, and when y<1 any first coordinate x is reached, as y(0,1)+(1−y)(x/(1−y),0)=(x,y); when y=1 all the weight is on (0,1). The points (1,1−1/k) lie in convS and converge to (1,1), which does not. So compactness in Corollary 18.2.3 cannot be weakened to closedness: here S is closed but unbounded, and the hull loses the line y=1, except for the one point that belongs to S.

18.2.4. Radon’s theorem and Helly’s theorem

The dimension count behind Carathéodory’s theorem says something about intersections of convex sets as well. Its first form is a statement about n+2 points.

Theorem 18.2.4 (Radon’s Theorem)

Let V be a real vector space with dim⁡V=n, and let x1,…,xm∈V with m≥n+2. Then the index set {1,…,m} can be split into two disjoint non-empty sets I and J with conv{xi:i∈I}∩conv{xj:j∈J}≠∅.

Idea. Take an affine dependence and separate its positive coefficients from the rest. Moving the negative terms across the equation gives an equation between a positive combination of some points and a positive combination of the others, with the same total weight on each side, because the coefficients add up to zero. Divide by that total, and each side becomes a convex combination.

Proof. By Lemma 18.2.1 (b), the list (x1,…,xm) is affinely dependent: there are λ1,…,λm, not all zero, with ∑iλixi=0 and ∑iλi=0. Let I={i:λi>0} and J={j:λj≤0}, which are disjoint with union {1,…,m}. Since the λi add up to 0 and are not all zero, some λi is positive and some is negative, so neither I nor J is empty. Put σ=∑i∈Iλi>0; then ∑j∈J(−λj)=σ as well, since the total is 0. Moving the terms indexed by J across and dividing by σ, y:=∑i∈Iλiσxi=∑j∈J−λjσxj. On the left the coefficients are positive and add up to 1; on the right they are ≥0 and add up to 1. So y lies in both hulls, by Theorem 18.1.3. This proves the theorem.

A partition as in the theorem is a Radon partition. In the plane, four points in general position (no three on a line) either have one inside the triangle of the other three, or they form a quadrilateral whose two diagonals cross; Exercise (B2: Radon partitions in the plane) finds the partition in each case. The count n+2 cannot be lowered: the n+1 points 0,e1,…,en have no Radon partition (Exercise (C3: The counts are sharp)).

Helly’s theorem turns the counting around. Instead of asking how many points a hull needs, it asks how many sets of a family must be checked to know that all of them have a common point. Checking pairs is not enough, since three lines in the plane can meet pairwise in three different points; checking triples in the plane is.

Theorem 18.2.5 (Helly’s Theorem)

Let V be a real vector space with dim⁡V=n, and let C1,…,Cm be convex subsets of V, with m≥n+1. If every n+1 of the sets have a point in common, then all m of them have a point in common.

Idea. Induction on the number of sets. Given m≥n+2 sets, the inductive hypothesis provides, for each i, a point xi lying in every set except possibly Ci. That is m≥n+2 points, so Radon’s theorem splits them into two groups whose hulls meet at some y. Any one set Ck misses at most one point, xk, and that point lies in only one of the two groups; the other group lies entirely in Ck, and so does its hull, which contains y.

Proof. We use induction on m. For m=n+1, the hypothesis applied to all m sets is the conclusion. Let m≥n+2, and suppose the theorem holds for families of m−1 convex sets. For each i=1,…,m, the family {Ck:k≠i} has m−1≥n+1 members, and every n+1 of them have a common point by hypothesis. By the inductive hypothesis, there is a point xi with xi∈Ckfor every k≠i. Since m≥n+2, Theorem 18.2.4 splits {1,…,m} into disjoint non-empty sets I, J and gives a point y∈conv{xi:i∈I}∩conv{xj:j∈J}.

Fix k∈{1,…,m}. If k∈I, then k∉J, so every xj with j∈J lies in Ck. Since Ck is convex, Lemma 18.1.2 puts every convex combination of these points in Ck, so conv{xj:j∈J}⊆Ck by Theorem 18.1.3, and in particular y∈Ck. If k∈J, the same argument with I in place of J gives y∈Ck. Hence y lies in every Ck. This completes the induction.

Example (Helly’s proof run on four half-planes)

In R2, let C1={y≥0},C2={x≥0},C3={x+y≤2},C4={x−y≤1}. Find points xi in all the sets except Ci, and follow the proof of Theorem 18.2.5 to a common point of all four.

Solution. Here n=2 and m=4=n+2, so the proof applies Radon’s theorem (Theorem 18.2.4) to four points. The following points lie in every set except their own, as substitution into the four inequalities shows: x1=(0,−1),x2=(−1,0),x3=(2,2),x4=(2,0). For instance, x1 has x=0≥0, x+y=−1≤2, x−y=1≤1, and y=−1<0 violates C1. And x4 has y=0, x=2, x+y=2, and x−y=2>1 violates C4.

An affine dependence: the equations ∑iλixi=0, ∑iλi=0 are satisfied by λ=(−6,4,−3,5). Check: the first coordinates give −4−6+10=0, the second 6−6+0=0, and −6+4−3+5=0. The positive coefficients are at I={2,4}, with σ=9, so y=49x2+59x4=(−4+109,0)=(23,0), and from the other side 69x1+39x3=(69,−6+69)=(23,0), as it must be. Finally y=(23,0) satisfies y=0≥0, x=23≥0, x+y=23≤2 and x−y=23≤1: it lies in all four half-planes. The proof explains why, without any checking: C2 and C4 contain x1 and x3, hence the segment between them, which contains y; and C1 and C3 contain x2 and x4, hence the other segment through y.

Remark. Helly’s theorem is about finite families, and the finiteness cannot simply be dropped. The closed half-lines [k,∞)⊆R, for k=1,2,3,…, are convex, and any finitely many of them meet (at their largest k), but no real number lies in all of them. For compact convex sets the infinite version does hold; Exercise (C2: Helly’s theorem for a sequence of compact sets) proves it for a sequence of sets.

With these results the chapter has its combinatorial foundation. §03 turns to geometry: a point outside a closed convex set can be separated from it by a hyperplane.

18.2.5. Exercises

A. Check your understanding

Exercise (A1)
  • (a) State Theorem 18.2.2.
  • (b) True or false: every point in the convex hull of ten points of R2 is a convex combination of three of them. Justify your answer.
  • (c) True or false: the convex hull of a closed subset of R2 is closed. Justify your answer.
  • (d) True or false: any four points of R3 have a Radon partition. Justify your answer.
  • (e) Is the list (e1,e2,e3) in R3 affinely independent? Is (e1,e2,e1+e2−e3,e3)?
  • (f) Which facts from Chapter 16’s list of imported analysis does Corollary 18.2.3 use, and where?

Solution.

  • (a) If dim⁡V=n and S⊆V, every point of convS is a convex combination of an affinely independent list of points of S, and so of at most n+1 points of S.

  • (b) True, by Theorem 18.2.2 with n=2: at most three are needed, and if fewer are used, a point can be added with weight 0.

  • (c) False. The warning in this section gives S={(0,1)}∪{(x,0):x∈R}, closed, with (1,1) a limit of points of convS not in convS.

  • (d) False. Radon’s theorem (Theorem 18.2.4) needs n+2=5 points in R3, and four can fail. The points 0,e1,e2,e3 are affinely independent, since e1,e2,e3 are linearly independent (Lemma 18.2.1 (a)). A point common to the hulls of two disjoint groups of them would give two convex combinations with equal value, and subtracting them gives a relation with coefficients adding up to 0 and not all zero, which is an affine dependence. So there is no Radon partition; Exercise (C3: The counts are sharp) carries this out for n+1 affinely independent points in general.

  • (e) Yes: it is linearly independent, and a linearly independent list is affinely independent. The second list is affinely dependent: e1+e2−(e1+e2−e3)−e3=0 with coefficients 1,1,−1,−1, which add up to 0.

  • (f) (A3), the compactness of closed bounded sets, for the weights in part (a); and (A4), the extreme value theorem, for the maximum over K in part (b). Part (a) also uses the hypothesis that K is compact, once for each of the n+1 points.

B. Practice

Exercise (B1: Shortening a combination)

In R2, let x1=(0,0), x2=(4,0), x3=(4,4), x4=(0,4), and x=110x1+210x2+310x3+410x4.

  • (a) Compute x, and find an affine dependence among x1,…,x4.
  • (b) Use the method of Theorem 18.2.2 to write x as a convex combination of three of the points.
  • (c) Apply the method with the dependence multiplied by −1. Which point is dropped now? Hence x lies in two different triangles with corners among the xi.

Solution.

  • (a) x=210(4,0)+310(4,4)+410(0,4)=(8+1210,12+1610)=(2,145). The corners of a square satisfy x1−x2+x3−x4=(0−4+4−0,0−0+4−4)=0, with 1−1+1−1=0. So λ=(1,−1,1,−1).

  • (b) The positive coefficients are at x1 and x3, with ratios 1/101=110 and 3/101=310. So s=110, attained at x1, and the new weights are t−sλ=(0,310,210,510). Check: 310(4,0)+210(4,4)+510(0,4)=(12+810,8+2010)=(2,145), and the weights add up to 1. So x∈conv{x2,x3,x4}.

  • (c) With −λ=(−1,1,−1,1), the positive coefficients are at x2 and x4, with ratios 210 and 410. So s=210, attained at x2, and the weights become t+sλ=(310,0,510,210). Check: 510(4,4)+210(0,4)=(2,20+810)=(2,145). Now x2 is dropped, and x∈conv{x1,x3,x4}. The two answers are consistent: the triangle with corners x2,x3,x4 is the part of the square where x+y≥4, the triangle with corners x1,x3,x4 is the part where y≥x, and (2,145) satisfies both. The shorter combination produced by Carathéodory’s theorem is not unique; it depends on the dependence used and on its sign.

Exercise (B2: Radon partitions in the plane)

Find a Radon partition, and a point common to the two hulls, for each list of four points in R2. Justify your answer.

  • (a) (0,0),(4,0),(0,4),(1,1).
  • (b) (0,0),(3,1),(1,3),(4,4).

Solution. Label the points x1,…,x4 in the order given, and follow the proof of Theorem 18.2.4.

  • (a) The equations ∑iλixi=0, ∑iλi=0 read 4λ2+λ4=0, 4λ3+λ4=0, λ1+λ2+λ3+λ4=0. Taking λ4=4 gives λ2=λ3=−1 and λ1=−2. So I={4}, J={1,2,3}, σ=4, and y=x4=(1,1)=24(0,0)+14(4,0)+14(0,4). The fourth point lies inside the triangle of the other three.

  • (b) The equations read 3λ2+λ3+4λ4=0, λ2+3λ3+4λ4=0, and ∑iλi=0. Subtracting the first two gives λ2=λ3, and then 4λ2+4λ4=0, so λ4=−λ2 and λ1=−λ2−λ3−λ4=−λ2. Taking λ2=−1 gives λ=(1,−1,−1,1). So I={1,4}, J={2,3}, σ=2, and y=12(0,0)+12(4,4)=(2,2)=12(3,1)+12(1,3). The two diagonals of the quadrilateral cross at (2,2).

Exercise (B3: Linear functionals on a polygon)

Let V be a finite-dimensional real vector space with a norm, and x1,…,xm∈V.

  • (a) Prove that {x1,…,xm} is compact, and deduce that P=conv{x1,…,xm} is compact.
  • (b) Prove that every linear functional φ on V attains its maximum over P at one of the points xi.
  • (c) Find the maximum and the minimum of φ(x,y)=2x−y over the triangle conv{(1,0),(3,1),(0,2)} of Example (Deciding membership in a triangle).

Solution.

  • (a) Let (yk) be a sequence in the finite set. Some xi occurs as yk for infinitely many k, since there are only m candidates, and those terms form a constant subsequence, which converges to xi, a point of the set. So the set is compact, and P is compact by Corollary 18.2.3 (a).

  • (b) By Corollary 18.2.3 (b), the maximum of φ over P equals its maximum over {x1,…,xm}, which is maxiφ(xi), attained at an xi with the largest value.

  • (c) The values at the corners are φ(1,0)=2, φ(3,1)=5, φ(0,2)=−2. By (b), the maximum over the triangle is 5, at (3,1). Applying (b) to −φ, the minimum is −2, at (0,2).

C. Going deeper

Exercise (C1: Carathéodory in the affine hull)

Let V be a real vector space, S⊆V non-empty, and suppose affS has dimension d (Definition 18.1.5).

  • (a) Prove that every affinely independent list of points of S has at most d+1 entries.
  • (b) Hence prove that every point of convS is a convex combination of at most d+1 points of S.
  • (c) Let S={(t,t,t):0≤t≤1}∪{(2,2,2)}⊆R3. What bound does Theorem 18.2.2 give, and what bound does (b) give?

Solution.

  • (a) By Proposition 18.1.4, affS=x0+U with dim⁡U=d. If (y0,…,ym) is an affinely independent list in S, then each yi lies in x0+U, so each difference yi−y0=(yi−x0)−(y0−x0) lies in U. By Lemma 18.2.1 (a) the m differences are linearly independent, and they lie in the d-dimensional space U, so m≤d by Theorem 1.6.3 (a).

  • (b) By Theorem 18.2.2, each point of convS is a convex combination of an affinely independent list of points of S, which has at most d+1 entries by (a).

  • (c) Here n=3, so Theorem 18.2.2 gives 4. All of S lies on the line span(1), and S contains two distinct points, so affS is that line and d=1; (b) gives 2. Indeed convS is the segment from 0 to (2,2,2), and each of its points is a convex combination of the two endpoints.

Exercise (C2: Helly’s theorem for a sequence of compact sets)

Let V be a real vector space of dimension n with a norm, and let C1,C2,C3,… be a sequence of compact convex subsets of V such that every n+1 of them have a common point.

  • (a) Prove that a compact set K is closed.
  • (b) Prove that for each m≥1 there is a point ym∈C1∩⋯∩Cm.
  • (c) Prove that ⋂k≥1Ck≠∅.
  • (d) Explain where the argument fails for the closed half-lines [k,∞) of the remark after Theorem 18.2.5.

Hint for (c): all the ym lie in C1.

Solution.

  • (a) Let xk→x with xk∈K. By compactness, a subsequence converges to some x′∈K. It also converges to x, as a subsequence of a convergent sequence, and a limit is unique: ‖x−x′‖≤‖x−xkj‖+‖xkj−x′‖→0, so x=x′ by (N1). Hence x∈K.

  • (b) For m≤n, the sets C1,…,Cm, together with Cm+1,…,Cn+1, are n+1 of the sets, and a common point of all of them lies in C1∩⋯∩Cm. For m≥n+1, Theorem 18.2.5 applies to the convex sets C1,…,Cm.

  • (c) Every ym lies in the compact set C1, so a subsequence ymj converges to some y. Fix k. For mj≥k, ymj∈Ck, and Ck is closed by (a); the terms with mj≥k form a sequence in Ck converging to y, so y∈Ck. As k was arbitrary, y∈⋂kCk.

  • (d) Steps (a) and (b) survive for Ck=[k,∞) with n=1: the sets are closed, and ym=m lies in the first m of them. Step (c) fails, because C1=[1,∞) is not compact: the sequence ym=m has no convergent subsequence, and the points escape to infinity instead of accumulating at a common point.

Exercise (C3: The counts are sharp)

Let V be a real vector space of dimension n, and let (x0,…,xn) be affinely independent.

  • (a) Prove that each point of conv{x0,…,xn} has exactly one expression ∑itixi with t∈Δn+1.
  • (b) Deduce that 1n+1∑ixi is not a convex combination of any n of the points. (This recovers Example (The bound is attained).)
  • (c) Prove that x0,…,xn have no Radon partition, so that n+2 in Theorem 18.2.4 cannot be lowered.

Solution.

  • (a) If ∑itixi=∑iti′xi with t,t′∈Δn+1, then ∑i(ti−ti′)xi=0 and ∑i(ti−ti′)=1−1=0. By affine independence every ti−ti′=0.

  • (b) The point has the expression with all weights 1n+1. A convex combination of n of the points is an expression of the form in (a) with the omitted point given weight 0. By the uniqueness in (a), it would have to coincide with the all-1n+1 expression, which has no zero weight.

  • (c) Suppose I,J are disjoint, non-empty, and ∑i∈Iaixi=∑j∈Jbjxj with non-negative weights, each family adding up to 1. Then ∑i∈Iaixi−∑j∈Jbjxj=0 is a relation among the xi whose coefficients add up to 1−1=0; an index lying in neither set gets coefficient 0, and no index lies in both, since I∩J=∅. By affine independence, all these coefficients are 0, so every ai=0, contradicting ∑i∈Iai=1. Hence no Radon partition exists.

Found a typo or a mistake? Report it, or read this page’s source

The text of this book is licensed under CC BY-NC-SA 4.0.