In a finite-dimensional space, the dual basis gives
an isomorphism , sending to . But that
isomorphism depends on the basis: change the basis and
the same vector goes to a different functional. Nothing
stops us from taking duals twice. The dual is a vector space,
so it has a dual of its own, , and two chosen
bases give . This section shows that the
composite isomorphism needs no choice at all:
it is built from evaluation alone. We use it to make one
meaning of the word “natural” precise, and to prove that
a subspace can be recovered from its annihilator. At the
end we see that in infinite dimension the construction
still makes sense, but it is no longer an
isomorphism.
Measuring
the measurements
We have studied a space and its space of
measurements (Definition 5.1.2). The
next object is the space of measurements
of .
Look at the expression , with and
. It has
two inputs. If we fix and let vary, we get the
functional
itself. If we fix and let vary, we get a
rule that takes a functional and returns a number. For
example, take . A functional on is
for unique (Theorem 5.1.1), and the
rule returns . So the fixed vector measures each
measurement. This rule appears every time we test a
vector against functionals, so it deserves a name.
A vector measures a functional by letting the
functional act on it.
Definition
5.3.1 (Double Dual and Evaluation Map)
Let be a
vector space over . The double
dual of
is , the space of linear functionals on
.
For ,
evaluation at is the
function The evaluation map of is When only one space is in play we write for .
In words, clause by clause:
- consists
of linear maps . Its elements
take a whole functional as input.
- is
defined on , not on
. The vector is fixed once and for
all; the variable is .
- The evaluation map sends each vector to the function . A bold
subscript
is a single element of ; an italic capital
is the whole
map.
Well-definedness. The definition
claims that , so we must check that is linear. The
operations on are pointwise (Definition 2.4.1). So
for and , Notice what the definition did
not use: no basis, no coordinates, no
choice of any kind. Only and the meaning of
“functional” appear.
Example
(Evaluation in Three Spaces)
- (a) Let . Describe for in terms of
row vectors.
- (b) Let , and
let be the dual basis of , so that
is the
coefficient of
in (Example (Dual Bases in )).
Compute
on and on the functional .
Which element of is ?
- (c) Describe , and the
evaluation map of .
Solution.
(a) By Theorem 5.1.1, every has
the form for a unique . So : the vector measures the row by standing to its
right in the product. The same product is read as “ measures ” or “ measures ”, depending on
which factor we hold fixed.
(b) , the coefficient of in . So the values on
are . Also . A linear functional on
is determined
by its values on the basis of (Theorem 2.1.5). The
values say
that is
the third vector of the dual basis of (Theorem 5.1.3). In the
same way, and
are the first
and second vectors of that dual basis. We will see that
this is no accident.
(c) for every , because a linear
map sends to
(Theorem 2.1.1). So
is the
zero functional on . If , the only
functional on is
the zero functional, so and , and is the only map
.
This degenerate case is a first sign that loses nothing: the
only vector it sends to zero is .
Here is a non-example by minimal change. On , replace by . It is still a function , and it is
still built without any choice. But take and . Then
, while . The
clause that fails is linearity on , so .
Why this definition. Given only a
vector and a
functional ,
the one number we can form without choosing anything is
;
anything else, such as , is built
from it and usually breaks linearity. The pointwise
operations of Definition 2.4.1 are
exactly what make linear. The name “double
dual” is literal: it is the dual of the dual.
Warning. Two different
“evaluations”. On , the functional lies in : it evaluates
polynomials at a number. The element
lies in : it evaluates
functionals at a polynomial. They meet
in one number, , read from opposite sides.
Also, is
not the vector :
it is a function on .
Quick check. Let .
Compute for
. Is there a non-zero with
?
Solution. . Yes: is
non-zero and . A single kills many
functionals; what the next theorem says is that for
it does
not kill all of them.
The first result says that is a linear map, and
that it is injective in every vector space, of any
dimension.
Theorem
5.3.1 (The Evaluation Map Is Linear and
Injective)
Let be any
vector space over . Then the evaluation
map is linear and injective.
Idea. Linearity is an identity
between two elements of , that is, between
two functions on ; compare them at an
arbitrary .
For injectivity, use the kernel test. If , then
every functional vanishes at . This is the signature
move of the chapter: to show a vector is zero, test it
against every functional. In finite dimension Theorem 5.1.5 does the
job. In general we repeat its proof with the Basis
Extension Theorem for arbitrary spaces.
Proof. Linear. Let and . For every
,
since is
linear and the operations on are pointwise (Definition 2.4.1),
Two functions on that agree at every
are equal,
so .
Injective. By Theorem 2.2.3 it
suffices to show that implies
. We prove
the contrapositive. Let . If is finite-dimensional,
Theorem 5.1.5 (a) gives
with . In general, is linearly
independent, so by Theorem 1.8.2 there
is a basis of
with . By Theorem 2.1.6, which
allows infinite bases, there is a linear map
with and for every . In either case and
, so . This
proves that
is injective.
In infinite dimension the proof repeats the remark
after Theorem 5.1.5, and Zorn’s
Lemma enters through Theorem 1.8.2. In
finite dimension no choice principle is needed.
So every vector is completely
remembered by the list of all its measurements . In finite
dimension a count turns “injective” into
“bijective”.
Theorem
5.3.2 (The Double Dual Isomorphism)
Let be a
finite-dimensional vector space over . Then the evaluation
map is an isomorphism. Moreover, if
is a basis of
with dual basis , then is the dual basis of .
Idea. Count instead of check. The
dual basis has as many vectors as the basis, so , and
the same holds one level up. An injective linear map
between spaces of the same finite dimension is
bijective. For the second statement, “dual basis” is the
condition , and for
that condition is the definition of read
backwards.
Proof. Let . By Corollary 5.1.4, is
finite-dimensional with , and applying it again to gives . By Theorem 5.3.1, is linear and
injective. Since is finite, Corollary 2.3.2 (e)
shows that is
bijective, hence an isomorphism (Definition 2.5.2).
For the second statement, for
all , by the
definition of the dual basis. By the uniqueness in Theorem 5.1.3 (a), applied
to the basis of , the dual basis of
(Definition 5.1.3) is the
only list in with . Hence it is , as claimed.
The theorem says: every linear
functional on
is evaluation at exactly one vector. To find the vector,
read off its coordinates from the values on a dual
basis. For instance, on with the coefficient functionals
of Example (Evaluation in Three Spaces),
let be the functional with ,
, .
By the second statement, , since both sides agree on the
basis and is linear. So, for
example, , where .
Part (b) of Example (Evaluation in Three Spaces)
was the case .
What
“natural” means
Both and hold in finite dimension, and both
follow from counting dimensions. Yet they are very
different isomorphisms. The difference is whether a
choice is needed.
The isomorphism depends on the basis. For a
basis of , let be the linear map with (Theorem 2.1.5). It
sends a basis to a basis, so it is an isomorphism, by
the argument in the proof of Theorem 2.5.4. Now
take , a
space of dimension . With the basis , the dual basis is
, and
is
. With
the basis , the
dual basis is , since that is the functional sending to . So , and by linearity is . The same
vector goes to
two different functionals. Every basis is as good as any
other, so none of these isomorphisms is preferred.
The isomorphism does not. Build it the same
way, choosing bases twice. First sends . Then, using the basis of , the map sends each to the -th vector of the dual
basis of .
By Theorem 5.3.2, that vector
is . So
the composite
sends for every . The linear map does the same, so
by the uniqueness part of Theorem 2.1.5, Each factor depends on , but the composite
does not: the two choices cancel. This is the first
meaning of natural: an isomorphism is
natural if it can be defined without choosing anything,
and is
defined by the formula alone.
There is a second, sharper meaning. A choice-free
construction should be compatible with every linear map:
if , then first applying and then identifying
with should agree with
first identifying
with and
then applying “the map that induces on double
duals”. To state this we need to know how a linear map
acts on functionals. That is the dual
map, the subject of the next section, where we
prove that is
compatible with every linear map, and see that no family
of isomorphisms can be.
Quick check. In with the basis
, compute
as an element of , and evaluate it
on .
Compare with .
Solution. The dual basis of is , so
.
The dual basis of is the with
, and , so and . Hence , using linearity of . On it gives . The factor from the first
step and the factor hidden in cancel, exactly as
the general computation predicts.
Consequences in finite dimension
Throughout this subsection, is finite-dimensional.
The isomorphism lets us run
arguments about “one level up” and
bring the answer back to .
The dual basis construction goes from a basis of
to a basis of
. Does every
basis of
arise this way? A list of independent
measurements should be the coordinate functions of some
basis, and the double dual shows it is.
Corollary
5.3.3 (Every Basis of the Dual Is a Dual
Basis)
Let be a
finite-dimensional vector space over , and let
be a basis of . Then there is
exactly one basis of whose dual basis is
, that is, with
Idea. Go up one level, where the
problem is already solved. The basis
of has a dual
basis in . Every is evaluation at
some vector, because is onto. Those
vectors are the answer, since says . Uniqueness is a “test against
functionals” argument.
Proof. Existence. Here
is
finite-dimensional (Corollary 5.1.4). By Theorem 5.1.3 applied to
, there is a
basis of with . By Theorem 5.3.2, is an isomorphism,
so there are unique with . Its inverse is an isomorphism (Theorem 2.5.3), so
is a basis of by
Theorem 2.5.2. For all
, By the uniqueness in Theorem 5.1.3 (a), the
dual basis of is .
Uniqueness. Suppose is
also a basis with . Fix . Then for every . Every is a
combination of the , so
for every . By Theorem 5.1.5 (b), . Hence
for
every .
In coordinates this is a matrix inversion, the mirror
image of Example (The Dual Basis Is Read Off the Inverse Matrix).
There, a basis was given and its dual basis appeared as
the rows of an inverse matrix. Here the functionals are
given, and the basis appears as the columns of an
inverse matrix.
Example
(A Basis With Prescribed Dual Basis)
On , consider the functionals Show that is a basis of , and find the basis
of
whose dual basis
it is.
Solution. Write down a
matrix. For , with in , So , where is row of Translate the condition. Let be the matrix whose
-th column is
.
By Theorem 0.9.2, the
entry of
is . So the condition
says exactly .
Solve. Row reduction (Theorem 3.4.6)
gives and one checks , so
is invertible by
Theorem 3.4.5.
Multiplying on the left by forces . Since the
columns of the invertible matrix are independent, is a
basis of (via the
coordinate isomorphism, Corollary 2.5.5). By
the uniqueness in Theorem 5.1.3 (a), its
dual basis is , which in particular is a basis
of . Reading
the columns, Check. , , ; , , ;
, , .
So every is : the
coordinates of in
this basis are the three measurements.
The next consequence is the one we will use most. A
subspace
determines the set of functionals
vanishing on it. Going back, the functionals in vanish together on
some set of vectors, which contains . Is it exactly ?
Corollary
5.3.4 (The Annihilator of the
Annihilator)
Let be a
finite-dimensional vector space over , and let be a subspace of . Write . Then So, under the identification , we have . Equivalently,
Idea. One inclusion is a tautology:
if and
kills , then . For the other, count. The dimension formula
applied twice, once in and once in , gives , and
is injective,
so too. One inclusion plus equal dimension gives
equality.
Proof. Let , so by Corollary 5.1.4.
Inclusion. Let . For every , by Definition 5.2.1. Hence
, and .
Dimensions. By Theorem 5.2.2 in , .
By Theorem 5.2.2 in the -dimensional space , applied to its
subspace ,
The restriction of to is linear and injective
(Theorem 5.3.1), so it is
an isomorphism onto its image , and
(Theorem 2.5.4). So
is a
subspace of
of the same finite dimension, and Theorem 1.6.8 gives
.
The equivalent form. Let . Then for every
if and only if , if and only if for
some .
Since is
injective, this happens if and only if .
The last form says: a subspace is exactly the
common zero set of the functionals that vanish on
it. No vector outside sneaks through all the
equations. In section 6 of this chapter this becomes the
statement that every subspace of is the solution set
of a homogeneous linear system. An immediate consequence
is that the annihilator loses no information.
Corollary
5.3.5 (Subspaces Are Determined by Their
Annihilators)
Let be a
finite-dimensional vector space, and let and be subspaces of . Then if and only if
.
Proof. is
immediate. Suppose
. By
Corollary 5.3.4, .
Quick check. Is Corollary 5.3.5 still true
if and are allowed to be
arbitrary subsets of ?
Solution. No. In , take and . A
functional vanishes at exactly when , and at exactly when , that is, again
when . So
but
. An
annihilator only sees the span, (Theorem 5.2.3 (b)).
Infinite
dimension: the evaluation map is not onto
Nothing in Definition 5.3.1 or Theorem 5.3.1 needed
finite dimension. The count in Theorem 5.3.2 did.
Warning. through
is a
finite-dimensional fact. For , the evaluation
map is injective but not surjective:
there is a linear functional on that is not
evaluation at any polynomial. The next example
constructs one.
Example
(A Functional on That Is Not an Evaluation)
Let () be the coordinate functionals, the
coefficient of
in , and let ,
as in Proposition 5.1.6. Show
that there is with for
every .
Solution. Step 1: is linearly
independent. By Proposition 5.1.6, the
form an
independent set and . Let be a finite list of
distinct elements of . If is not in
, then is independent.
Otherwise, list last; the
others are independent and is not in
their span, so is
independent by Lemma 1.5.3.
Step 2: build . By Theorem 1.8.2 there
is a basis of
containing
. By Theorem 2.1.6 for the
(infinite) basis ,
there is a linear with
and for every . In
particular for all .
Step 3: is not an
evaluation. Suppose for some
. Then
for every , the
coefficient of
in is . So , and . This
contradicts . Hence , and is not
surjective.
The functional exists, but nobody
can write it down: it comes from Zorn’s Lemma through Theorem 1.8.2. The
deeper reason for the failure is size. is so much
bigger than
(Exercise (C4: How large is ?) identifies it with the whole
sequence space ) that is bigger
still, and in fact no isomorphism
exists at all, a statement about the sizes of bases that
we do not prove. In finite dimension, sizes cannot grow,
and the evaluation map is the perfect dictionary of Theorem 5.3.2.
Exercises
A. Check your
understanding
Exercise
(A1)
- (a) Define for , and the
evaluation map . In which space
does
live?
- (b) State a
hypothesis on
under which
is an isomorphism, and a space for which it is not.
- (c) True or false:
if is
finite-dimensional and , then
for every non-zero .
Justify your answer.
- (d) True or false:
if and are subspaces of with , then . Justify your
answer.
- (e) Name the method
used to prove in Corollary 5.3.4.
Solution.
(a) , , and , (Definition 5.3.1). lives in .
(b) If is finite-dimensional,
is an
isomorphism (Theorem 5.3.2). For it is not
surjective (Example (A Functional on That Is Not an Evaluation)).
(c) False. It
says only that some has (Theorem 5.3.1). In , and give .
(d) True, by Corollary 5.3.5, since
is
finite-dimensional.
(e) One inclusion
plus equal dimension:
directly, then from the dimension
formula for annihilators (twice) and injectivity of
, and Theorem 1.6.8.
B. Practice
Exercise
(B1: A basis with a given dual basis)
- (a) Let and
on . Find the basis
of
whose dual
basis is .
- (b) Let and
on . Find the
basis of
whose dual basis is .
Solution.
(a) As in Example (A Basis With Prescribed Dual Basis),
with the rows
of , and the
condition says for . Here , so by Theorem 0.9.8 , so and . These are independent (the columns of
an invertible matrix), hence a basis. Check: , , , . By the
uniqueness part of Theorem 5.1.3, the dual
basis of is .
(b) For , and . So and whose columns are the coordinates of and in . Check: , , , . As in (a), is a basis
with dual basis .
Exercise
(B2: for
a line)
Let .
- (a) Find a basis of
.
- (b) Find all with for every
,
and check that the answer is .
- (c) Hence verify
that , and confirm the dimension count.
Solution.
(a) A functional
(Theorem 5.1.1) lies in
iff it
vanishes at (Theorem 5.2.3 (b)), that
is, .
The solutions are , so and span (we replaced by its
negative). They are independent, since neither is a
multiple of the other, so is
a basis of .
This matches (Theorem 5.2.2).
(b) Every is a
combination of , so for all
iff , that is, and . With : , , so . The set
is exactly .
(c) Let . By Theorem 5.3.2, for
some , and
means for all . By (b), , so ;
the reverse inclusion is immediate from Definition 5.2.1.
Dimensions: .
Exercise
(B3: Recognizing an evaluation)
Let , with the coefficient functionals of Example (Evaluation in Three Spaces).
Let be the linear functional with ,
, .
Find with
.
Hence compute and
, where
and .
Solution. By Theorem 5.3.2,
is the dual basis of . Hence takes the values on . So does , and a linear
functional is determined by its values on a basis (Theorem 2.1.5). Since
is linear (Theorem 5.3.1), Hence and .
C. Going deeper
Exercise
(C1: Subspaces of
and of )
Let be a
finite-dimensional vector space over . Prove that is a
bijection from the set of subspaces of to the set of subspaces
of , and that
it reverses inclusions in both directions: if and only
if .
Hint: for surjectivity, given a subspace ,
consider .
Solution. Let
(Corollary 5.1.4). By Proposition 5.2.1, is a subspace of
, so the map
is well defined.
Injective. This is Corollary 5.3.5.
Inclusions. If , then by
Theorem 5.2.3 (a).
Conversely, suppose , and let . Every lies in
, so . By Corollary 5.3.4 (the
equivalent form, for ), . Hence .
Surjective. Let be a subspace of , and let . For , iff for
all
iff , where . So ,
and since is
an isomorphism (Theorem 5.3.2), is a subspace and restricts to an
isomorphism . By Theorem 5.2.2 in , . By definition of , every vanishes on
, so . By Theorem 5.2.2 in , . By Theorem 1.6.8, . This proves
the claim.
Exercise
(C2: Spans cut out by equations)
Let be
finite-dimensional and any subset.
- (a) Prove that .
- (b) Deduce: a vector
lies in if and only if
every functional that vanishes on vanishes at .
- (c) Show by an
example that (a) can fail if “” is replaced by
“”.
Solution.
(a) is a subspace
(Theorem 1.3.1), and
by Theorem 5.2.3 (b).
Applying Corollary 5.3.4 to ,
(b) This is (a)
read for a single vector .
(c) Take . Then consists of the
functionals , and their common zero set is the whole
-axis, which
contains .
Solution.
(a) If for all
, then
in particular for every , so every coefficient
of is and . Conversely for every
.
(b) Suppose . Every
vanishes on , so
by (a). Hence and (every
functional vanishes at ). But
and , by Proposition 5.1.6. So
, a contradiction.
(c) The dimension
count. In Exercise (C1: Subspaces of and of ) we used that
is onto and
that to force from . Here and : the inclusion holds, but there is no
finite dimension to compare, and a proper subspace of an
infinite-dimensional space can be “as large as” the
whole space.