In the first section of this chapter, signed area
obeyed three rules: it is linear in each side, it
vanishes when two sides are equal, and the unit square
has area . In the
second section we named functions obeying the first two
rules, alternating multilinear forms, and in the third
we built the sign of a permutation. This section puts
the pieces together. We prove that on there is
exactly one alternating -linear form that takes
the value on the
standard basis, and we find a formula for it. That form
is the determinant.
The goal
and the plan
Here is the statement we are after.
There is exactly one function (with factors) that is -linear (Definition 7.2.1),
alternating (Definition 7.2.2),
and satisfies .
It has two halves of a very different nature.
Uniqueness says: if such a exists, its values are
forced. Existence says: some function
really has all three properties. We prove uniqueness
first, because its proof is how we find the
formula. Suppose
exists, expand everything using the rules, and see what
is left. The formula that comes out is then the only
candidate, and existence reduces to checking that the
candidate obeys the rules.
Throughout, a list of columns
and the matrix carry the same
information, and we pass between them freely. We write
for the
-th entry of , so that
Rearranging
the arguments
Expanding a form on basis vectors will produce values
like : the standard basis in a scrambled order.
Alternating forms handle scrambling by a sign, and the
sign is exactly the one built from inversions.
Lemma
7.4.1 (Permuting the arguments of an
alternating form)
Let be an
alternating -linear form on a vector
space over , let ,
and let . Then
Idea. A transposition swaps two
arguments, and each swap costs a factor by Theorem 7.2.1. Every
permutation is a product of transpositions, so the value
picks up for
a product of of
them. Multiplicativity of the sign says that is , whichever
product we chose.
Proof. If , then and , since the
identity has no inversions (Definition 7.3.2);
there is nothing to prove. Let . For , write .
First let and let be a transposition. The -th argument of is . For
this is
; for
it is ; for it is . So the
arguments of are those of
with
positions and
exchanged. By Theorem 7.2.1,
swapping two arguments changes the sign, so
Now let . By Theorem 0.10.4, for some
transpositions with . Put and , so that .
Applying
times, On the other hand, by Theorem 7.3.1 and Corollary 7.3.2,
. This
proves the lemma.
The proof chose a factorization of into
transpositions, and different choices can have different
lengths. The answer does not depend on the choice,
because only the parity of enters, and Corollary 7.3.3 says
the parity is determined by . In the proof this
is absorbed into the equation .
Uniqueness
We now expand an alternating form completely. It
helps to see the case first.
Idea. For , write and . Linearity in the
first argument, then in the second, gives four terms:
The first and last terms vanish because two
arguments are equal, and . What is left is , the formula for .
In general the four terms become one term for each
way of choosing, for every argument , which basis vector
to
take from . A
choice is a function , and
there are of
them. The ones that pick some basis vector twice die.
The survivors pick every basis vector once, so they are
permutations, and Lemma 7.4.1 converts
each into a sign.
Proof. Write for
. We first
expand the arguments one at a time.
Claim. For each ,
where the sum runs over all
functions . For we read the right side as the single term
.
Proof. We use induction on . For both sides are
. Suppose the claim holds for some . In each term,
the argument in position is . Since is linear in argument
, Substituting this into the induction
hypothesis gives a sum over all pairs with and . Such a pair is the same thing as a
function , namely for
and ; and each
arises from
exactly one pair. The term for the pair is . This is
the claim for .
Taking in
the claim, We sort the functions into two
kinds.
Case 1: is not
injective. Then
for some ,
so the arguments in positions and of are equal. Since is alternating, this
value is , and the
whole term is .
Case 2: is
injective. Since is finite, is bijective by
Theorem 0.4.9, so
for some . By Lemma 7.4.1 with
,
Hence only the terms of Case 2 survive in , there is
exactly one for each , and which is the stated formula after moving the
scalar to the front. This proves the
theorem.
So the three rules leave no freedom at all. If a
normalized alternating form exists, it
must be Out of terms, the rules
killed all but .
For that is
out of .
Existence
The candidate has been found. Now we check it against
the rules, forgetting where it came from.
Idea. Linearity is visible: each
product takes exactly one entry from each column. For
alternation, suppose columns and are equal. Pair each
with . The two
permutations have opposite signs. Their products use the
same entries, except that the entries taken from columns
and trade places, and those
two columns are equal. So each pair contributes .
Why pair terms instead of arguing “swapping the equal
columns changes
to , so and ”? Because gives , and over a field
with ,
such as , that
says nothing. The pairing argument never divides by
.
Proof. Multilinearity. Fix
and fix
all columns except the -th. For a fixed , the product contains exactly one entry of
, namely , the -th coordinate
of . So the
term for
equals , where does not depend on . The map is linear, since coordinates of
a sum are sums of coordinates and coordinates of are times the coordinates.
So each term is linear in , and hence so is
their sum .
Alternation. Suppose with , that is, for all
. Let , let be the even permutations (Definition 7.3.3), so
that consists
of the odd ones. Since by Theorem 7.3.1 and Corollary 7.3.2, the
map sends to . It is
a bijection , because
sends back to and .
Every has sign or , so Fix and compare the two products factor by
factor. For , , so the factors agree. For , the second product
has , which is the factor of the
first product at . For , the second product has , the factor of the first product
at . So the
two products consist of the same factors in a different
order, and they are equal because multiplication in
is commutative.
Every bracket is ,
and .
Normalization. For , is if and otherwise. The product
is therefore if for all
, and otherwise. Only contributes,
and .
Hence . This proves the theorem.
Uniqueness and existence together answer the question
of the first section: the rules of signed area single
out exactly one function.
The
determinant
We now have a function of square matrices that is
forced on us by three reasonable rules, and it deserves
a name. It is the central notion of this chapter.
The determinant is the only way to attach a
number to vectors
in that is
linear in each vector, vanishes when two vectors
coincide, and gives on the standard
basis.
Definition
7.4.1 (Determinant)
Let and
. The determinant of
is For columns we also write
for the determinant of the matrix .
In words: run over all permutations . For each, pick
from column the
entry in row ; this picks one
entry in every column and, because is a bijection,
one entry in every row. Multiply the picked entries, attach
the sign of ,
and add up. The determinant is defined only for
square matrices, and its value lies in the
field of the
entries.
Well-definedness. The formula is a
finite sum, so it always gives a number. What the name
“the determinant” really claims is that
nothing else satisfies the three rules, and that is Theorem 7.4.2; Theorem 7.4.3 shows
does satisfy
them. The sign is fixed by
counting inversions (Definition 7.3.2),
and by Corollary 7.3.3 any
factorization of into
transpositions gives the same sign, so either method may
be used to evaluate the formula.
Examples.
- . , so . A degenerate case, but it is the base of
every induction on size.
- . , with signs and . The identity picks
, and
picks . So the value derived from the rules in Example ( from the Rules),
and the number whose non-vanishing decides invertibility
in Theorem 0.9.8.
- . The six permutations of and their signs (a
-cycle has sign
, a transposition
) give the terms coming from in this order. For instance
has ,
,
, and
picks .
- A numerical . For , the six terms in the same order
are , , , , and , so .
- Identity and zero. by the
normalization in Theorem 7.4.3, and
, since
every product contains a zero factor.
Non-example by minimal change.
Delete the sign. The permanent is still -linear in the columns,
by the same argument as in Theorem 7.4.3, and
still gives at
. But it is not
alternating: , which is non-zero over although the two
columns are equal. The sign is exactly what makes the
pairing argument cancel.
Why this definition. Each rule has a
job. Without normalization, the uniqueness theorem only
pins the form down up to the scalar .
Without alternation, the permanent and many other
functions qualify. Multilinearity is what let us expand
at all. The choice of columns rather
than rows is a convention: we show below that the
transpose has the same determinant, so rows would give
the same function. We have avoided “Sarrus’s rule” on
purpose. It is a picture of the six-term formula for
and nothing
more, and for
its diagonal pattern would produce products while the
Leibniz formula has .
Warning. The determinant is
not linear. It is linear in each column
separately, not in the matrix. For , but . In general each product in the
Leibniz formula has factors, and scaling
scales every
factor, so So for matrices, not .
Quick check. Which permutations
give a non-zero term in the determinant of , and what is the determinant?
Solution. Column has its only non-zero
entry in row ,
column in row
, and column in row . A non-zero term needs
for every , so , , , that is,
, of
sign . The
determinant is .
The payoff for the forms of the second section is
immediate. There we saw that the alternating -linear forms on form a vector space
(Theorem 7.2.3) and
promised its dimension.
Proof. By Theorem 7.4.3, is an element of
this space, and it is not the zero form since . So the list is linearly
independent. By Theorem 7.4.2 and Definition 7.4.1,
every in the
space satisfies the displayed formula, so lies in the span of . Hence is a basis, and
the dimension is .
This corollary is the most useful form of uniqueness.
To prove that some function of columns is a multiple
of the determinant, check that is multilinear and
alternating, and compute . The
multiplicativity of the determinant in the next section
is proved exactly this way.
Transposes
and triangular matrices
The definition read the matrix column by column.
Reading it row by row gives nothing new.
Theorem
7.4.5 (Determinant of the Transpose)
For every , . Consequently, is also an
alternating -linear function of the
rows of , with value at .
Idea. A term of picks the
entries , one in
each row. The same positions are also “one
in each column”: position is with
. So
the term is the term of for , and has the same
sign as .
Proof. The -entry of is (Definition 0.9.10), so
by Definition 7.4.1
Fix . As runs through , runs
through exactly
once, and . Since multiplication in is commutative, we may
reorder the factors by : Next, by Theorem 7.3.1, and
both signs lie in , so . Therefore where the second equality substitutes ; this
is allowed because is a bijection of onto itself, being
its own inverse.
For the second statement, let be the
rows of . The
columns of
are , so .
The map is linear (Theorem 0.9.5), so by
Theorem 7.4.3 the
function is linear
in each . If
for
some , then
,
and the value is .
Finally . This proves the theorem.
So every statement about columns has a twin about
rows. In particular Theorem 7.2.1 applies
to rows: swapping two rows changes the sign of , and adding a
multiple of one row to another does not change it. The
next section turns this into a method of
computation.
Before that, one class of matrices whose determinant
can be read off directly. Recall that is upper triangular if
whenever
(Definition 0.9.5).
Theorem
7.4.6 (Determinant of a Triangular
Matrix)
If
is upper triangular or lower triangular, then
Idea. Which permutations can pick
only entries on or above the diagonal? Picking with for every
forces : the numbers
are in some order, so they have the same
sum, and none of them is allowed to exceed its
partner.
Proof. Suppose is upper triangular,
and let with . We claim for some
. Otherwise for all
. Since is a bijection of
, , so is a sum of non-negative
integers equal to . Hence for every
, contradicting
. For
such , by
upper triangularity, so the term of is . Only the identity
remains, and .
If is lower
triangular, then is upper triangular
with the same diagonal, and by Theorem 7.4.5. This
proves the theorem.
For example, : six terms, five of which vanish.
Diagonal matrices are a special case, . Together with Chapter 3’s result
that an upper triangular matrix is invertible exactly
when its diagonal entries are non-zero (Lemma 3.6.2), this
already shows that for upper triangular matrices, is invertible if and
only if . The next section proves this for all square
matrices.
Determinants over a commutative ring
The characteristic polynomial at the end of this
chapter is the determinant of a matrix whose entries are
polynomials, such as . Polynomials form
no field, since
has no inverse in . So we record
exactly what this section used.
In the characteristic-polynomial section we will
apply these results with . The next two sections flag, in the same
way, which of their proofs survive the passage to a
ring.
Exercises
A. Check your
understanding
Exercise
(A1)
- (a) State the three
properties that characterize ,
and write down the Leibniz formula.
- (b) How many terms
does the Leibniz formula have for ? How many of the
corresponding permutations have sign ?
- (c) True or false:
for all . Justify your answer.
- (d) True or false:
for all . Justify your answer.
- (e) In the proof of
Theorem 7.4.2, why
does a term with a non-injective vanish?
- (f) Explain why the
existence proof pairs with instead of
arguing “, so
”.
Solution.
- (a) is -linear in the columns,
alternating (zero whenever two columns are equal), and
. By
Theorem 7.4.2 and Theorem 7.4.3 it is
the only such function, and .
- (b) One term per
permutation: . In the proof of Theorem 7.4.3, is a bijection from the permutations of sign
to those of sign
, so each set has
elements.
- (c) False. For , but .
- (d) True. Each
Leibniz product has factors, each
multiplied by ,
so . (For it is false.)
- (e) If
with , the
form is evaluated with the equal arguments in
positions and
, and an
alternating form vanishes there.
- (f) only gives . Over a field in
which , such
as , this does
not imply .
The pairing shows that the terms cancel in pairs, which
works over every field.
B. Practice
Exercise
(B1: Six-term determinants)
Using the Leibniz formula, listing all six terms,
compute the determinants of Then compute in the same way, and hence verify Theorem 7.4.5 for
this .
Solution. We use the order and the six-term formula from
the examples after Definition 7.4.1:
For :
; ; ; ; ;
. Hence .
For : ; ; ; ;
; . Hence .
For : ;
; ; ; ;
. The sum is , as Theorem 7.4.5
predicts; the six terms are the same numbers, with the
two -cycles
exchanged, because .
Exercise
(B2: The determinant of )
Let and let be its permutation matrix (Definition 3.4.2).
- (a) Prove that .
- (b) Hence compute
and .
Solution.
- (a) By Theorem 7.4.3, is an alternating
-linear form on
. By Lemma 7.4.1 with
,
- (b) The first matrix
has columns , so it is with , , , that is,
.
A -cycle is (Example (Computing with cycles)),
a product of two transpositions, so its sign is and the determinant is
. The second
matrix has columns , so it is with , of
sign by
Theorem 7.3.1 and Corollary 7.3.2. Its
determinant is .
Exercise
(B3: A zero row)
Let have a zero row. Prove directly from Definition 7.4.1,
without using Theorem 7.4.5, that
. Then
prove the same for a zero column.
Solution. Suppose row of is zero, and let . Since
is
surjective, there is with . The factor
of the term for is , so the term is . This holds for every
, so .
Suppose column
is zero. For every , the term for
contains the
factor , so again every term vanishes and .
C. Going deeper
Exercise
(C1: Too many zeros)
Let .
- (a) Prove that if
more than
entries of are
zero, then .
- (b) Show that the
bound is sharp: give, for each , a matrix with exactly
zero
entries and non-zero determinant.
Solution.
- (a) If more than
entries are
zero, then fewer than entries are non-zero.
For ,
the term for
is a product of the entries in positions
. These positions are distinct,
since their column indices are distinct. They cannot all
hold non-zero entries, because there are fewer than
such entries. So
at least one factor is , and the term is . Hence .
- (b) has exactly zero entries, and
.
Exercise
(C2: Counting the cost)
A computer performs about multiplications per
second.
- (a) Show that
evaluating the Leibniz formula term by term for an matrix takes
multiplications. Estimate the time this takes for .
- (b) Gaussian
elimination (Chapter 3) brings to upper triangular
form. Suppose no row swaps are needed. At step (for ),
each of the
rows below the pivot requires one division to find its
multiplier and multiplications to update its entries in
columns . Show that the total number of
multiplications and divisions is ,
and evaluate it for .
In the next section we will see that the determinant
can be read off from this triangular form with further
multiplications.
Solution.
- (a) There is one
term for each , that is, terms, and each is a
product of
entries, which takes multiplications. For , . At per second this
takes about seconds, roughly years.
- (b) Step costs
operations. With running from to , the total is For this is , a few
microseconds. The Leibniz formula is a definition and a
proof tool, not an algorithm.
Exercise
(C3: The permanent, and a change of field)
For define .
- (a) Prove that is
-linear in the
columns and .
- (b) Let . Prove that over
, is
not alternating.
- (c) Prove that over
, for every . Explain why this does not
contradict (b) and Theorem 7.4.2.
Solution.
- (a) The proof of
multilinearity in Theorem 7.4.3 never
used the signs: for fixed , the term for is a constant
times , which is
linear in the -th
column. The normalization argument there also applies:
only
contributes at , with product .
- (b) Let have
every entry equal to . Its first two columns
are equal, but every term of is
, so in .
- (c) In , , so
for every , and
the two formulas agree term by term. There is no
contradiction: (b) is a statement over , where . Over , for , and
is alternating, as Theorem 7.4.3
guarantees. Uniqueness is about a fixed field, and over
each field there is exactly one normalized alternating
form.