Linear algebra is about equations like , and so far
we have met several number systems in which such
equations make sense: , , , and the arithmetic
of remainders . Which of them
can serve as the numbers of linear algebra? This section
answers by isolating the rules that solving linear
equations actually uses. A number system obeying those
rules is called a field, and fields are the scalars of
every later chapter.
What
solving linear equations needs
Here is a small system, solved the way you learned at
school: Subtracting twice the second equation from the
first gives .
Dividing by gives
, and then
.
Check: and .
Look at what we used. We added and subtracted
equations, multiplied an equation by a number, and
divided by a non-zero number. Silently
we also rearranged terms, regrouped them and expanded
brackets. Every step of Gaussian elimination is of this
kind, and every one of them works in , and .
Now try the integers. The equation involves only
integers, yet it has no integer solution, because the
step “divide by ”
leaves .
Elimination stalls as soon as a pivot has no inverse. So
what separates
from is
division, and division is exactly what we must
demand.
A field is a number system where you can add,
subtract, multiply, and divide by anything non-zero,
with the usual rules.
The
definition
Definition
0.7.1 (Field)
A field is a set together with two
functions, addition , , and multiplication , , satisfying the following
axioms.
- (F1) for
all .
- (F2)
for all .
- (F3) There exists an
element
such that
for every .
- (F4) For
every there exists an element such that .
- (F5) for
all .
- (F6) for
all .
- (F7) There exists an
element
with such that for
every .
- (F8) For
every non-zero there exists an element such that
.
- (F9)
for all .
Read the axioms in groups.
- (F1)–(F4) are about addition alone.
It is commutative and associative, it has a neutral
element , and
every element has a negative. Subtraction is then
defined by .
- (F5)–(F8) say the same things about
multiplication, with one change: only
non-zero elements are required to have
inverses. Division is defined by
for . We
never divide by ,
and the axioms never ask us to.
- (F7) also insists that : the two neutral
elements are different.
- (F9) is the one rule linking the
two operations. It is what lets us expand brackets.
Note the order of quantifiers in (F3):
one element works for
every .
This is stronger than “for every there is some element
with ”. In (F4) the
order is reversed, as it must be: the negative depends on .
We often say “
is a field” when the operations are clear, and write
when
they need to be named. Since addition and multiplication
are functions into , sums and products of
elements of stay
in ; when we build
a field inside a bigger number system, this “closure” is
the first thing to check.
First
consequences of the axioms
The notation in the definition hides a question. We
wrote “”, “” and “” as if each were a
single well-defined element. The axioms only say that
such elements exist. If a field could
contain two different elements behaving like , the symbol would be ambiguous, and
so would and
. The next
theorem removes this worry and proves the familiar rules
of algebra from the nine axioms.
Theorem
0.7.1 (Basic Properties of Fields)
Let be a field
and let .
- (a) The element
in (F3) is
unique, and the element in (F7) is unique.
- (b) (Cancellation)
If ,
then . If
and , then .
- (c) The negative
in (F4) is
unique, and for the inverse in (F8) is
unique.
- (d) .
- (e) .
- (f) If , then or .
Idea. Each part is a short chain of
axioms, and the chain is found backwards from the goal.
For uniqueness we use the standard move: suppose two
elements both have the property, and show they are
equal. For (d) there is no axiom about at all, so we
must create a situation where one applies. The trick is
to rewrite in a
fancy way as ,
expand with (F9), and cancel. For (f), the hypothesis
is there to
be spent on (F8).
We prove the uniqueness of , additive cancellation,
the uniqueness of negatives, (d) and (f). The remaining
statements are Exercise (B1: The Remaining Basic Properties).
Proof.
(a) Suppose and both satisfy (F3).
Applying (F3) for to the element
, and (F3) for
to the element
, and using
(F1), So the zero element is unique.
(b) Suppose . Adding
on the left of
both sides and using (F2), By (F1) and (F4), .
Hence , and by (F1) and (F3) this says .
(c) Suppose and both satisfy (F4) for
, that is, and . Then , so by additive
cancellation in (b).
(d) By (F3),
.
Therefore, by (F9), By (F3), also . Comparing, , and additive cancellation (b) gives
.
Finally by (F6), so .
(e) Suppose . If there is nothing to
prove, so suppose . By (F8), exists. Then, by
(F7), (F8), (F6) and (F5), where the last equality is (d). This shows
that or .
Two small consequences are used without comment from
now on:
and ,
by (F1), (F3), (F6) and (F7). More importantly, every
identity of school algebra that is proved from these
rules, such as or , now holds
in every field. Part (f) is the property we will use
most: a product of non-zero elements is non-zero.
Examples
We check the standard examples first, then an exotic
one, then a degenerate case.
Example
(The Fields ,
and )
Explain why ,
and , with their usual
addition and multiplication, are fields.
Solution. For , the axioms (F1)–(F9)
are the rules of arithmetic for real numbers that we
take as familiar, and .
For , the
sum, product and negative of fractions are fractions,
and so is the inverse of a non-zero
fraction . So the
operations of
restrict to functions , and lie in
whenever does. The identities in
(F1), (F2), (F5), (F6) and (F9) hold for all real
numbers, so in particular for rational ones. Hence is a field.
For , the
axioms (F1)–(F6) and (F9), together with the existence
of , are
Proposition 0.6.1. We
have . Finally (F8) is Proposition 0.6.3: a
non-zero has the
inverse . Hence is a field.
The next example is a field strictly between and . It shows that the
inverse axiom (F8) can take real work to check.
Example
( Is a
Field)
Let ,
with the addition and multiplication of . Show that is a field,
and find the inverse of .
Solution. Let and with
.
Closure. We have and , using .
The coefficients are rational, so .
Axioms that are identities. (F1), (F2),
(F5), (F6) and (F9) hold for all real numbers, hence for
the elements of .
Neutral elements and negatives. and lie in
, and
. The
negative lies in .
Inverses. Suppose . We first claim
.
If and
,
then
would be rational, contradicting Theorem 0.2.3. If
, then , so .
Therefore , and by Theorem 0.7.1 (f) in
, Since
is a non-zero rational number, the element satisfies . So
(F8) holds, and is a
field.
For we get , so . Check: .
The method is “rationalize the denominator”, the same
move as multiplying by the conjugate in . The irrationality of
is exactly
what guarantees the new denominator is not zero.
Quick check. Is , with the operations of , a field?
The degenerate case. Let with and . Every
axiom except one holds: (F1), (F2), (F5), (F6) and (F9)
are identities between elements that all equal , (F3) and (F4) hold
with , and
(F8) holds vacuously because there is no non-zero
element. The only failure is (F7): the one element that
could serve as is
, and the axiom
demands . So is not a field, and
every field has at least the two elements and . This one-element
system is the reason the clause is there.
Finite
fields
Every field so far is infinite. The arithmetic of
remainders gives finite ones, and they are genuinely
useful: computer science and coding theory do linear
algebra over them all the time.
Recall from Definition 0.5.2 and
Definition 0.5.5 that
for an integer , congruence modulo is an equivalence
relation on . We
write for the
class of and
for the
quotient set. By division with remainder (Exercise (C2: Division with remainder)),
, and these classes are distinct.
Also
exactly when
divides .
Example
(Arithmetic on and the Field
)
Let .
Define and . Show that these operations are
well defined, that they satisfy every field axiom except
possibly (F8) and the clause , and that holds exactly
when . Write
out the tables for .
Solution.
Well-definedness. The formulas use
representatives, so we must check that the answer does
not depend on which representatives we pick. For
addition this is Example (Addition modulo is well defined).
For multiplication, suppose and , so divides and . Then is divisible by , so .
Axioms. Every identity in (F1), (F2), (F5),
(F6), (F9) transfers from , because both sides
can be computed on representatives. For instance, for
(F9), The same one-line computation works for the
other four. The class satisfies (F3) since
,
the class is a
negative of as
in (F4), and
satisfies .
The clause . We have exactly when divides , that is, when . So exactly when
.
Tables for . Writing for , the set has the tables
The only surprise is , since is even. Here (F8)
holds as well, since the only non-zero element is and . Hence
is a
field.
So for ,
whether is
a field comes down to one question: does every non-zero
class have an inverse? To find an inverse of we need an integer
with , that is,
for
some integer . The
following lemma produces such and .
Lemma
0.7.2 (Bézout’s Lemma for Integers)
Let
with , and
suppose that the only positive integer dividing both
and is . Then there exist with
Idea. Consider all positive
integers of the form . There is a smallest one, , by well-ordering. The
plan: ① show
divides and ; ② conclude from the
hypothesis. For ①, divide by : the remainder is again
of the form
and is smaller than , so minimality forces
it to be .
Proof. Let . Since , we have , so is
a non-empty subset of . By the well-ordering
principle (Theorem 0.2.11), has a smallest element
.
Next we divide
by , using
well-ordering a second time. Let be the collection of
non-negative integers of the form with . Taking
gives , which is non-negative because forces ; so is non-empty, and by Theorem 0.2.11 it has
a least element . If , then would lie in and be smaller than
, contradicting
minimality. Hence , and ; this is the division with remainder of Exercise (C2: Division with remainder),
repeated here in the one case the proof needs. Now has the form . If , then and , contradicting the minimality of . Hence , and divides . The same argument with
in place of shows that divides .
Therefore is a
positive integer dividing both and . By hypothesis , so , as
claimed.
Now we can decide exactly when is a field.
Theorem
0.7.3 ( Is a Field
Exactly for Prime )
Let be
an integer. Then is a field if
and only if is
prime.
Idea. By Example (Arithmetic on and the
Field ),
only (F8) is in question. If is prime, a non-zero
class has not divisible by , so and share no factor, and
Bézout hands us the inverse. If factors, then
with both factors non-zero, which no field allows.
Proof. By Example (Arithmetic on and the
Field ),
satisfies
all field axioms except possibly (F8), including since .
Suppose is
prime, and let . Then does not divide . A positive integer
dividing is or , and does not divide , so the only positive
common divisor of
and is . By Lemma 0.7.2 there are
with
. Since
is
divisible by ,
So is
an inverse of ,
and (F8) holds. Hence is a field.
We
prove the contrapositive. Suppose is not prime.
Then for
some integers
with and . Since ,
does not divide ,
so ;
likewise . But . By Theorem 0.7.1 (f),
this cannot happen in a field. Hence is not a field.
This proves the theorem.
For a prime we
write , and usually drop the brackets,
writing its elements as and computing “mod ”. So are fields, while , and are not.
Quick check. Find the inverse of
in .
Solution. We need with leaving remainder
on division by
. Trying : . So in . (By Theorem 0.7.1 (c) this
is the only inverse.)
Because is
a field, the elimination from the start of the section
runs unchanged in it. Only the arithmetic is new.
Example
(Elimination over )
Solve the system , over .
Solution. In the inverses are
, , , , since and
. Multiply the first equation by : since , and , it
becomes .
Subtract times
this from the second equation: the -terms cancel, and we
get since and . Multiply by : . Then . Check: and in . Hence is the
unique solution.
Non-examples
Each of these fails some part of the slogan, and it
pays to name the exact clause that fails.
- . Everything
but (F8) holds:
is closed under
and , contains
, and negatives, and
inherits the identities from . But has no inverse in
, since is even and never
equals . Changing
to is the minimal change
that repairs it.
- . This
is with the
modulus changed from to . All axioms but (F8)
still hold (Example (Arithmetic on and the
Field )),
but
with . By Theorem 0.7.1 (f),
cannot have an
inverse; indeed is always one of
.
- real matrices, with the matrix
operations you know from school (they are treated
properly later in this chapter). The identity matrix
plays the role of . Two axioms fail. (F6)
fails: (F8) fails too: is not the zero matrix, but every
product has
second row zero, so is never the
identity.
Warning. “” does not
mean can be
divided by in . In the equation
has no
solution, and has two, and . Before dividing modulo , check that is prime, or at least
that and share no factor.
Why these
axioms
Each clause is there because something we rely on
breaks without it.
- Without (F8), elimination stalls,
as over
showed. Worse,
the theorems of the next chapters fail: over , the analogues of
vector spaces (called modules) need not have bases, and
“a set of
independent vectors in an -dimensional space spans
it” becomes false. This book always works over a
field.
- Without (F6), scalars would not
commute with each other. The matrices above show such
systems exist, and there are even systems with division
but without commutativity. Linear algebra constantly
swaps scalars, as in for a vector (Chapter 1), so we
keep commutativity.
- Without , the one-element system would count, and
every statement of the form “a field has a non-zero
element” would fail. Keeping it costs nothing.
- The name “field” is historical and
carries no extra meaning.
The
characteristic of a field
In we can
add to itself as
often as we like without reaching . In two copies already
give , and in
it takes
copies. This
number is the most basic invariant of a field, and it
decides whether familiar arguments such as “ implies ” are valid.
First some notation. For and , define the
integer multiple by and
. So with terms. This agrees with
the field product when , by Theorem 0.7.1 (d).
Lemma
0.7.4 (Integer Multiples)
Let be a
field, and
. Then
Proof. All three follow by
induction on one variable (Theorem 0.2.7). For
the first, induct on : the case is
by (F3), and if it holds for , then by (F2) and the
definition, For the third, induct on : the case is by Theorem 0.7.1 (d), and
if it holds for ,
then by (F6), (F9) and (F7), The second is the third with , combined
with , which follows from the first by
induction on .
Definition
0.7.2 (Characteristic)
Let be a
field. If there is a positive integer
with , the
characteristic of is the
smallest such . If there is no such
, the
characteristic of
is .
In words: count how many copies of must be added to reach
. If it never
happens, the convention is to say “characteristic ”, not “characteristic
”: in that
case the only integer with is .
- ,
, have
characteristic ,
because for every positive integer .
- has
characteristic :
,
which is
exactly when
divides , and the
smallest positive such is .
- is the
smallest case: characteristic , because .
Can a field have characteristic ? In , six copies of
give , but is not a field.
This is no accident.
Theorem
0.7.5 (The Characteristic Is or Prime)
The characteristic of a field is either or a prime number.
Idea. Suppose the characteristic
factors as with smaller factors.
Then the elements and are non-zero, by minimality of , but their product is
. A
field has no such pairs. This is the same argument as in
Theorem 0.7.3, run
inside an arbitrary field.
Proof. Let be a field of
characteristic . Since the integer multiple is
non-zero by (F7), we have , so . Suppose, for a contradiction, that is not prime. Then
with
integers and . By Lemma 0.7.4, By Theorem 0.7.1 (f),
or
.
Either way we have a positive integer smaller than whose multiple of is , contradicting the
minimality of .
Hence is
prime.
So the characteristic is , , , , , and so on. Together
with Exercise (C2: Finite Fields Have Prime Characteristic),
this says a finite field always has prime
characteristic.
Warning. In a field of
characteristic ,
such as , we
have , so
and for
every . The familiar argument
“, so , so ” divides by , which is there. For example, in
the element
satisfies but is not . This is why later
results, notably on symmetric bilinear forms in Chapter
14, carry the hypothesis “characteristic ”.
With fields in hand, the stage for linear algebra is
set: in Chapter 1, a vector space is defined
over a field , and every result
proved there holds at once for , , , and .
Exercises
A. Check your
understanding
Exercise
(A1)
- (a) Define what it
means for a set
with two operations to be a field.
- (b) True or false:
in every field, implies . Justify your answer.
- (c) True or false:
is a
field. Justify your answer.
- (d) True or false:
in every field, . Justify your answer.
- (e) What are the
characteristics of and of ?
- (f) The set with the usual
addition and multiplication is not a field. Name two
axioms that fail, each with a witness.
Solution.
(a) See Definition 0.7.1: two
operations satisfying (F1)–(F9), including .
(b) True. If
, then
or by Theorem 0.7.1
(f).
(c) False. Since
is
not prime,
is not a field by Theorem 0.7.3;
concretely with .
(d) False. In
, .
(e) has characteristic
, and has characteristic
(see the examples
after Definition 0.7.2).
(f) (F4) fails:
, but no
has . (F8) fails:
, but no
has .
B. Practice
Exercise
(B1: The Remaining Basic Properties)
Let be a field
and .
Using only the axioms and the parts of Theorem 0.7.1 proved
in the text, prove:
- (a) the element
in (F7) is
unique;
- (b) if and , then ;
- (c) for , the inverse
is
unique;
- (d) .
Hint: for (d), show that .
Solution.
(a) Suppose and both satisfy (F7).
Then, by (F7) for , (F6), and (F7)
for , .
(b) Suppose and . By (F8), exists, and
multiplying both sides by it gives .
By (F6) and (F5), ,
using (F8) and (F7) at the end. In the same way . Hence
.
(c) Suppose and both satisfy (F8) for
: . By (b),
.
(d) By (F7) and
(F6), . Therefore, using (F6) and (F9), where the last two equalities use (F4) and Theorem 0.7.1 (d). So
satisfies
(F4) for . By
uniqueness of negatives (Theorem 0.7.1 (c)),
.
Exercise
(B2: Solving Equations in )
- (a) Solve in .
- (b) Solve the system
, over .
Solution.
(a) Adding to both sides gives
in . Since
in , we have
.
Multiplying by ,
. Check:
in . Hence .
(b) Subtract
times the first
equation from the second: , that is, , or in . Since , , so . Then . Check: and in
. Hence .
Exercise
(B3: Which Are Fields?)
Determine which of the following are fields, with the
stated operations. Justify your answer.
Solution.
(a) Not a field.
Since
is not prime, Theorem 0.7.3 applies;
concretely with , which is impossible in a field by Theorem 0.7.1
(f).
(b) A field. Let
and
with
.
Then , and have rational parts, and with
. The
identities (F1), (F2), (F5), (F6), (F9) hold because
they hold in
(Example (The Fields , and )). If , then is a non-zero
rational number, and by Proposition 0.6.3
, which lies in . So (F8)
holds.
(c) Not a field:
(F8) fails for .
Suppose
with
satisfied .
This is also an equation in the field , where is an inverse of
; by uniqueness of
inverses in (Theorem 0.7.1 (c)),
. But
has real
part , a contradiction.
(d) A field, by
Theorem 0.7.3, since
is
prime.
C. Going deeper
Exercise
(C1: A Field with Four Elements)
Let , a set of four formal symbols
, where . Define with all coefficient arithmetic in . (The product is
what expanding gives if we replace by .)
- (a) Write out the
addition and multiplication tables of .
- (b) Prove that is a field.
- (c) Explain why
there is no bijection with and for all . So this
four-element field is not “ in
disguise”.
Hint: for (c), look for a non-zero element of
whose
square is zero.
Solution.
(a) Using the
formulas, with in : For instance, , and .
(b) Let , , with
. Since is a field (Example (Arithmetic on and the
Field )),
we may compute with the coefficients using the rules of
algebra.
Addition. It acts coordinate by coordinate,
so (F1) and (F2) follow from the same laws in , the element satisfies
(F3), and
satisfies (F4) because and in .
(F6). The formula for is unchanged when
and are swapped: and
.
(F7). With , , and since the
coefficients differ.
(F9). Since , and expanding the coefficients shows this is
.
(F5). Write with , . Then . Expanding,
where in the second we used in . Similarly with
, , and
. Expanding gives and , again
using . Hence .
(F8). From the table, , and , so every
non-zero element has an inverse.
This proves that is a field.
- (c) Suppose such a
bijection
existed. First, , so
additive cancellation in (adding , which only
uses (F1)–(F4), valid there by Example (Arithmetic on and the
Field ))
gives . Since is surjective,
there is
with . As , we have . But so because is injective.
This contradicts Theorem 0.7.1 (f) in
the field (from
(b)). Hence no such exists.
Exercise
(C2: Finite Fields Have Prime Characteristic)
- (a) Let be a finite field.
Prove that the characteristic of is a prime .
- (b) Let be a field of
characteristic . Prove that for every .
Hint: for (a), the elements cannot all be different.
Solution.
(a) The elements
for all
lie in the finite set , so they cannot all be
distinct. Hence there are positive integers with . By
Lemma 0.7.4, , so , and
additive cancellation (Theorem 0.7.1 (b))
gives with . Therefore the characteristic of is not . By Theorem 0.7.5, it is a
prime .
(b) Let . By Lemma 0.7.4 and the
definition of characteristic, , where the last step is Theorem 0.7.1
(d).
Exercise
(C3: The Frobenius Identity)
Let be a
prime.
- (a) Let with dividing . Prove that divides or divides .
- (b) Deduce that
divides the
binomial coefficient for .
- (c) Let be a field of
characteristic .
Prove that for all .
You may use the binomial theorem in any field,
with integer multiples as in Lemma 0.7.4; its
inductive proof uses only the field axioms.
Hint: for (a), use Lemma 0.7.2. For (b),
use .
Solution.
(a) Suppose does not divide . A positive integer
dividing is or , so the only positive
common divisor of
and is . By Lemma 0.7.2 there are
with
.
Multiplying by ,
.
Both terms on the right are divisible by , the first because
divides . Hence divides .
(b) First, by (a)
and induction on the number of factors, if divides a product of
integers then it divides one of the factors. The
integers are not divisible by , so divides neither nor for , and
hence, by (a) once more, not their product. Now divides . By (a), divides .
(c) Let . By the
binomial theorem, since . Fix . By (b),
for some .
By Lemma 0.7.4, because in characteristic and times anything is (Theorem 0.7.1 (d)). So
every middle term vanishes, and , as
claimed.