Bases

Definition 1. A (linear) basis (or a coordinate system ) in a vector space ๐’ฑ is a set ๐’ณ of linearly independent vectors such that every vector in ๐’ฑ is a linear combination of elements of ๐’ณ . A vector space ๐’ฑ is finite-dimensional if it has a finite basis.

Except for the occasional consideration of examples we shall restrict our attention, throughout this book, to finite-dimensional vector spaces.

For examples of bases we turn again to the spaces ๐’ซ and โ„‚ n . In ๐’ซ , the set { x n } , where x n ( t ) = t n , n = 0 , 1 , 2 , , is a basis; every polynomial is, by definition, a linear combination of a finite number of x n . Moreover ๐’ซ has no finite basis, for, given any finite set of polynomials, we can find a polynomial of higher degree than any of them; this latter polynomial is obviously not a linear combination of the former ones.

An example of a basis in โ„‚ n is the set of vectors x i , i = 1 , , n , defined by the condition that the j -th coordinate of x i is δ i j . (Here we use for the first time the popular Kronecker δ ; it is defined by δ i j = 1 if i = j and δ i j = 0 if i j .) Thus we assert that in โ„‚ 3 the vectors x 1 = ( 1 , 0 , 0 ) , x 2 = ( 0 , 1 , 0 ) , and x 3 = ( 0 , 0 , 1 ) form a basis. It is easy to see that they are linearly independent; the formula x = ( ξ 1 , ξ 2 , ξ 3 ) = ξ 1 x 1 + ξ 2 x 2 + ξ 3 x 3 proves that every x in โ„‚ 3 is a linear combination of them.

In a general finite-dimensional vector space ๐’ฑ , with basis { x 1 , , x n } , we know that every x can be written in the form x = i ξ i x i ; we assert that the ξ โ€™s are uniquely determined by x . The proof of this assertion is an argument often used in the theory of linear dependence. If we had x = i η i x i , then we should have, by subtraction, i ( ξ i η i ) x i = 0. Since the x i are linearly independent, this implies that ξ i η i = 0 for i = 1 , , n ; in other words, the ξ โ€™s are the same as the η โ€™s. (Observe that writing { x 1 , , x n } for a basis with n elements is not the proper thing to do in case n = 0 . We shall, nevertheless, frequently use this notation. Whenever that is done, it is, in principle, necessary to adjoin a separate discussion designed to cover the vector space ๐’ช . In fact, however, everything about that space is so trivial that the details are not worth writing down, and we shall omit them.)

Theorem 1. If ๐’ฑ is a finite-dimensional vector space and if { y 1 , , y m } is any set of linearly independent vectors in ๐’ฑ , then, unless the y โ€™s already form a basis, we can find vectors y m + 1 , , y m + p so that the totality of the y โ€™s, that is, { y 1 , , y m , y m + 1 , , y m + p } , is a basis. In other words, every linearly independent set can be extended to a basis.

Proof. Since ๐’ฑ is finite-dimensional, it has a finite basis, say { x 1 , , x n } . We consider the set ๐’ฎ of vectors y 1 , , y m , x 1 , , x n in this order, and we apply to this set the theorem of Section: Linear combinations several times in succession. In the first place, the set ๐’ฎ is linearly dependent, since the y โ€™s are (as are all vectors) linear combinations of the x โ€™s. Hence some vector of ๐’ฎ is a linear combination of the preceding ones; let z be the first such vector. Then z is different from any y i , i = 1 , , m (since the y โ€™s are linearly independent), so that z is equal to some x , say z = x i . We consider the new set \mathcal{S}^{\prime} of vectors y 1 , , y m , x 1 , , x i 1 , x i + 1 , , x n . We observe that every vector in ๐’ฑ is a linear combination of vectors in \mathcal{S}^{\prime} , since by means of y 1 , , y m , x 1 , , x i 1 we may express x i , and then by means of x 1 , , x i 1 , x i , x i + 1 , , x n we may express any vector. (The x โ€™s form a basis.) If \mathcal{S}^{\prime} is linearly independent, we are done. If it is not, we apply the theorem of Section: Linear combinations again and again the same way till we reach a linearly independent set containing y 1 , , y m , in terms of which we may express every vector in ๐’ฑ . This last set is a basis containing the y โ€™s. โ—ป

EXERCISES

Exercise 1. 

  1. Prove that the four vectors \begin{align} & x=(1,0,0) \\ & y=(0,1,0) \\ & z=(0,0,1) \\ & u=(1,1,1) \end{align}in โ„‚ 3 form a linearly dependent set, but any three of them are linearly independent. (To test the linear dependence of vectors x = ( ξ 1 , ξ 2 , ξ 3 ) , y = ( η 1 , η 2 , η 3 ) , and z = ( ζ 1 , ζ 2 , ζ 2 ) in โ„‚ 3 , proceed as follows. Assume that α , β , and γ can be found so that α x + β y + γ z = 0 . This means that \begin{align} & \alpha \xi_{1}+\beta \eta_{1}+\gamma \xi_{1}=0 \\ & \alpha \xi_{2}+\beta \eta_{2}+\gamma \zeta_{2}=0 \\ & \alpha \xi_{3}+\beta \eta_{3}+\gamma \xi_{3}=0 \end{align}The vectors x , y , and z are linearly dependent if and only if these equations have a solution other than α = β = γ = 0 .)
  2. If the vectors x , y , z , and u in ๐’ซ are defined by x ( t ) = 1 , y ( t ) = t , z ( t ) = t 2 , and u ( t ) = 1 + t + t 2 , prove that x , y , z , and u are linearly dependent, but any three of them are linearly independent.

Exercise 2. Prove that if โ„ is considered as a rational vector space (see. Section: Examples , (8)), then a necessary and sufficient condition that the vectors 1 and ξ in โ„ be linearly independent is that the real number ξ be irrational.

Exercise 3. Is it true that if x , y , and z are linearly independent vectors, then so also are x + y , y + z , and z + x ?

Exercise 4. 

  1. Under what conditions on the scalar ξ are the vectors ( 1 + ξ , 1 ξ ) and ( 1 ξ , 1 + ξ ) in โ„‚ 2 linearly dependent?
  2. Under what conditions on the scalar ξ are the vectors ( ξ , 1 , 0 ) , ( 1 , ξ , 1 ) , and ( 0 , 1 , ξ ) in โ„ 2 linearly dependent?
  3. What is the answer to (b) for โ„š 3 (in place of โ„ 3 )?

Exercise 5. 

  1. The vectors ( ξ 1 , ξ 2 ) and ( η 1 , η 2 ) in โ„‚ 2 are linearly dependent if and only if ξ 1 η 2 = ξ 2 η 1 .
  2. Find a similar necessary and sufficient condition for the linear dependence of two vectors in โ„‚ 2 . Do the same for three vectors in โ„‚ 3 .
  3. Is there a set of three linearly independent vectors in โ„‚ 2 ?

Exercise 6. 

  1. Under what conditions on the scalars ξ and η are the vectors ( 1 , ξ ) and ( 1 , η ) in โ„‚ 2 linearly dependent?
  2. Under what conditions on the scalars ξ , η , and ζ are the vectors ( 1 , ξ , ξ 2 ) , ( 1 , η , η 2 ) , and ( 1 , ζ , ζ 2 ) in โ„‚ 2 linearly dependent?
  3. Guess and prove a generalization of (a) and (b) to โ„‚ n .

Exercise 7. 

  1. Find two bases in โ„‚ 4 such that the only vectors common to both are ( 0 , 0 , 1 , 1 ) and ( 1 , 1 , 0 , 0 ) .
  2. Find two bases in โ„‚ 4 that have no vectors in common so that one of them contains the vectors ( 1 , 0 , 0 , 0 ) and ( 1 , 1 , 0 , 0 ) and the other one contains the vectors ( 1 , 1 , 1 , 0 ) and ( 1 , 1 , 1 , 1 ) .

Exercise 8. 

  1. Under what conditions on the scalar ξ do the vectors ( 1 , 1 , 1 ) and ( 1 , ξ , ξ 2 ) form a basis of โ„‚ 3 ?
  2. Under what conditions on the scalar ξ do the vectors ( 0 , 1 , ξ ) , ( ξ , 0 , 1 ) , and ( ξ , 1 , 1 + ξ ) form a basis of โ„‚ 3 ?

Exercise 9. Consider the set of all those vectors in โ„‚ 2 each of whose coordinates is either 0 or 1 ; how many different bases does this set contain?

Exercise 10. If ๐’ณ is the set consisting of the six vectors ( 1 , 1 , 0 , 0 ) , ( 1 , 0 , 1 , 0 ) , ( 1 , 0 , 0 , 1 ) , ( 0 , 1 , 1 , 0 ) , ( 0 , 1 , 0 , 1 ) , ( 0 , 0 , 1 , 1 ) in โ„‚ 4 , find two different maximal linearly independent subsets of ๐’ณ . (A maximal linearly independent subset of ๐’ณ is a linearly independent subset ๐’ด of ๐’ณ that becomes linearly dependent every time that a vector of ๐’ณ that is not already in ๐’ด is adjoined to ๐’ด .)

Exercise 11. Prove that every vector space has a basis. (The proof of this fact is out of reach for those not acquainted with some transfinite trickery, such as well-ordering or Zornโ€™s lemma.)