Linear Transformations
What you will be able to do
Given a map between vector spaces, the learner can decide whether it is linear and justify the verdict, construct its matrix from the images of a basis when it is, and determine the kernel and image with their dimensions, checking the result against rank–nullity.
Orientation
A function on
A linear one is fixed by three numbers' worth of choices, its values on a basis. Everything else follows, because every vector is a combination of those three and a linear map sends combinations to the corresponding combinations of images.
That collapse is what a matrix is. Its columns are the images of the basis vectors, and multiplying by it reconstructs the map's value anywhere. Reading a matrix as the record of a transformation, rather than as a grid of numbers with a multiplication rule, is what this unit adds.
Two subspaces come with any such map: what it sends to zero, and what it reaches. Their dimensions are not independent. They sum to the dimension of the space you started from.
Definition
Dependence of the matrix on the chosen bases
The definition leaves three points implicit, and each is a place the notation misleads.
The matrix is not the transformation.
Column
Order in a composition runs right to left.
Why kernel and image are subspaces. Both follow from the three conditions of the previous unit, and each takes one line.
For the kernel:
For the image:
Neither argument mentions coordinates, so both hold for maps between spaces of matrices, polynomials or functions.
Figure
A coordinate grid before and after a linear map
The grid before and after. This nonsingular example sends lines to lines and keeps parallel families parallel, which is linearity seen rather than asserted, and the origin does not move because
Stated for an arbitrary linear map the fact is weaker: a line maps to a line or to a point, collapsing when its direction lies in the kernel, and distinct parallel lines can land on the same image. Invertibility is what rules those cases out here.
Read the matrix off the picture:
Keep this image. The area factor of the transformed grid is the determinant, the directions it does not turn are the eigenvectors, and the ellipse a circle becomes under it carries the singular values. Three later units read this one picture.
Example
A catalogue of maps on the plane
Each map below is linear, each is given by its matrix, and each is worth recognising on sight.
Scaling by
Reflection in the
Rotation by
Projection onto the
Shear.
| Map | nullity | rank | |
|---|---|---|---|
| zero | 0 | 2 | 0 |
| projection | 0 | 1 | 1 |
| identity | 1 | 0 | 2 |
| rotation | 1 | 0 | 2 |
| reflection | 0 | 2 | |
| shear | 1 | 0 | 2 |
The determinant is zero exactly when the kernel is nontrivial, and in the plane the three rank values 0, 1 and 2 are the only ones available, collapse everything, collapse a line, collapse nothing. Rank–nullity accounts for each row: the entries in the last two columns sum to 2 throughout.
Two that are not on the list. Translation by a fixed vector is not linear, since it moves the origin. "Reflection in the line
Worked example
From a formula to a matrix, kernel and image
The map.
---
Step 1: test linearity. Take
Regrouping shows these agree. For scaling,
A numerical check on
Step 2: build the matrix. Apply
These are the columns:
Checking on
Step 3: kernel and image.
Rank–nullity:
---
A singular map, for contrast.
Kernel.
Image.
Rank–nullity:
Both maps are linear and both are given by equally ordinary formulas. One loses nothing and reaches everything; the other collapses a line to the origin and reaches only a line. The determinant distinguishes them before either kernel is computed, and rank–nullity then fixes the second dimension once the first is known.
---
Composition, briefly. Let
which differ.
Determinants multiply:
Derivation
The rank-nullity theorem
Claim. For a linear
The construction. Let
a basis of
They span the image. Any element of
Applying
So every image element is a combination of the
They are independent. Suppose
That is a vanishing combination of the full basis of
Being a spanning independent set,
What the proof used. Linearity, the existence of a basis, and the extension of a basis of a subspace to one of the whole space. No coordinates, no matrix, and no assumption about
Where it fails. Finite-dimensionality of
The immediate consequence. For
Non-example
Maps that fail linearity
A shift.
A squaring.
A norm.
Transposition, which is linear.
Linearity is not about looking like a formula with no exponents. It is two equations that either hold for all inputs or do not, and the cases divide by how they fail:
Optional enrichment (1)
Application
Differentiation as a linear map
Let
Linear.
Its matrix. Apply
Checking on
Kernel and image.
What this makes possible. Two facts usually met separately become one statement. That an antiderivative is determined only up to a constant is the kernel being one-dimensional. That every polynomial of degree at most 2 has an antiderivative is the image being everything of that degree. The
Beyond polynomials. The same reading applies to linear differential operators. The solutions of
The limit worth naming.