Rank, Nullity and the Four Fundamental Spaces

Count independent constraints and locate each fundamental space in its correct ambient space.

Builds on Subspaces, Null Spaces and Column Spaces

The bigger question: How many independent directions does a model really have?

On this page

Count pivots once, interpret them twice

For an m×nm\times n matrix AA, its rank rr is the number of pivots. It equals both the dimension of the column space and the dimension of the row space. The rank-nullity theorem states

dim⁡N(A)+rank⁡(A)=n.\dim N(A)+\operatorname{rank}(A)=n.

There are n−rn-r free input directions that map to zero. Applying the same theorem to ATA^T gives dim⁡N(AT)=m−r\dim N(A^T)=m-r.

The four spaces are C(A)⊆RmC(A)\subseteq\mathbb R^m, N(A)⊆RnN(A)\subseteq\mathbb R^n, C(AT)⊆RnC(A^T)\subseteq\mathbb R^n (row space), and N(AT)⊆RmN(A^T)\subseteq\mathbb R^m (left null space). Their dimensions are r,n−r,r,m−rr,n-r,r,m-r respectively.

Visual guide

VISUAL GUIDEA rank-one map collapses one direction
The map A(x, y) = (x + y, 0) sends every output to the horizontal axis. Its nullspace is the line y = −x: all those inputs map to zero. Input dimension 2 splits into rank 1 plus nullity 1.-2.5-2.5-1.25-1.25001.251.252.52.5xy
  • Nullspace y = −x
  • Column space y = 0
The map A(x, y) = (x + y, 0) sends every output to the horizontal axis. Its nullspace is the line y = −x: all those inputs map to zero. Input dimension 2 splits into rank 1 plus nullity 1.

Worked example: count and construct

Let A=(123246)A=\begin{pmatrix}1&2&3\\2&4&6\end{pmatrix}. Its rank is one. The column space is spanned by (1,2)T(1,2)^T, and the row space by (1,2,3)T(1,2,3)^T. The null space has basis (−2,1,0)T,(−3,0,1)T(-2,1,0)^T,(-3,0,1)^T. The left null space is spanned by (−2,1)T(-2,1)^T.

Check dimensions: the input has three coordinates, with one row-space direction and two null directions. The output has two coordinates, with one reachable direction and one left-null direction.

PAUSE & THINKA quick check, not a grade

Try it yourself.

Choose an answer and explain your reasoning to yourself. Use a hint if you get stuck.

A matrix has 5 columns and rank 3. What is its nullity?

Hint 1 · Find a starting point

Rank and nullity split the number of input coordinates.

Hint 2 · Take the next step

Use rank+nullity=number of columns.

Show the reasoning

Answer: 2

Nullity=5−3=2, the number of independent free directions in the null space.

Before moving on: what would make one of the other answers wrong? Saying why is part of understanding.

Worked example: a consistency certificate

A system Ax=bA\mathbf x=\mathbf b can be solvable only if every y∈N(AT)\mathbf y\in N(A^T) satisfies yTb=0\mathbf y^T\mathbf b=0, because yTAx=0\mathbf y^TA\mathbf x=0. This condition is also sufficient: the column space is the orthogonal complement of the left null space.

For the matrix above and b=(1,3)T\mathbf b=(1,3)^T, the left-null vector (−2,1)T(-2,1)^T gives dot product 1≠01\ne0. The system is inconsistent. For b=(1,2)T\mathbf b=(1,2)^T, the test gives zero and the target is reachable.

Practice

  1. A 4×64\times6 matrix has rank three. Find both nullities.
  2. Can a 3×53\times5 matrix be one-to-one on R5\mathbb R^5?
  3. When is a square n×nn\times n matrix invertible in terms of rank?
Show worked solutions
  1. dim⁡N(A)=3\dim N(A)=3 and dim⁡N(AT)=1\dim N(A^T)=1.
  2. No. Its rank is at most three, so its nullity is at least two.
  3. Exactly when its rank is nn, equivalently its null space contains only zero.
MAKE IT YOURS

Pause before the next idea.

Can you explain how the visualization connects to this lesson’s goal? If a step still feels uncertain, put this lesson on your review list and try the check again another day.

Optional marks, not a grade. Saved in this browser only. Open notebook →