Linear Algebra
5.310 min read

Row Rank

We already know that the rank of a matrix AA is the dimension of its column space. Now we define the row rank as the rank of AtA^t, which equals the dimension of the span of the row vectors of AA.

Think of each row of AA as a 1×n1 \times n row vector. These row vectors span a subspace of Rn\mathbb{R}^n — the row space of AA. The row rank is the dimension of this row space, i.e., the number of linearly independent rows.

At first glance, there is no reason to expect row rank and column rank to be equal. Rows and columns have completely different dimensions. But the Row Rank Theorem tells us they are always equal — a deep and non-obvious symmetry of every matrix.

Formal View

Definition 5.3 — Row Rank
Let AA be an m×nm \times n matrix. Its row rank is defined as Rowrank(A):=Rank(At)\text{Rowrank}(A) := \text{Rank}(A^t), the dimension of the span of the row vectors of AA.
Theorem 5.4 — Row Rank Theorem
For any matrix CC:
Rank(C)=Rowrank(C)\text{Rank}(C) = \text{Rowrank}(C)
The column rank and row rank of every matrix are equal.

The proof uses matrix factoring — we will build it up in the next section.

Interactive Visualization

Transpose Visualizer

Why This Matters

The equality of row rank and column rank reveals a fundamental symmetry hidden inside every matrix.

  • In data science, the rank of a data matrix counts the number of truly independent features regardless of whether we view data as rows or columns
  • The theorem guarantees that the number of independent equations in a linear system equals the number of independent constraints — rows and columns carry the same information about rank
  • It underpins the singular value decomposition: the non-zero singular values of AA and AtA^t are identical

Quiz

Question 1

A 4×64 \times 6 matrix AA has Rank(A)=3\text{Rank}(A) = 3. What is Rank(At)\text{Rank}(A^t)?

Question 2

A matrix can have more linearly independent rows than linearly independent columns.

Common Mistakes

  • Thinking row rank and column rank could differ — they are always equal, which is the content of the Row Rank Theorem.
  • Confusing the row space (a subspace of Rn\mathbb{R}^n) with the column space (a subspace of Rm\mathbb{R}^m) — they live in completely different spaces.
  • Assuming the row rank of a tall matrix (m>nm > n) must be larger because there are more rows — rank is bounded by min(m,n)\min(m, n) regardless.