Row Rank
We already know that the rank of a matrix is the dimension of its column space. Now we define the row rank as the rank of , which equals the dimension of the span of the row vectors of .
Think of each row of as a row vector. These row vectors span a subspace of — the row space of . The row rank is the dimension of this row space, i.e., the number of linearly independent rows.
At first glance, there is no reason to expect row rank and column rank to be equal. Rows and columns have completely different dimensions. But the Row Rank Theorem tells us they are always equal — a deep and non-obvious symmetry of every matrix.
Formal View
The proof uses matrix factoring — we will build it up in the next section.
Interactive Visualization
Transpose Visualizer
Why This Matters
The equality of row rank and column rank reveals a fundamental symmetry hidden inside every matrix.
- In data science, the rank of a data matrix counts the number of truly independent features regardless of whether we view data as rows or columns
- The theorem guarantees that the number of independent equations in a linear system equals the number of independent constraints — rows and columns carry the same information about rank
- It underpins the singular value decomposition: the non-zero singular values of and are identical
Quiz
A matrix has . What is ?
A matrix can have more linearly independent rows than linearly independent columns.
Common Mistakes
- Thinking row rank and column rank could differ — they are always equal, which is the content of the Row Rank Theorem.
- Confusing the row space (a subspace of ) with the column space (a subspace of ) — they live in completely different spaces.
- Assuming the row rank of a tall matrix () must be larger because there are more rows — rank is bounded by regardless.