The Transpose
The transpose of a matrix flips it across its main diagonal. Every row becomes a column and every column becomes a row. If is an matrix, then is an matrix, and the entry in row , column of equals the entry in row , column of .
A column vector is just an matrix. Its transpose is a matrix — we call this a row vector. Row vectors let us write dot products as matrix products: .
Up to this point, we have studied matrices entirely through their columns. The transpose lets us apply everything we know about column structure to the rows of the original matrix — it is our gateway to studying row space.
Formal View
Interactive Visualization
Transpose Visualizer
Why This Matters
The transpose is fundamental to nearly every branch of applied mathematics.
- Symmetric matrices arise in physics, statistics, and optimization — covariance matrices and moment-of-inertia tensors are all symmetric
- In machine learning, the normal equations for least-squares regression involve and
- Quantum mechanics uses Hermitian matrices (the complex analog of symmetric), whose transpose plays a central role
- The transpose determines the "adjoint" of a linear map, connecting input and output spaces in a dual relationship
Quiz
If is a matrix, what are the dimensions of ?
for all matrices and with compatible dimensions.
Which expression equals the dot product using matrix notation?
Common Mistakes
- Writing instead of — the transpose reverses order, just as the inverse does.
- Confusing a row vector with a column vector — they have different dimensions and behave differently in matrix products.
- Assuming without knowing is invertible — this identity only holds for square invertible matrices.