Linear Algebra
5.110 min read

The Transpose

The transpose of a matrix flips it across its main diagonal. Every row becomes a column and every column becomes a row. If AA is an m×nm \times n matrix, then AtA^t is an n×mn \times m matrix, and the entry in row ii, column jj of AtA^t equals the entry in row jj, column ii of AA.

A column vector vRm\mathbf{v} \in \mathbb{R}^m is just an m×1m \times 1 matrix. Its transpose vt\mathbf{v}^t is a 1×m1 \times m matrix — we call this a row vector. Row vectors let us write dot products as matrix products: utv=uv\mathbf{u}^t \mathbf{v} = \mathbf{u} \cdot \mathbf{v}.

Up to this point, we have studied matrices entirely through their columns. The transpose lets us apply everything we know about column structure to the rows of the original matrix — it is our gateway to studying row space.

Formal View

Definition 5.1 — Transpose
Let AA be an m×nm \times n matrix. Its transpose AtA^t is the n×mn \times m matrix defined by (At)ij=Aji(A^t)_{ij} = A_{ji}. For a column vector vRm\mathbf{v} \in \mathbb{R}^m, the transpose vt\mathbf{v}^t is a 1×m1 \times m row vector.
Remark 5.1
Transposing twice returns the original: (At)t=A(A^t)^t = A. The transpose of a product reverses the order: (AB)t=BtAt(AB)^t = B^t A^t. You can verify this by checking dimensions: if AA is m×nm \times n and BB is n×pn \times p, then (AB)t(AB)^t is p×m=BtAtp \times m = B^t A^t.

Interactive Visualization

Transpose Visualizer

Why This Matters

The transpose is fundamental to nearly every branch of applied mathematics.

  • Symmetric matrices A=AtA = A^t arise in physics, statistics, and optimization — covariance matrices and moment-of-inertia tensors are all symmetric
  • In machine learning, the normal equations for least-squares regression involve AtAA^t A and AtbA^t \mathbf{b}
  • Quantum mechanics uses Hermitian matrices (the complex analog of symmetric), whose transpose plays a central role
  • The transpose determines the "adjoint" of a linear map, connecting input and output spaces in a dual relationship

Quiz

Question 1

If AA is a 3×53 \times 5 matrix, what are the dimensions of AtA^t?

Question 2

(AB)t=AtBt(AB)^t = A^t B^t for all matrices AA and BB with compatible dimensions.

Question 3

Which expression equals the dot product uv\mathbf{u} \cdot \mathbf{v} using matrix notation?

Common Mistakes

  • Writing (AB)t=AtBt(AB)^t = A^t B^t instead of BtAtB^t A^t — the transpose reverses order, just as the inverse does.
  • Confusing a row vector vt\mathbf{v}^t with a column vector — they have different dimensions and behave differently in matrix products.
  • Assuming (At)1=(A1)t(A^t)^{-1} = (A^{-1})^t without knowing AA is invertible — this identity only holds for square invertible matrices.