Linear Algebra
5.28 min read

Properties of the Transpose

The transpose interacts cleanly with all the matrix operations we have studied. Addition and scalar multiplication pass straight through: (A+B)t=At+Bt(A + B)^t = A^t + B^t and (rA)t=rAt(rA)^t = rA^t. For products, the rule reverses order: (AB)t=BtAt(AB)^t = B^t A^t.

When AA is invertible, so is AtA^t, and its inverse is the transpose of A1A^{-1}: (At)1=(A1)t(A^t)^{-1} = (A^{-1})^t. This is sometimes written AtA^{-t}. You can verify it directly: At(A1)t=(A1A)t=It=IA^t (A^{-1})^t = (A^{-1} A)^t = I^t = I.

A useful extension of the product rule: (ABC)t=CtBtAt(ABC)^t = C^t B^t A^t. Each factor transposes and the whole product reverses. This generalizes to any number of factors.

Formal View

Theorem 5.2 — Transpose Algebra
Let AA and BB be m×nm \times n matrices, rRr \in \mathbb{R}, and let A,BA, B have a well-defined product ABAB. Then:\begin{enumerate} \item (At)t=A(A^t)^t = A \item (A+B)t=At+Bt(A + B)^t = A^t + B^t \item (rA)t=rAt(rA)^t = rA^t \item (AB)t=BtAt(AB)^t = B^t A^t \item If AA is square and invertible: (At)1=(A1)t=:At(A^t)^{-1} = (A^{-1})^t =: A^{-t} \end{enumerate}

Why This Matters

These algebraic rules make the transpose a well-behaved operation that fits seamlessly into calculations.

  • The rule (AB)t=BtAt(AB)^t = B^t A^t is used constantly in deriving gradient formulas in machine learning
  • In numerical linear algebra, computing (AtA)1At(A^t A)^{-1} A^t (the pseudoinverse) relies on all these identities
  • When checking if a matrix is symmetric, the identity (A+At)t=At+A(A + A^t)^t = A^t + A immediately shows A+AtA + A^t is always symmetric

Quiz

Question 1

Which of the following is always symmetric (equals its own transpose) for any matrix AA?

Question 2

If AA is invertible, then (At)1=(A1)t(A^t)^{-1} = (A^{-1})^t.

Common Mistakes

  • Applying the transpose rule as (AB)t=AtBt(AB)^t = A^t B^t — always reverse the order: (AB)t=BtAt(AB)^t = B^t A^t.
  • Assuming every matrix plus its transpose equals the zero matrix — A+AtA + A^t is symmetric, not zero.