Linear Algebra
8.77 min read

Symmetry is Preserved Under Congruence

If AA is a symmetric matrix and MM is any matrix of compatible dimensions, the product M⊤AMM^\top A M is also symmetric. This operation — transforming AA by sandwiching with MM and M⊤M^\top — is called a congruence transformation.

The proof is quick: (M⊤AM)⊤=M⊤A⊤(M⊤)⊤=M⊤AM(M^\top A M)^\top = M^\top A^\top (M^\top)^\top = M^\top A M, where we used A⊤=AA^\top = A (symmetry of AA) and (M⊤)⊤=M(M^\top)^\top = M. So the result equals itself, hence it is symmetric.

This fact matters because when we change coordinates (Section 8.14), the matrix of the quadratic form changes by exactly a congruence transformation. Knowing that symmetry is preserved means the diagonalized form is also symmetric — a diagonal matrix with eigenvalues on the diagonal.

Formal View

Lemma 8.2 — Congruence Preserves Symmetry
If AA is a symmetric n×nn \times n matrix and MM is any n×kn \times k matrix, then M⊤AMM^\top A M is symmetric.

Proof: (M⊤AM)⊤=M⊤A⊤M=M⊤AM(M^\top A M)^\top = M^\top A^\top M = M^\top A M since A⊤=AA^\top = A.

Why This Matters

Congruence transformations arise in changes of coordinates, and knowing symmetry is preserved ensures the transformed quadratic retains all the structural properties we care about.

  • Principal component analysis: the covariance matrix Σ\Sigma transforms to U⊤ΣU=ΛU^\top \Sigma U = \Lambda under a rotation UU — still symmetric and diagonal.
  • Finite element methods: transforming stiffness matrices to reduced coordinates preserves their symmetry and positive-definiteness.
  • Normal equations: A⊤AA^\top A is always symmetric, a consequence of congruence (with M=AM = A, A⊤AA^\top A is M⊤IMM^\top I M).

Quiz

Question 1

If AA is symmetric and MM is any matrix, then M⊤AMM^\top A M is always symmetric.

Question 2

What is the key property of AA used to show (M⊤AM)⊤=M⊤AM(M^\top A M)^\top = M^\top A M?

Common Mistakes

  • Thinking MAM⊤MAM^\top (wrong order) also preserves symmetry — it does if AA is symmetric, but the correct congruence form is M⊤AMM^\top A M.
  • Assuming MM must also be symmetric — there is no requirement on MM.