Linear Algebra
8.77 min read

Symmetry is Preserved Under Congruence

If AA is a symmetric matrix and MM is any matrix of compatible dimensions, the product MAMM^\top A M is also symmetric. This operation — transforming AA by sandwiching with MM and MM^\top — is called a congruence transformation.

The proof is quick: (MAM)=MA(M)=MAM(M^\top A M)^\top = M^\top A^\top (M^\top)^\top = M^\top A M, where we used A=AA^\top = A (symmetry of AA) and (M)=M(M^\top)^\top = M. So the result equals itself, hence it is symmetric.

This fact matters because when we change coordinates (Section 8.14), the matrix of the quadratic form changes by exactly a congruence transformation. Knowing that symmetry is preserved means the diagonalized form is also symmetric — a diagonal matrix with eigenvalues on the diagonal.

Formal View

Lemma 8.2 — Congruence Preserves Symmetry
If AA is a symmetric n×nn \times n matrix and MM is any n×kn \times k matrix, then MAMM^\top A M is symmetric.

Proof: (MAM)=MAM=MAM(M^\top A M)^\top = M^\top A^\top M = M^\top A M since A=AA^\top = A.

Why This Matters

Congruence transformations arise in changes of coordinates, and knowing symmetry is preserved ensures the transformed quadratic retains all the structural properties we care about.

  • Principal component analysis: the covariance matrix Σ\Sigma transforms to UΣU=ΛU^\top \Sigma U = \Lambda under a rotation UU — still symmetric and diagonal.
  • Finite element methods: transforming stiffness matrices to reduced coordinates preserves their symmetry and positive-definiteness.
  • Normal equations: AAA^\top A is always symmetric, a consequence of congruence (with M=AM = A, AAA^\top A is MIMM^\top I M).

Quiz

Question 1

If AA is symmetric and MM is any matrix, then MAMM^\top A M is always symmetric.

Question 2

What is the key property of AA used to show (MAM)=MAM(M^\top A M)^\top = M^\top A M?

Common Mistakes

  • Thinking MAMMAM^\top (wrong order) also preserves symmetry — it does if AA is symmetric, but the correct congruence form is MAMM^\top A M.
  • Assuming MM must also be symmetric — there is no requirement on MM.