Symmetry of Mixed Partials
In the calculation , you can compute and . They are equal! Is this a coincidence?
No — for well-behaved functions, mixed partials are always equal. The order you differentiate in does not matter: differentiating first by then gives the same result as first by then .
This is the Mixed Partials Theorem (sometimes called Clairaut's Theorem or Schwarz's Theorem). The proof is non-trivial and requires the assumption, but the conclusion is beautifully clean.
The consequence: the Hessian matrix (coming next) is symmetric. All the theory of symmetric matrices — eigenvalues, spectral decomposition, definiteness — applies to it.
Formal View
The order of differentiation does not matter for twice-differentiable functions.
Why This Matters
Symmetry of the Hessian is the bridge that lets us apply all our tools from symmetric matrix theory to second-order optimization.
- Hessian symmetry means only unique entries to compute, not
- Symmetric Hessian guarantees real eigenvalues — critical for classifying critical points
- Integrability conditions in physics use mixed-partial symmetry (Maxwell's relations)
- Conservative vector fields satisfy — same idea
Quiz
For , we always have .
Why does symmetry of mixed partials matter for optimization?
For , are and equal?
For on with , how many distinct second partial derivative values are there?
Common Mistakes
- Assuming without checking that — counterexamples exist for pathological functions.
- Confusing the theorem direction: symmetry of mixed partials follows from twice-differentiability, not the other way around.