Second Partial Derivatives
The first partial derivatives and are themselves functions of . Nothing stops us from differentiating them with respect to or again — these are the second partial derivatives.
For , there are four second partials: differentiate with respect to or , and differentiate with respect to or . We write them as , , , .
The "mixed" partials and both differentiate once in and once in , just in different orders. As we will see shortly, they are usually equal.
For a function on , there are second partials , which we can organize into a matrix.
Formal View
If first partials are differentiable they are certainly continuous, giving the hierarchy: .
Why This Matters
Second derivatives tell us about curvature — whether a function bends upward (bowl), downward (dome), or twists (saddle). This is what the second derivative test is built on.
- Curvature of neural network loss landscapes (flat vs. sharp minima)
- Newton's method uses second derivatives for faster convergence than gradient descent
- Structural engineering: beam bending involves second derivatives of displacement
- Image processing: Laplacian () detects edges and blobs
Quiz
For , what is ?
How many second partial derivatives does have?
What does mean?
If (continuously differentiable), then .
Common Mistakes
- Confusing and — means differentiate first by , then by .
- Thinking that variables always give second partials — there are (including mixed partials).
- Assuming second partial derivative functions exist just because the function is smooth-looking.