Linear Algebra
10.218 min read

Class Inclusions C⁰ ⊃ D¹ ⊃ C¹

We can now summarize the hierarchy of function classes: C0D1C1C^0 \supset D^1 \supset C^1. C0C^0 (continuous): ff has no jumps. D1D^1 (differentiable): ff is C0C^0 and f(x)f'(x) exists at every point (but ff' might not be continuous). C1C^1 (continuously differentiable): ff is D1D^1 and ff' is itself continuous.

Each inclusion is strict: there exist C0C^0 functions that are not D1D^1 (e.g., x|x| at 00), and there exist D1D^1 functions that are not C1C^1 (the classic example: f(x)=x2sin(1/x)f(x) = x^2 \sin(1/x) for x0x \neq 0, f(0)=0f(0) = 0, which is differentiable at 00 but has a discontinuous derivative there).

For multivariate functions (Chapters 11–12), these same classes generalize: C0C^0 means continuous, D1D^1 means partial derivatives exist everywhere, and C1C^1 means partial derivatives are continuous. The key result: C1C^1 implies D1D^1, and in multiple dimensions, C1C^1 implies the full chain rule holds — this is not guaranteed for merely D1D^1 functions.

Formal View

Theorem 10.4 — Strict Inclusions C⁰ ⊃ D¹ ⊃ C¹
The inclusions C0D1C1C^0 \supset D^1 \supset C^1 are all strict: - xC0D1|x| \in C^0 \setminus D^1 (continuous but not differentiable at 0). - f(x)=x2sin(1/x)f(x) = x^2 \sin(1/x) (extended by f(0)=0f(0)=0) D1C1\in D^1 \setminus C^1 (differentiable but derivative not continuous at 0). - Every polynomial C1\in C^1.

For optimization: C1C^1 functions have Lipschitz gradients under mild assumptions, enabling standard convergence proofs for gradient descent.

Why This Matters

Knowing which class a function belongs to determines what algorithms and theorems apply.

  • Gradient descent convergence proofs require C1C^1 with Lipschitz derivative — D1D^1 alone is insufficient.
  • Implicit function theorem applies to C1C^1 mappings — not just D1D^1.
  • Numerical ODE solvers have higher-order accuracy for CkC^k functions with larger kk.

Quiz

Question 1

Which function is in D1D^1 but NOT in C1C^1?

Question 2

Every C1C^1 function is also in D1D^1.

Common Mistakes

  • Thinking differentiable and continuously differentiable are the same — the example x2sin(1/x)x^2\sin(1/x) shows they are not.
  • Assuming that for smooth-looking functions, the derivative is automatically continuous — check carefully for oscillatory behavior.