Linear Algebra
12.207 min read

Extreme Value Theorem

The Extreme Value Theorem (EVT) is one of the most important existence results in analysis: if ff is continuous and the domain DD is compact (closed and bounded), then ff attains its maximum and minimum values on DD.

More precisely, there exist points a,bD\mathbf{a}^*, \mathbf{b}^* \in D such that f(a)f(x)f(b)f(\mathbf{a}^*) \leq f(\mathbf{x}) \leq f(\mathbf{b}^*) for all xD\mathbf{x} \in D.

The EVT guarantees existence but does not tell us how to find these extrema. Practically, we check: (1) interior critical points (from f=0\nabla f = \mathbf{0}), (2) boundary critical points, and (3) corners/vertices if the domain is a polytope. The global extremum is the best of all these candidates.

Formal View

Theorem 12.12 (Extreme Value Theorem) — Existence of Global Extrema
If f:DRf: D \to \mathbb{R} is continuous and DRnD \subseteq \mathbb{R}^n is compact, then ff attains its minimum and maximum on DD: there exist a,bD\mathbf{a}^*, \mathbf{b}^* \in D such that f(a)=minxDf(x)f(\mathbf{a}^*) = \min_{\mathbf{x}\in D} f(\mathbf{x}) and f(b)=maxxDf(x)f(\mathbf{b}^*) = \max_{\mathbf{x}\in D} f(\mathbf{x}).

Interactive Visualization

Interactive Line Explorer

Why This Matters

The EVT is the theoretical foundation for asserting that optimization problems on compact domains have solutions.

  • Guaranteeing that constrained optimization problems have optimal solutions
  • Existence of optimal portfolios under budget constraints
  • Proving that differential equations have solutions under regularity conditions

Quiz

Question 1

The Extreme Value Theorem requires which conditions?

Question 2

The Extreme Value Theorem tells us how to find the minimum — not just that it exists.

Common Mistakes

  • Trying to apply the EVT to continuous functions on non-compact (e.g., open or unbounded) domains.
  • Confusing existence (EVT) with uniqueness — the EVT guarantees a minimum exists but does not say it is unique.
  • Forgetting that the minimum might be attained at the boundary, not just at interior critical points.