Linear Algebra
10.88 min read

Formal Definition of Limit

The formal ε\varepsilon-δ\delta definition makes the notion of "approaching" precise. limxx0f(x)=L\lim_{x \to x_0} f(x) = L means: for any desired accuracy ε>0\varepsilon > 0, there is a tolerance δ>0\delta > 0 such that inputs within δ\delta of x0x_0 produce outputs within ε\varepsilon of LL.

Key features of this definition: (1) ε\varepsilon is chosen first (by the "adversary"), then δ\delta must be found (by us). (2) The condition 0<xx0<δ0 < |x - x_0| < \delta explicitly excludes x=x0x = x_0. (3) The same δ\delta must work for all xx in the deleted neighborhood.

This definition is the bedrock of all of calculus. While we do not always use it explicitly, every theorem about limits, derivatives, and integrals ultimately rests on it.

Formal View

Definition 10.7 — Epsilon-Delta Definition of Limit
limxx0f(x)=L\lim_{x \to x_0} f(x) = L if and only if: for every ε>0\varepsilon > 0, there exists δ>0\delta > 0 such that
0<xx0<δ    f(x)L<ε.0 < |x - x_0| < \delta \implies |f(x) - L| < \varepsilon.

The condition 0<xx00 < |x - x_0| (strictly greater than 0) excludes x=x0x = x_0 itself, reflecting that the limit does not care about f(x0)f(x_0).

Why This Matters

The formal definition makes calculus rigorous and enables proofs of theorems that practitioners rely on.

  • Proving continuity of composed functions: rigorous limit arguments show fgf \circ g is continuous if ff and gg are.
  • Numerical analysis: epsilon-delta arguments justify when finite-difference approximations are valid.
  • Convergence proofs: showing iterative algorithms converge uses limit arguments.

Quiz

Question 1

In the ε\varepsilon-δ\delta definition, which quantity is chosen first?

Question 2

The condition 0<xx00 < |x - x_0| in the epsilon-delta definition ensures xx0x \neq x_0.

Common Mistakes

  • Reversing the order: δ\delta must be found AFTER ε\varepsilon is given, not the other way around.
  • Forgetting the strict inequality 0<xx00 < |x-x_0| — the limit intentionally excludes x=x0x = x_0.