Linear Algebra
3.98 min read

Injectivity and Nullity

The precise algebraic characterization of injectivity: AA is injective if and only if Nullity(A)=0\text{Nullity}(A) = 0. Equivalently, Ax=0A\mathbf{x} = \mathbf{0} has only the trivial solution.

Why? If Ax1=Ax2A\mathbf{x}_1 = A\mathbf{x}_2, then A(x1x2)=0A(\mathbf{x}_1 - \mathbf{x}_2) = \mathbf{0}, so x1x2Null(A)\mathbf{x}_1 - \mathbf{x}_2 \in \text{Null}(A). If the null space is trivial, then x1x2=0\mathbf{x}_1 - \mathbf{x}_2 = \mathbf{0}, so x1=x2\mathbf{x}_1 = \mathbf{x}_2.

This gives a clean test: to check if AA is injective, solve Ax=0A\mathbf{x} = \mathbf{0} and check if the only solution is x=0\mathbf{x} = \mathbf{0}.

Formal View

Theorem 3.9
ARm×nA \in \mathbb{R}^{m \times n} is injective \Longleftrightarrow Nullity(A)=0\text{Nullity}(A) = 0 \Longleftrightarrow The equation Ax=0A\mathbf{x} = \mathbf{0} has only the trivial solution x=0\mathbf{x} = \mathbf{0}.

Why This Matters

The nullity gives a computable measure of injectivity failure.

  • Nullity = 0 means the system Ax=bA\mathbf{x} = \mathbf{b} has at most one solution
  • In machine learning, large nullity in a feature matrix signals collinearity issues

Quiz

Question 1

If AA has nullity 0, then Ax=bA\mathbf{x} = \mathbf{b} has at most one solution for any b\mathbf{b}.

Common Mistakes

  • Confusing "at most one solution" (injectivity) with "exactly one solution" (injectivity + surjectivity = bijectivity).