Linear Algebra
2.710 min read

Linear Combinations

A linear combination of vectors a1,,ak\mathbf{a}_1, \ldots, \mathbf{a}_k is any expression c1a1+c2a2++ckakc_1 \mathbf{a}_1 + c_2 \mathbf{a}_2 + \cdots + c_k \mathbf{a}_k where c1,,ckc_1, \ldots, c_k are scalars. The scalars are called the coefficients or weights.

Linear combinations are the core operation of linear algebra. Matrix-vector multiplication AxA\mathbf{x} is a linear combination of the columns of AA weighted by the entries of x\mathbf{x}.

There are three ways to picture a linear combination: symbolically (the formula above), geometrically (tip-to-tail addition of scaled arrows), and entry-by-entry (compute each entry of the result separately). All three perspectives are useful.

Formal View

Definition 2.7 — Linear Combination
A linear combination of vectors a1,,akRm\mathbf{a}_1, \ldots, \mathbf{a}_k \in \mathbb{R}^m is any vector of the form
c1a1+c2a2++ckakc_1 \mathbf{a}_1 + c_2 \mathbf{a}_2 + \cdots + c_k \mathbf{a}_k
for scalars c1,,ckRc_1, \ldots, c_k \in \mathbb{R}.

Why This Matters

Every matrix-vector product, every weighted average, every superposition of signals is a linear combination.

  • Mixing colors: any color is a linear combination of red, green, blue basis colors
  • Portfolio: total return is a linear combination of individual asset returns
  • Image reconstruction: each pixel of a deblurred image is a linear combination of neighboring pixels

Quiz

Question 1

Is (7,11)(7, 11) a linear combination of (1,2)(1, 2) and (3,1)(3, 1)?

Common Mistakes

  • Thinking linear combinations only use integer coefficients — any real number works.
  • Forgetting that the result of a linear combination is a vector of the same size as the input vectors.