2.58 min read
Algebraic Properties of Vectors
Vector addition and scalar multiplication satisfy a rich set of algebraic properties. These properties hold for any vectors in and any scalars, and they follow directly from the fact that real number arithmetic satisfies these rules entry-by-entry.
The most important properties are: commutativity (), associativity (), and distributivity ().
These 8 properties — when abstracted from — define what a vector space is. Any system satisfying these axioms behaves like vectors, even if its elements look nothing like number tuples (e.g., polynomials, matrices, continuous functions).
Formal View
Theorem 2.5 — Vector Space Properties
For all and : \begin{enumerate} \item (commutativity) \item (associativity) \item (zero identity) \item (additive inverse) \item (distributivity over vector addition) \item (distributivity over scalar addition) \item (scalar associativity) \item (scalar identity) \end{enumerate}
Why This Matters
These 8 axioms are the minimal requirements for a structure to behave like "vectors." They define the theory of vector spaces.
- Abstract vector spaces include polynomials, matrices, and function spaces — all obeying the same algebra
- These properties justify why linear algebra techniques transfer across domains
- In machine learning, the 8 axioms ensure that gradient updates "add up" correctly
Quiz
Question 1
For any vector , we have .
Common Mistakes
- Thinking commutativity holds for matrix multiplication — it does for vectors but NOT for matrices.
- Confusing the zero vector with the scalar — they are different objects.