Linear Algebra
232 Interactive Sections · 17 Chapters

Linear Algebra

An Interactive Journey from Equations to Structure

Interactive diagrams. Step-by-step algorithms. Conceptual quizzes. Everything you need to deeply understand linear algebra — not just compute it.

Start Learning

Interactive Diagrams

14 live visualizations

Quizzes

Instant feedback

Formal Definitions

Mathematically precise

Course Chapters

1

Chapter 1

Linear Systems

Geometry, Structure, and Solution Methods

Discover how systems of equations encode geometry, develop powerful elimination algorithms, and reveal the deep structure of solution sets.

14 sections~147 min
2

Chapter 2

Vectors

Span, Independence, and the Language of Linear Algebra

Master the language of vectors: how to add, scale, combine, and span with them — and discover the deep notions of linear independence, subspace, and basis.

17 sections~149 min
3

Chapter 3

Matrices and Linear Maps

Rank, Nullity, and the Structure of Transformations

Understand matrices as linear transformations, master the column space and null space, and discover the Rank-Nullity theorem that ties everything together.

17 sections~152 min
4

Chapter 4

Matrix Algebra and Invertibility

Composition, Products, and LU Decomposition

Master matrix multiplication as composition of transformations, understand invertibility through 10 equivalent conditions, and learn the LU decomposition algorithm.

13 sections~128 min
5

Chapter 5

Transpose and Row Rank

Rows, Columns, and a Surprising Equality

Discover the transpose operation and explore the deep symmetry between row space and column space through the Row Rank Theorem — one of the most elegant results in linear algebra.

7 sections~66 min
6

Chapter 6

Dot Products, Orthogonality, and Projections

Measuring Angles, Length, and Finding the Closest Vector

Build a complete theory of measurement in linear algebra — dot products, lengths, angles, and orthogonality — then use orthogonal projection to solve the best approximation problem.

9 sections~85 min
7

Chapter 7

Eigenvalues and Eigenvectors

Directions That Only Scale

Discover the special directions a matrix never rotates — only stretches or shrinks. Eigenvalues and eigenvectors reveal the hidden structure of a linear transformation and unlock powerful tools in data science, physics, and differential equations.

11 sections~140 min
8

Chapter 8

Quadratic Forms and Symmetric Matrices

When Matrices Meet Geometry

Explore how symmetric matrices and their eigenvalues determine the shape of quadratic functions — from bowls to saddles. Build toward positive definiteness, the spectral theorem, and the geometry behind least squares.

18 sections~159 min
9

Chapter 9

Singular Value Decomposition

The Universal Matrix Factorization

Master the SVD — the most powerful factorization in linear algebra. Understand how any matrix decomposes into rotations and scalings, how it generalizes the spectral theorem, and how it underpins PCA, low-rank approximation, and multidimensional scaling.

21 sections~182 min
10

Chapter 10

Optimization and Derivatives

The Calculus of Finding Minima

Build from scratch the calculus tools needed for optimization: limits, continuity, derivatives, and differentiability. Understand local linear approximation and the hierarchy of function classes C⁰, D¹, and C¹.

21 sections~159 min
11

Chapter 11

Partial Derivatives and the Jacobian

Extending Differentiation to Many Variables

How do we differentiate functions of multiple variables? This chapter builds the toolkit: partial derivatives, local linear approximation, differentiability, and the Jacobian matrix — the multivariable generalization of the derivative.

12 sections~114 min
12

Chapter 12

Gradient, Critical Points, and Optimization

Finding Minima Using First- and Second-Order Information

Building on partial derivatives and the Jacobian, this chapter introduces the gradient vector, directional derivatives, gradient descent, critical point theory, and the practical methods for finding global minima of functions on subsets of Rⁿ.

23 sections~192 min
13

Chapter 13

Vector-Valued Functions

Functions from Rⁿ to Rᵐ and Their Derivatives

Extending differentiation to functions with vector outputs. This chapter covers the Jacobian for vector-valued functions, local linear approximation in the vector setting, trajectories, and the geometry of vector-valued maps.

9 sections~86 min
14

Chapter 14

The Chain Rule

Differentiating Compositions of Functions

The chain rule is the master tool of calculus, enabling the differentiation of composed functions. This chapter derives the multivariate chain rule via local linear approximation, explores matrix-form justification, and covers the key special cases: one underlying variable, two underlying variables, and non-canonical input/output types.

16 sections~130 min
15

Chapter 15

Backpropagation

Computing Gradients Through Computational Circuits

Backpropagation is the algorithm that makes training neural networks tractable. By viewing computation as a circuit, we can compute all partial derivatives in two efficient passes — one forward, one backward.

7 sections~53 min
16

Chapter 16

Second Derivatives and Convexity

Curvature, the Hessian, and Globally Well-Behaved Functions

Second derivatives capture curvature — how fast a function bends. The Hessian matrix organizes all second partials, powers the second derivative test, and unlocks the powerful theory of convex functions where local minima are guaranteed to be global.

9 sections~68 min
17

Chapter 17

Lagrange Multipliers

Optimizing Under Equality Constraints

When optimization is restricted to a surface defined by equality constraints, gradient descent alone fails. Lagrange multipliers provide the systematic tool, revealing that constrained optima occur where gradients of the objective and constraints align — and even proving that symmetric matrices have eigenvalues.

8 sections~64 min