Shapes, elimination, and consistency
An m × n matrix maps n-dimensional inputs to m-dimensional outputs. Row operations on the augmented matrix preserve solutions. Ax = b is consistent exactly when rank(A) equals rank([A | b]); a pivot in the augmented column signals inconsistency.
Check yourself: Did you apply each row operation to the right-hand side too?
Basis, rank, and nullity
A basis must span its space and be independent. Rank counts independent columns, equivalently pivots. For n columns, rank plus nullity equals n. Echelon-form pivot positions identify basis columns for the column space; select those columns from the original matrix.
Check yourself: Does your null-space dimension count the free input coordinates?
Orthogonality and least squares
Projection onto a nonzero vector u is u(uᵀb)/(uᵀu). The residual is orthogonal to u. More generally, least-squares solutions satisfy Aᵀ(Ax − b) = 0. The familiar inverse formula requires independent columns; a singular AᵀA does not mean no minimizing solution exists.
Check yourself: Is the residual orthogonal to every column of A?
Eigenvalues and symmetric matrices
Solve det(A − λI) = 0 for eigenvalues, then solve (A − λI)v = 0 for nonzero eigenvectors. Their sum and product, counting multiplicities, equal trace and determinant. Real symmetric matrices admit an orthonormal eigenbasis; repeated eigenvalues do not guarantee this for arbitrary matrices.
Check yourself: Can you verify each proposed pair directly through Av = λv?
Singular values and low-rank structure
An SVD writes A = UΣVᵀ with orthonormal singular directions. Singular values are nonnegative square roots of eigenvalues of AᵀA; their nonzero count equals rank. Keeping the largest k terms gives a best rank-at-most-k approximation in Frobenius norm, linking matrix structure to compression.
Check yourself: Are you confusing singular values with potentially negative eigenvalues?