MuPO/pZYQ7qCZpo+SVSZOB69vSRhS20600gAn5Yjn3bHNOwsJW7foKDt/7UBkaZhO2yndIGBtQtPTzHE3AN2lryRtU+xQjGWVyTFbfr80XEVkvqLgjDgc4viRnKwjn9iXdtfuXYCmFf5JVqs/0+KDTaXj2EKDY7SXyYTUP1R2Tv7PLwH0OMu5M/FyrCjX2BAn1kqO5iCLGcflDlFKy+5lEQKk5yrfPu6bf/QROGAY7qUo04mSwb9HrJZNu7uBOmH+t3wcekoVqNgxPdtTMgZn72OXQRLYbpaQYvoi90rK8NlBqPr/vN+dprTd4pM4sDRbUKFcMhGSFTjYqxIGM4liuZVA1qal2RQqyZvs8KMi6q4JUTOUuWQoukj8uQXdPpFawBDIdS7TJ+vmfvGaM8dNEbJ9k6ijFpXx7kMBZvlT4zfbv50CFlmU2nD4BkFEOaPxf5dOIqgsklB15JJ4S+eSahAR1oSfwj7iVaOhFgHLyrQas/VSMqIa4ANNLE8Si9BUakNfAtGW5uuui7mRPz5dukrhmovDF+MykQ2cQJMAEtCwGC9lD6NGdtlLz8TX3lB4iBtIghudcf4+LFm6x1Xq2xPiHQtarjD7NhMtJKA3f4LXIQZaLpTGEZe/sdPShl+1NUvTk8aZroiulro1uO+6U2uaxVsuc3SK5UlmapjFH2dv2HqmtYFyOL4GgVcKXKGFle6j23i1uDkOJBrppO3UbdWAb0EwM21XhNdo7SHNuM4TZdgsdP
DjczlNWsLNm1D6McObNz4mqs517EiSvUsOkguyXMFWrcTJ6H7dwLbL/B+Y81BTIS1UHYlIK8louE+VFuugV/tqv5wxcOKV8yPN5FkE4vg1KGrHkYqNEG3QZYUMNal8aQ2uG12Ashaw9bvGyjtxy/sNnrzfv356C5h8AEK+EnSVXwo8Auhhawu/O4Se99f3rVTaR5DJiCOMJsiOoeVDKaXKfkaNmTaNAwma+lRjQmfoWStRTfjn7xKmv26R6QmaLhFX2ri+02XYXXgopH9R02JRQLB+4txAr1nwA30hy4OzlC6/stxEmL24CtTqF4s1O4ch0fyPAEXCOqeCZVlxTxLzZZD1aGLnKy2E1kxanDQnvlycDcbGOFgjB9lgajj88gdmz7MfP1s/yOKmjkI1J0e1N5ZQA6GIxS3Na9Z58YLofDwTTI+mJ7pegGN4x0tI+8mY0j1upbOrD9IVFCzJrdLkEN4jUJMd8nwxNDkwNKrbaI4P9HeRsi25c55SaWcaZkVEfpMGRK51T2X2YjtBpDF/1M2vkuyGMW9HJ3k3gEC6Hgp5DpOMiMtAphchCGD6wxZbXoph8elHTkViQs6KRpkkrlgM9FZgMFkG97cfr3HkyUmACjrMQ4uNXlQYyPW3v3mmImE3JiMP1CWihSNdqcvbM1jBbc8Zi4ZnKWKC3CZf2w/zL2jXULI5LSIFkHvgebLSISYVB868CW2uGJcVYZU6BfMfJFz4aXNThi/yNbgTHzEnIsPU

Vectors & Matrices

The fundamental building blocks of linear algebra and modern computation.

a49WbF25/ruVNbg/1RkVOPWmyto+U0+SFLC4oWjKFps4fxul2PywWmGxgd6WPQ72xEc9wwHgswVpQWYLbZXZfqzijUJMLl5GeN2zkBGFNBp2Z0ZNo46CiIC6ZhE8M7nybZqoRQoOkl6tr0JLxmz7RwxytRbshGBmaKCppxEVzb6tiMgV8CMORVDCdeF0g77qLBJzjgP5KV0TNpe6vv8gua40ZsBD3V5HhrJyafXxCTOZJlv3Rye/4rrbiidLn2Igds+nT8uAF4VtLlnvMK7T19g1spD4cqb4rY62HIDoOvz3vIaYF3PIkW18r/8Dz1VMTU2wVmeS3H3fMhJgoiWXSfDhwwOG1n13ZLzTf9QmUIF0/z6tz6+aeHgSlopF3yO8LuTCRja3IIisjQ2+pgNSrJnSshIa/lwPQyDR1bdmOoEkf/yIfGKXFe+IrxpACGdLgpeCt/OnHijgSuxqIIXMPN4j/r+1V7TEy1YVStH/rNZHZwY8OMWtXlBdXMpS+LLK00inbyNZKyPiul0Qae76EVCnjr/xnvjLq0K77vQ7xZ0Qn+UDbwoqRs4CWxX2HC8bwToBZFXYmcMvkqfiMZ64l0dFdB3UFbmYE/B4xUBx+kKq7KLJf9vLWRLSL2cyc4Qn/UMCAhQCjQgyfsZVEkFexgufR2O9yimH8/+D0KHBqtVvgxo0sI9sdpkk9P3Xqa9pxlDc7pbRjl8Zk8bW+BSsjlfP5nA0A2Bn/L6BSDfFVYSqyyJX3v

Vectors

A vector is an ordered list of numbers representing magnitude and direction. In ℝⁿ, vectors can represent points, displacements, or abstract data.

Vector: v = (v₁, v₂, …, vₙ)
Magnitude: ‖v‖ = √(v₁² + v₂² + … + vₙ²)
Dot product: u·v = u₁v₁ + u₂v₂ + … + uₙvₙ
cos θ = (u·v)/(‖u‖·‖v‖)

The magnitude formula generalizes the distance formula from coordinate geometry. The dot product connects to trigonometric functions via the angle between vectors.

Matrices

A matrix is a rectangular array of numbers. An m×n matrix has m rows and n columns.

Identity matrix: I (1s on diagonal, 0s elsewhere)
Transpose: (Aᵀ)ᵢⱼ = Aⱼᵢ
Symmetric: A = Aᵀ

Special matrices: diagonal, upper/lower triangular, symmetric, orthogonal (QᵀQ = I). The identity matrix I acts like 1 in matrix multiplication — similar to how 1 is the multiplicative identity.

Matrix Operations

  1. Addition: (A + B)ᵢⱼ = Aᵢⱼ + Bᵢⱼ (same dimensions required)
  2. Scalar multiplication: (cA)ᵢⱼ = c·Aᵢⱼ
  3. Matrix multiplication: (AB)ᵢⱼ = Σₖ Aᵢₖ·Bₖⱼ (inner dimensions must match)
  4. Inverse: AA⁻¹ = A⁻¹A = I (only for square, non-singular matrices)
Matrix multiplication is not commutative: AB ≠ BA in general. However, it is associative: (AB)C = A(BC). This algebraic structure is fundamental to linear transformations.

Solving Linear Systems

Linear systems Ax = b can be solved via:

  • Gaussian elimination: Row reduce to echelon form
  • Matrix inverse: x = A⁻¹b (when A is invertible)
  • Cramer's rule: xᵢ = det(Aᵢ)/det(A)

These generalize the methods for solving systems of equations to any number of variables. In regression analysis, the normal equations have the form b = (XᵀX)⁻¹Xᵀy.

Determinants

2×2: det(A) = ad − bc
3×3: cofactor expansion along any row/column
Properties: det(AB) = det(A)·det(B), det(Aᵀ) = det(A)

The determinant encodes whether a matrix is invertible (det ≠ 0), the scaling factor of the associated transformation, and the signed volume of the parallelepiped formed by column vectors.

BGR9edVe+XHvdxGkZkutADVdsDpZ+fZhdlvcJrckEqQU6dewamLykcujcVlxdBMbTo996wNB5Vf5T6j1PY76OgEAPkhRiYCw9JsIiGxkodqj6qPlHJP1YerJ3LT2RypO3r5XugiCN+0TCH2U5cbpleeGoboDZWTtpsrclfNJf9M/ui8Sl9tCfsfmbpzjoJVS5zPgKh2TaaFA7w0hUk5cG1qffVK+1PoGskkKj1QlM1Lj9qlSuhBFjsY0w4+UmvFVzT5xJ5Mdaf4HlNFutsfprYYJ0V5tnw6g6Jp+1l9pN2OIfarV81xDppQDBvRdSmcV9aNwPLSMiMH62Xg0t4ARU/HZw2con7QTuy+03bNSythGj/14G0UzzhP50Ov/kCiA8ZZnSrujxGUxC137hbVWssXHo6MT+jzYnzOlBXU/E8nnFyg0t7ejcHt/hYxdQTNeT4Tm45J6uqH42QzNZQbKfhYAKp+I526q917J6KTaaajnOKZXUqINUI4kCV+Ufz0DSX8oAUMi35ikIMknF/aUN5Q4vsyRhIYQB7bVQ1q0KYIvRMTaLN8xBQTCQ4u4zzoKp9lxicdx1b3GNEOzGsnoqma43CaTHWu73f8CctY3imUYbLhB2B55WPVsk3k+9uWuiDjL7Wd06pnL1JOwm8KGk4hY+6xIHxKKI8rclfNJRgCd/qYgXVMK7v5qJ4F/I/o6PqesivZw/9I6yoDhQ+kjmRGOhpnhVXGmhLTSeJDkk5JkgwPnWr