Chapter 09

Change of Basis

00 · Symbol Glossary

$\mathcal{B}$script B — basis label

A calligraphic letter labelling a specific basis. B={b1,b2,,bn}\mathcal{B} = \{\mathbf{b}_1, \mathbf{b}_2, \ldots, \mathbf{b}_n\} names a choice of nn linearly independent vectors that span the space. Used to distinguish one basis from another when multiple bases are in play at once.

$[\mathbf{v}]_\mathcal{B}$v in basis B — coordinate vector

The coordinate representation of v\mathbf{v} with respect to basis B\mathcal{B}. If v=c1b1+c2b2++cnbn\mathbf{v} = c_1\mathbf{b}_1 + c_2\mathbf{b}_2 + \cdots + c_n\mathbf{b}_n, then [v]B=(c1cn)[\mathbf{v}]_\mathcal{B} = \begin{pmatrix}c_1\\\vdots\\c_n\end{pmatrix}. The same geometric vector v\mathbf{v} has different coordinate vectors in different bases — this is the core idea of the whole chapter.

$P_{\mathcal{B}}$P sub B — change-of-basis matrix

The matrix whose columns are the basis vectors of B\mathcal{B} written in standard coordinates. Converts B\mathcal{B}-coordinates to standard coordinates: v=PB[v]B\mathbf{v} = P_\mathcal{B} [\mathbf{v}]_\mathcal{B}. Its inverse goes the other direction: [v]B=PB1v[\mathbf{v}]_\mathcal{B} = P_\mathcal{B}^{-1}\mathbf{v}.

$[T]_\mathcal{B}$T in basis B — matrix representation

The matrix of a linear transformation TT expressed relative to basis B\mathcal{B}. The same transformation looks like a different matrix when you change the basis — and choosing the right basis can make the matrix diagonal (Chapter 7 diagonalisation is a special case of this).

$P^{-1}AP$P inverse A P — similarity transform

A similarity transformation. Matrices AA and P1APP^{-1}AP represent the same linear transformation in different bases. They share eigenvalues, determinant, and trace — all invariants that do not depend on the choice of basis.


01 · What Changes of Basis Mean

You already know that a vector vR2\mathbf{v} \in \mathbb{R}^2 has coordinates (3,5)(3, 5) — meaning 33 steps in the xx-direction and 55 steps in the yy-direction. But those coordinates depend entirely on the choice of axes. Rotate the axes 45°, and the same physical arrow has completely different coordinate numbers. The arrow does not change; the measuring frame does.

This is the heart of change of basis: one geometric object, infinitely many coordinate descriptions. The standard basis {e1,e2}\{\mathbf{e}_1, \mathbf{e}_2\} is just one choice. Any two linearly independent vectors form a valid alternative.

Definition — Coordinates in a Basis

Let B={b1,,bn}\mathcal{B} = \{\mathbf{b}_1, \ldots, \mathbf{b}_n\} be a basis for Rn\mathbb{R}^n. For any vRn\mathbf{v} \in \mathbb{R}^n there exist unique scalars c1,,cnc_1, \ldots, c_n such that:

v=c1b1+c2b2++cnbn\mathbf{v} = c_1\mathbf{b}_1 + c_2\mathbf{b}_2 + \cdots + c_n\mathbf{b}_n

The coordinate vector of v\mathbf{v} in basis B\mathcal{B} is:

[v]B=(c1c2cn)[\mathbf{v}]_\mathcal{B} = \begin{pmatrix}c_1\\c_2\\\vdots\\c_n\end{pmatrix}

cic_i — the scalar coefficient on the ii-th basis vector. Uniqueness is guaranteed because B\mathcal{B} is a basis (linearly independent and spanning).

✓ Example — Same Vector, Two Descriptions

Let B={b1=(11),  b2=(11)}\mathcal{B} = \left\{\mathbf{b}_1 = \begin{pmatrix}1\\1\end{pmatrix},\; \mathbf{b}_2 = \begin{pmatrix}1\\-1\end{pmatrix}\right\} and v=(31)\mathbf{v} = \begin{pmatrix}3\\1\end{pmatrix}.

In standard coordinates: v=(31)\mathbf{v} = \begin{pmatrix}3\\1\end{pmatrix}.

In B\mathcal{B}-coordinates: solve c1(11)+c2(11)=(31)c_1\begin{pmatrix}1\\1\end{pmatrix} + c_2\begin{pmatrix}1\\-1\end{pmatrix} = \begin{pmatrix}3\\1\end{pmatrix}.

Row 1: c1+c2=3c_1 + c_2 = 3. Row 2: c1c2=1c_1 - c_2 = 1. Adding: 2c1=4c1=22c_1 = 4 \Rightarrow c_1 = 2. Then c2=1c_2 = 1.

Therefore [v]B=(21)[\mathbf{v}]_\mathcal{B} = \begin{pmatrix}2\\1\end{pmatrix}. The same arrow has coordinates (3,1)(3,1) in the standard frame and (2,1)(2,1) in the B\mathcal{B}-frame.

❌ Common Mistake — Coordinates Depend on Basis

Writing [v]B=(31)[\mathbf{v}]_\mathcal{B} = \begin{pmatrix}3\\1\end{pmatrix} by simply copying the standard-coordinate entries. The standard coordinates of v\mathbf{v} are its coefficients with respect to {e1,e2}\{\mathbf{e}_1, \mathbf{e}_2\}, not B\mathcal{B}. Unless B\mathcal{B} happens to be the standard basis, [v]Bv[\mathbf{v}]_\mathcal{B} \neq \mathbf{v}. You must solve the linear system PB[v]B=vP_\mathcal{B} [\mathbf{v}]_\mathcal{B} = \mathbf{v} every time.


02 · The Change-of-Basis Matrix

Solving a linear system each time is slow. The change-of-basis matrix packages the conversion into a single matrix multiplication.

Definition — Change-of-Basis Matrix

Given a basis B={b1,,bn}\mathcal{B} = \{\mathbf{b}_1, \ldots, \mathbf{b}_n\} for Rn\mathbb{R}^n, the change-of-basis matrix is:

PB=(b1b2bn)P_\mathcal{B} = \begin{pmatrix} \mathbf{b}_1 & \mathbf{b}_2 & \cdots & \mathbf{b}_n \end{pmatrix}

the n×nn \times n matrix whose columns are the basis vectors in standard coordinates.

To convert B\mathcal{B}-coordinates to standard: v=PB[v]B\mathbf{v} = P_\mathcal{B}\, [\mathbf{v}]_\mathcal{B}

To convert standard to B\mathcal{B}-coordinates: [v]B=PB1v[\mathbf{v}]_\mathcal{B} = P_\mathcal{B}^{-1}\, \mathbf{v}

PBP_\mathcal{B} is always invertible because the columns are linearly independent (they form a basis).

Step-by-step — Converting $\mathbf{v}=\begin{pmatrix}4\\2\end{pmatrix}$ to $\mathcal{B}$-coordinates where $\mathcal{B}=\left\{\begin{pmatrix}2\\1\end{pmatrix},\begin{pmatrix}0\\1\end{pmatrix}\right\}$
1

Write the change-of-basis matrix: place the basis vectors as columns.

PB=(2011)P_\mathcal{B} = \begin{pmatrix}2 & 0 \\ 1 & 1\end{pmatrix}

Column 1 is b1=(2,1)T\mathbf{b}_1 = (2,1)^T, column 2 is b2=(0,1)T\mathbf{b}_2 = (0,1)^T.

2

Compute PB1P_\mathcal{B}^{-1}: for a 2×22\times 2 matrix (abcd)\begin{pmatrix}a&b\\c&d\end{pmatrix}, the inverse is 1adbc(dbca)\frac{1}{ad-bc}\begin{pmatrix}d&-b\\-c&a\end{pmatrix}.

det(PB)=2101=2\det(P_\mathcal{B}) = 2\cdot1 - 0\cdot1 = 2. Therefore:

PB1=12(1012)P_\mathcal{B}^{-1} = \frac{1}{2}\begin{pmatrix}1 & 0 \\ -1 & 2\end{pmatrix}

The 12\frac{1}{2} comes from dividing every entry by det=2\det = 2.

3

Multiply PB1vP_\mathcal{B}^{-1}\mathbf{v}: convert v=(42)\mathbf{v}=\begin{pmatrix}4\\2\end{pmatrix} to B\mathcal{B}-coordinates.

[v]B=12(1012)(42)=12(44+4)=12(40)=(20)[\mathbf{v}]_\mathcal{B} = \frac{1}{2}\begin{pmatrix}1 & 0 \\ -1 & 2\end{pmatrix}\begin{pmatrix}4\\2\end{pmatrix} = \frac{1}{2}\begin{pmatrix}4\\-4+4\end{pmatrix} = \frac{1}{2}\begin{pmatrix}4\\0\end{pmatrix} = \begin{pmatrix}2\\0\end{pmatrix}

Row 1: 1(4)+0(2)=41(4)+0(2)=4, then 42=2\frac{4}{2}=2. Row 2: 1(4)+2(2)=4+4=0-1(4)+2(2)=-4+4=0, then 02=0\frac{0}{2}=0.

4

Verify: PB[v]B=(2011)(20)=(42)=vP_\mathcal{B}[\mathbf{v}]_\mathcal{B} = \begin{pmatrix}2&0\\1&1\end{pmatrix}\begin{pmatrix}2\\0\end{pmatrix} = \begin{pmatrix}4\\2\end{pmatrix} = \mathbf{v} ✓. The coordinates (2,0)(2,0) mean v=2b1+0b2\mathbf{v} = 2\mathbf{b}_1 + 0\mathbf{b}_2 — the vector v\mathbf{v} is simply twice b1\mathbf{b}_1.


03 · Changing Between Two Non-Standard Bases

When both the source and target are non-standard bases, the conversion routes through standard coordinates.

Definition — Basis Change Between $\mathcal{B}$ and $\mathcal{C}$

Let B\mathcal{B} and C\mathcal{C} be two bases for Rn\mathbb{R}^n with change-of-basis matrices PBP_\mathcal{B} and PCP_\mathcal{C}. Then:

[v]C=PC1PB[v]B[\mathbf{v}]_\mathcal{C} = P_\mathcal{C}^{-1} P_\mathcal{B}\, [\mathbf{v}]_\mathcal{B}

The matrix PC1PBP_\mathcal{C}^{-1} P_\mathcal{B} is the change-of-basis matrix from B\mathcal{B} to C\mathcal{C}. Reading right to left: first convert B\mathcal{B}-coordinates to standard (PBP_\mathcal{B}), then standard to C\mathcal{C}-coordinates (PC1P_\mathcal{C}^{-1}).

Standard Basis Is the Relay Station

Every coordinate conversion routes through standard coordinates. You never need a direct formula between arbitrary bases — compose the two matrices PC1P_\mathcal{C}^{-1} and PBP_\mathcal{B} and the routing happens automatically.


04 · Matrices Under Change of Basis

When a linear transformation T:RnRnT: \mathbb{R}^n \to \mathbb{R}^n has standard matrix AA, its matrix in a different basis B\mathcal{B} is related by a similarity transformation.

Definition — Similarity Transformation

Matrices AA and BB are similar if there exists an invertible matrix PP such that:

B=P1APB = P^{-1}AP

BB is the matrix of the same linear transformation, but expressed in the basis whose vectors are the columns of PP. Similar matrices represent the same transformation and share: eigenvalues, determinant, trace, rank, and characteristic polynomial.

✓ Example — Diagonalisation Is Change of Basis

Diagonalising A=PDP1A = PDP^{-1} is exactly a change of basis. In the basis of eigenvectors (columns of PP), the transformation becomes the diagonal matrix D=P1APD = P^{-1}AP. The transformation scales each eigenvector by its eigenvalue — a much simpler picture than the off-diagonal mixing in AA.

This is why diagonalisation matters: it finds the natural coordinate system for AA.

Step-by-step — Finding $[T]_\mathcal{B}$ for $T(\mathbf{x})=A\mathbf{x}$ with $A=\begin{pmatrix}3&1\\0&2\end{pmatrix}$ in basis $\mathcal{B}=\left\{\begin{pmatrix}1\\0\end{pmatrix},\begin{pmatrix}1\\1\end{pmatrix}\right\}$
1

Write PBP_\mathcal{B}: columns are the basis vectors in standard order.

P=PB=(1101)P = P_\mathcal{B} = \begin{pmatrix}1&1\\0&1\end{pmatrix}
2

Compute P1P^{-1}: det(P)=1110=1\det(P)=1\cdot1-1\cdot0=1, so P1=(1101)P^{-1} = \begin{pmatrix}1&-1\\0&1\end{pmatrix}.

3

Compute APAP: right-multiply AA by PP.

AP=(3102)(1101)=(3402)AP = \begin{pmatrix}3&1\\0&2\end{pmatrix}\begin{pmatrix}1&1\\0&1\end{pmatrix} = \begin{pmatrix}3&4\\0&2\end{pmatrix}

Entry (1,1)(1,1): 3(1)+1(0)=33(1)+1(0)=3. Entry (1,2)(1,2): 3(1)+1(1)=43(1)+1(1)=4. Entry (2,1)(2,1): 0+2(0)=00+2(0)=0. Entry (2,2)(2,2): 0+2(1)=20+2(1)=2.

4

Compute [T]B=P1AP[T]_\mathcal{B} = P^{-1}AP:

[T]B=(1101)(3402)=(3202)[T]_\mathcal{B} = \begin{pmatrix}1&-1\\0&1\end{pmatrix}\begin{pmatrix}3&4\\0&2\end{pmatrix} = \begin{pmatrix}3&2\\0&2\end{pmatrix}

Entry (1,1)(1,1): 1(3)+(1)(0)=31(3)+(-1)(0)=3. Entry (1,2)(1,2): 1(4)+(1)(2)=21(4)+(-1)(2)=2. Entry (2,1)(2,1): 00. Entry (2,2)(2,2): 1(2)=21(2)=2.

In basis B\mathcal{B}, the transformation matrix is upper triangular — same eigenvalues 33 and 22, but simpler off-diagonal structure.

❌ What Breaks — Matrix Change of Basis Is Not Transpose

A common error is computing PTAPP^T A P instead of P1APP^{-1}AP. This equals the similarity transformation only when PP is orthogonal (PT=P1P^T = P^{-1}). For a general change-of-basis matrix, PTP1P^T \neq P^{-1}, so PTAPP^TAP produces a wrong result that does not represent the transformation in the new basis.


05 · Quant Application — PCA as Change of Basis

Principal Component Analysis is exactly a change of basis for a covariance matrix. Given a sample covariance matrix ΣRp×p\Sigma \in \mathbb{R}^{p \times p} (symmetric, positive semi-definite), the spectral theorem guarantees an orthogonal diagonalisation:

Σ=QΛQT\Sigma = Q \Lambda Q^T

where QQ has orthonormal eigenvectors as columns and Λ=diag(λ1,,λp)\Lambda = \text{diag}(\lambda_1, \ldots, \lambda_p) with λ1λ2λp0\lambda_1 \geq \lambda_2 \geq \cdots \geq \lambda_p \geq 0.

Changing to the eigenvector basis means [Σ]Q=Q1ΣQ=QTΣQ=Λ[\Sigma]_Q = Q^{-1}\Sigma Q = Q^T \Sigma Q = \Lambda. In the eigenvector coordinate system, all assets' risk contributions are diagonal — uncorrelated. The original covariance matrix had cross-correlation terms; in the PC basis those vanish.

The first column of QQ points in the direction of maximum variance (λ1\lambda_1 largest). Projecting the return data onto QQ gives the principal component scores — a new set of uncorrelated factors that explain variance in decreasing order.


06 · Practice Exercises

EXERCISE 9.1

Write the change-of-basis matrix PBP_\mathcal{B} by placing b1\mathbf{b}_1 and b2\mathbf{b}_2 as columns. Then apply PB1P_\mathcal{B}^{-1} to v\mathbf{v}.

PB=(1223)P_\mathcal{B} = \begin{pmatrix}1&2\\2&3\end{pmatrix}.

det(PB)=1(3)2(2)=34=1\det(P_\mathcal{B}) = 1(3)-2(2) = 3-4 = -1.

PB1=11(3221)=(3221)P_\mathcal{B}^{-1} = \frac{1}{-1}\begin{pmatrix}3&-2\\-2&1\end{pmatrix} = \begin{pmatrix}-3&2\\2&-1\end{pmatrix}.

[v]B=(3221)(57)=(15+14107)=(13)[\mathbf{v}]_\mathcal{B} = \begin{pmatrix}-3&2\\2&-1\end{pmatrix}\begin{pmatrix}5\\7\end{pmatrix} = \begin{pmatrix}-15+14\\10-7\end{pmatrix} = \begin{pmatrix}-1\\3\end{pmatrix}.

Verify: (1223)(13)=(1+62+9)=(57)=v\begin{pmatrix}1&2\\2&3\end{pmatrix}\begin{pmatrix}-1\\3\end{pmatrix} = \begin{pmatrix}-1+6\\-2+9\end{pmatrix} = \begin{pmatrix}5\\7\end{pmatrix} = \mathbf{v} ✓.

Let B={(12),(23)}\mathcal{B} = \left\{\begin{pmatrix}1\\2\end{pmatrix}, \begin{pmatrix}2\\3\end{pmatrix}\right\} and v=(57)\mathbf{v} = \begin{pmatrix}5\\7\end{pmatrix}. Find [v]B[\mathbf{v}]_\mathcal{B}.

EXERCISE 9.2

Compute the change-of-basis matrix from B\mathcal{B} to C\mathcal{C} as PC1PBP_\mathcal{C}^{-1} P_\mathcal{B}. Apply it to the given coordinates.

PB=(2001)P_\mathcal{B} = \begin{pmatrix}2&0\\0&1\end{pmatrix} and PC=(1102)P_\mathcal{C} = \begin{pmatrix}1&1\\0&2\end{pmatrix}.

det(PC)=2\det(P_\mathcal{C})=2, so PC1=12(2101)P_\mathcal{C}^{-1} = \frac{1}{2}\begin{pmatrix}2&-1\\0&1\end{pmatrix}.

[v]C=PC1PB[v]B=12(2101)(2001)(31)[\mathbf{v}]_\mathcal{C} = P_\mathcal{C}^{-1}P_\mathcal{B}[\mathbf{v}]_\mathcal{B} = \frac{1}{2}\begin{pmatrix}2&-1\\0&1\end{pmatrix}\begin{pmatrix}2&0\\0&1\end{pmatrix}\begin{pmatrix}3\\1\end{pmatrix}.

PC1PB=12(4101)P_\mathcal{C}^{-1}P_\mathcal{B} = \frac{1}{2}\begin{pmatrix}4&-1\\0&1\end{pmatrix}.

12(4101)(31)=12(1211)=(11/21/2)\frac{1}{2}\begin{pmatrix}4&-1\\0&1\end{pmatrix}\begin{pmatrix}3\\1\end{pmatrix} = \frac{1}{2}\begin{pmatrix}12-1\\1\end{pmatrix} = \begin{pmatrix}11/2\\1/2\end{pmatrix}.

Let B={(20),(01)}\mathcal{B} = \left\{\begin{pmatrix}2\\0\end{pmatrix}, \begin{pmatrix}0\\1\end{pmatrix}\right\} and C={(10),(12)}\mathcal{C} = \left\{\begin{pmatrix}1\\0\end{pmatrix}, \begin{pmatrix}1\\2\end{pmatrix}\right\}. Given [v]B=(31)[\mathbf{v}]_\mathcal{B} = \begin{pmatrix}3\\1\end{pmatrix}, find [v]C[\mathbf{v}]_\mathcal{C}.

EXERCISE 9.3

Form PP from the eigenvectors and compute P1APP^{-1}AP. The result should be diagonal.

Eigenvalues of A=(4213)A=\begin{pmatrix}4&2\\1&3\end{pmatrix}: p(λ)=(4λ)(3λ)2=λ27λ+10=(λ5)(λ2)p(\lambda)=(4-\lambda)(3-\lambda)-2=\lambda^2-7\lambda+10=(\lambda-5)(\lambda-2), so λ1=5\lambda_1=5, λ2=2\lambda_2=2.

For λ=5\lambda=5: (A5I)=(1212)(A-5I)=\begin{pmatrix}-1&2\\1&-2\end{pmatrix}; eigenvector v1=(21)\mathbf{v}_1=\begin{pmatrix}2\\1\end{pmatrix}.

For λ=2\lambda=2: (A2I)=(2211)(A-2I)=\begin{pmatrix}2&2\\1&1\end{pmatrix}; eigenvector v2=(11)\mathbf{v}_2=\begin{pmatrix}-1\\1\end{pmatrix}.

P=(2111)P=\begin{pmatrix}2&-1\\1&1\end{pmatrix}, det(P)=3\det(P)=3, P1=13(1112)P^{-1}=\frac{1}{3}\begin{pmatrix}1&1\\-1&2\end{pmatrix}.

P1AP=(5002)P^{-1}AP = \begin{pmatrix}5&0\\0&2\end{pmatrix} ✓ — diagonal, eigenvalues on diagonal.

For A=(4213)A = \begin{pmatrix}4&2\\1&3\end{pmatrix}, find the change-of-basis matrix PP to the eigenvector basis and compute [T]P=P1AP[T]_P = P^{-1}AP. Verify the result is diagonal.

EXERCISE 9.4

Similar matrices satisfy B=P1APB = P^{-1}AP. They share eigenvalues because the characteristic polynomial is invariant: det(BλI)=det(P1(AλI)P)=det(AλI)\det(B-\lambda I) = \det(P^{-1}(A-\lambda I)P) = \det(A-\lambda I).

Shared eigenvalues: det(P1APλI)=det(P1(AλI)P)=det(P1)det(AλI)det(P)=det(AλI)\det(P^{-1}AP - \lambda I) = \det(P^{-1}(A-\lambda I)P) = \det(P^{-1})\det(A-\lambda I)\det(P) = \det(A-\lambda I) since det(P1)det(P)=1\det(P^{-1})\det(P)=1. Same characteristic polynomial \Rightarrow same eigenvalues.

Shared determinant: det(P1AP)=det(P1)det(A)det(P)=det(A)\det(P^{-1}AP) = \det(P^{-1})\det(A)\det(P) = \det(A).

Shared trace: tr(P1AP)=tr(APP1)=tr(A)\text{tr}(P^{-1}AP) = \text{tr}(APP^{-1}) = \text{tr}(A) by the cyclic property of trace.

Shared rank: P1APP^{-1}AP and AA have the same null space dimension (multiplying by invertible matrices preserves rank).

These quantities are basis-independent invariants of the linear transformation itself.

Prove that similar matrices AA and B=P1APB = P^{-1}AP share the same eigenvalues, determinant, trace, and rank. For each, state which property of det\det or tr\text{tr} makes the proof work.

EXERCISE 9.5

A matrix AA is diagonalisable     \iff it has nn linearly independent eigenvectors. The change-of-basis matrix PP then diagonalises it. If eigenvectors span Rn\mathbb{R}^n, write them as columns of PP.

A=(2102)A=\begin{pmatrix}2&1\\0&2\end{pmatrix} has repeated eigenvalue λ=2\lambda=2 (algebraic multiplicity 2). (A2I)=(0100)(A-2I)=\begin{pmatrix}0&1\\0&0\end{pmatrix}; ker(A2I)=span{(10)}\ker(A-2I) = \text{span}\left\{\begin{pmatrix}1\\0\end{pmatrix}\right\}, geometric multiplicity 1.

Since geometric multiplicity (1) << algebraic multiplicity (2), the matrix is not diagonalisable — there is no basis of eigenvectors. No change-of-basis matrix PP can produce a diagonal matrix P1APP^{-1}AP.

The best achievable is the Jordan form (2102)\begin{pmatrix}2&1\\0&2\end{pmatrix} — which is already the Jordan normal form of AA.

The matrix A=(2102)A = \begin{pmatrix}2&1\\0&2\end{pmatrix} has eigenvalue λ=2\lambda=2 with algebraic multiplicity 2. Determine whether AA is diagonalisable (i.e., whether a change-of-basis matrix to a diagonal representation exists) and explain why or why not.

EXERCISE 9.6

The covariance matrix Σ\Sigma is symmetric, so its eigenvectors are orthogonal. The change of basis QTΣQ=ΛQ^T \Sigma Q = \Lambda transforms to principal component coordinates. Portfolio variance in PC coordinates is wPCTΛwPC=iλiwi2\mathbf{w}_{PC}^T \Lambda \mathbf{w}_{PC} = \sum_i \lambda_i w_i^2.

Σ=(4221)\Sigma = \begin{pmatrix}4&2\\2&1\end{pmatrix}.

Eigenvalues: p(λ)=(4λ)(1λ)4=λ25λ=λ(λ5)p(\lambda)=(4-\lambda)(1-\lambda)-4=\lambda^2-5\lambda=\lambda(\lambda-5), so λ1=5\lambda_1=5, λ2=0\lambda_2=0.

For λ=5\lambda=5: (Σ5I)v=0(Σ-5I)\mathbf{v}=0 gives (1224)v=0\begin{pmatrix}-1&2\\2&-4\end{pmatrix}\mathbf{v}=0; eigenvector v1=15(21)\mathbf{v}_1=\frac{1}{\sqrt{5}}\begin{pmatrix}2\\1\end{pmatrix}.

For λ=0\lambda=0: Σv=0\Sigma\mathbf{v}=0 gives v2=15(12)\mathbf{v}_2=\frac{1}{\sqrt{5}}\begin{pmatrix}-1\\2\end{pmatrix}.

Q=15(2112)Q = \frac{1}{\sqrt{5}}\begin{pmatrix}2&-1\\1&2\end{pmatrix}, Λ=(5000)\Lambda = \begin{pmatrix}5&0\\0&0\end{pmatrix}.

λ2=0\lambda_2=0 means the portfolio has a zero-variance direction — the assets are perfectly collinear. In the PC basis, wPC=QTw\mathbf{w}_{PC} = Q^T\mathbf{w}; all portfolio variance concentrates in PC1. Holding the λ2=0\lambda_2=0 direction incurs no variance — it is the risk-free combination of these two assets.

A two-asset portfolio has covariance matrix Σ=(4221)\Sigma = \begin{pmatrix}4&2\\2&1\end{pmatrix}. Find the orthogonal change-of-basis matrix QQ that diagonalises Σ\Sigma (i.e., QTΣQ=ΛQ^T\Sigma Q = \Lambda). Interpret the result: what does λ2=0\lambda_2 = 0 mean for portfolio construction?


07 · Chapter Summary

ConceptFormula / Rule
Coordinate vector[v]B=(c1,,cn)T[\mathbf{v}]_\mathcal{B} = (c_1,\ldots,c_n)^T where v=cibi\mathbf{v}=\sum c_i\mathbf{b}_i
Change-of-basis matrixPBP_\mathcal{B} = columns are basis vectors in standard coords
Standard from B\mathcal{B}v=PB[v]B\mathbf{v} = P_\mathcal{B}[\mathbf{v}]_\mathcal{B}
B\mathcal{B} from standard[v]B=PB1v[\mathbf{v}]_\mathcal{B} = P_\mathcal{B}^{-1}\mathbf{v}
B\mathcal{B} to C\mathcal{C}[v]C=PC1PB[v]B[\mathbf{v}]_\mathcal{C} = P_\mathcal{C}^{-1}P_\mathcal{B}[\mathbf{v}]_\mathcal{B}
Similarity transform[T]B=P1AP[T]_\mathcal{B} = P^{-1}AP; same eigenvalues, det, trace
DiagonalisationSpecial case: PP = eigenvector matrix; [T]P=Λ[T]_P = \Lambda
PCACovariance Σ=QΛQT\Sigma = Q\Lambda Q^T; PC basis decorrelates risk

Next: Chapter 10 — Inner Products & Orthogonality generalises the dot product to abstract vector spaces and establishes the precise meaning of "angle" and "perpendicularity" in any dimension.