Eigenvalue Definition

A financial model designed to predict asset growth suddenly shows some assets skyrocketing while others stagnate, even though their underlying drivers appear similar. The model's outputs are wildly disproportionate, making it impossible to trust. What's causing this uneven, almost chaotic, scaling behavior within the system, and how can we quantify it? It turns out, understanding these specific directions of disproportionate scaling is crucial, and the factor by which they scale is precisely what we call an eigenvalue.

Eigenvectors: The Unchanged Directions

Recall that an eigenvector is a special non-zero vector that, when a linear transformation is applied to it, only changes in magnitude (scales) but not in direction. It remains on the same span as the original vector. This unique property makes eigenvectors fundamental for understanding the intrinsic behavior of linear transformations, revealing the directions along which a transformation acts purely as a stretch or a compression.

Seeing the Scale: How Transformations Stretch

Eigenvector Scaling by a Linear Transformation

This plot shows how a linear transformation scales eigenvectors along their original directions, without rotation. The original vectors

v_1=(1,0)

and

v_2=(0,1)

are transformed into

A v_1=(2,0)

and

A v_2=(0,0.5)

respectively, demonstrating pure scaling.

Loading chart...

Key Insight: Eigenvectors maintain their direction, only changing in length (scaling) after transformation. The amount of scaling varies for different eigenvectors.

The Scaling Factor: Meet the Eigenvalue

The visualization clearly shows that while the eigenvectors' directions remain constant, their lengths change. This change in length is a direct result of the linear transformation acting upon them. The scalar factor by which an eigenvector is stretched or shrunk is precisely what we define as its eigenvalue. It's the numerical value that quantifies the extent of this scaling effect.

Formalizing the Relationship: The Eigenvalue Equation

📐 The Eigenvalue Equation

Av = \lambda v

Here, $A$ is the linear transformation matrix, $v$ is the non-zero eigenvector, and $\lambda$ (lambda) is the eigenvalue, representing the scalar factor by which $v$ is scaled. This equation states that applying the transformation $A$ to $v$ is equivalent to simply scaling $v$ by $\lambda$ .

Eigenvalue

A scalar

\lambda

(lambda) that, for a given linear transformation represented by matrix

A

, satisfies the equation

Av = \lambda v

for a non-zero vector

v

. It quantifies the scaling factor applied to the eigenvector, indicating how much the eigenvector is stretched or shrunk.

Example: If a matrix

A

transforms a vector

v

such that

Av = 3v

, then

3

is an eigenvalue of

A

associated with eigenvector

v

, meaning

v

is stretched by a factor of 3. If

Av = -0.5v

, then

-0.5

is an eigenvalue, meaning

v

is shrunk by half and its direction is reversed.

Interpreting Magnitude: How Much Does it Scale?

The absolute value of an eigenvalue, $|\lambda|$ , tells us about the extent of scaling. If $|\lambda| > 1$ , the eigenvector is stretched, meaning its length increases after the transformation. Conversely, if $|\lambda| < 1$ , the eigenvector is shrunk or compressed, resulting in a shorter length. When $|\lambda| = 1$ , the eigenvector's length remains unchanged, indicating no scaling effect on its magnitude.

Interpreting Sign: Does it Flip Direction?

Beyond magnitude, the sign of an eigenvalue provides crucial information about the eigenvector's direction. A positive eigenvalue ( $\lambda > 0$ ) means the eigenvector's direction is preserved after the transformation; it points in the same general direction. However, a negative eigenvalue ( $\lambda < 0$ ) indicates that the eigenvector's direction is reversed, effectively flipping it 180 degrees while still keeping it on the same line.

Check Your Understanding

If an eigenvalue is

-0.5

, what does this indicate about the corresponding eigenvector's transformation?

Why Eigenvalues Matter: Beyond the Math

Eigenvalues are not just abstract mathematical concepts; they are critical for understanding the behavior of complex systems. In Principal Component Analysis (PCA), eigenvalues quantify the amount of variance captured along each principal component, helping to reduce data dimensionality. In engineering, they are used in stability analysis to determine if a system will return to equilibrium or diverge chaotically. They provide a quantitative measure of the disproportionate scaling effects observed in many real-world phenomena, from financial markets to quantum mechanics.

Key Takeaways

An eigenvalue ( $\lambda$ ) is the scalar factor by which an eigenvector ( $v$ ) is scaled under a linear transformation ( $A$ ).
The relationship is formalized by the eigenvalue equation: $Av = \lambda v$ .
The magnitude of an eigenvalue, $|\lambda|$ , indicates whether the eigenvector is stretched ( $|\lambda| > 1$ ), shrunk ( $|\lambda| < 1$ ), or remains the same length ( $|\lambda| = 1$ ).
The sign of an eigenvalue indicates direction: $\lambda > 0$ preserves direction, while $\lambda < 0$ reverses it.
Eigenvalues are crucial for quantifying disproportionate scaling effects in systems, helping to explain phenomena like the uneven asset growth in our financial model scenario.

← All lessons in Linear Algebra: Eigenvalues