Solution. The dot productlink of the column vectors of $\boldsymbol{Q}$ is $0$, which means that the column vectors are orthogonal. Also, the column vectors are of unit length and thus by theoremlink, we have that $\boldsymbol{Q}$ is an orthogonal matrix.

Let's now compute $\boldsymbol{Q}\boldsymbol{BQ}^T$ like so:

If we let $\boldsymbol{A}$ equal this matrix, then $\boldsymbol{A}$ will be orthogonally similar to $\boldsymbol{B}$.

Proof. By definitionlink, if $\boldsymbol{A}$ is orthogonally similar to $\boldsymbol{B}$, then there exists an orthogonal matrix $\boldsymbol{Q}$ such that:

Where the second equality follows because $\boldsymbol{Q}^T= \boldsymbol{Q}^{-1}$ by propertylink. Since $\boldsymbol{Q}$ is invertible by propertylink, $\boldsymbol{Q}^{-1}$ exists. This means that $\boldsymbol{A}$ and $\boldsymbol{B}$ are similarlink by definition. This completes the proof.

Because orthogonally similar matrices are similar matrices, orthogonally similar matrices enjoy all the nice properties of similar matrices! For instance, orthogonally similar matrices are commutative, which means that if $\boldsymbol{A}$ is orthogonally similar to $\boldsymbol{B}$, then $\boldsymbol{B}$ is orthogonally similar to $\boldsymbol{A}$. To learn more about the other properties of similar matrices, please check out our guide on similar matrices.

Proof. By definitionlink, if $\boldsymbol{A}$ is orthogonally diagonalizable, then there exists an orthogonal matrix $\boldsymbol{Q}$ and diagonal matrix $\boldsymbol{D}$ such that:

By propertylink of orthogonal matrices, we have that $\boldsymbol{Q}^T=\boldsymbol{Q}^{-1}$. Therefore, \eqref{eq:MZoWp18igntt89SRfef} becomes:

This completes the proof.

Proof. By definitionlink, if $\boldsymbol{A}$ is orthogonally diagonalizable, then there exists an orthogonal matrix $\boldsymbol{Q}$ and a diagonal matrix $\boldsymbol{D}$ such that:

Note that the second equality follow because of propertylink, that is, $\boldsymbol{Q}^T=\boldsymbol{Q}^{-1}$.

Now, recall that an $n\times{n}$ matrix $\boldsymbol{A}$ is said to be diagonalizablelink if there exists an invertible matrix $\boldsymbol{P}$ and a diagonal matrix $\boldsymbol{D}$ such that:

Since any orthogonal matrix $\boldsymbol{Q}$ is invertible by propertylink, we conclude that orthogonally diagonalizable matrices are diagonalizable. This completes the proof.

This means that orthogonally diagonalizable matrices inherit all the properties of diagonalizable matrices! For instance, given $\boldsymbol{A}=\boldsymbol{QDQ}^T$, the column vectors of $\boldsymbol{Q}$ are the eigenvectors of $\boldsymbol{A}$ and the diagonal entries of $\boldsymbol{D}$ are the corresponding eigenvalues. However, orthogonal diagonalization requires a stricter condition that the eigenvectors must be orthogonal, which for many matrices is not true. In other words, most matrices are not orthogonally diagonalizable (although they may be diagonalizable).

We will now state and prove an extraordinary theorem that dictates what type of matrices is orthogonally diagonalizable.

Proof. We start by proving the forward proposition, which is much simpler than the proof of the converse. By definitionlink, if $\boldsymbol{A}$ is orthogonally diagonalizable, then there exist an orthogonal matrix $\boldsymbol{Q}$ and a diagonal matrix $\boldsymbol{D}$ such that:

Now, let's take the transpose of both sides:

Here, we used theoremlink for the second equality and theoremlink for $\boldsymbol{D}^T=\boldsymbol{D}$.

Since the transpose of $\boldsymbol{A}$ is equal to itself, $\boldsymbol{A}$ must be symmetric by definitionlink. This completes the proof of the forward proposition.

We will now prove the converse by induction on the size $n$ of a symmetric matrix $\boldsymbol{A}$. For the base case, suppose $n=1$, that is, $\boldsymbol{A}$ is a $1\times{1}$ symmetric matrix. Let's check if $\boldsymbol{A}$ is orthogonally diagonalizable:

Since $(1)$ is an orthogonal matrix and $(a)$ is a diagonal matrix, we conclude that $\boldsymbol{A}$ is orthogonally diagonalizable by definitionlink. We now assume that if $\boldsymbol{A}$ is an $(n-1)\times(n-1)$ symmetric matrix, then $\boldsymbol{A}$ is orthogonally diagonalizable. Our goal is to show that if $\boldsymbol{A}$ is an $n\times{n}$ symmetric matrix, then $\boldsymbol{A}$ is orthogonally diagonalizable.

Suppose $\boldsymbol{A}$ is an $n\times{n}$ symmetric matrix. Let $\lambda_1$ be an eigenvalue of $\boldsymbol{A}$ and let $\boldsymbol{x}_1$ be the corresponding eigenvector. Let $\boldsymbol{q}_1=\boldsymbol{x}_1$ and we apply theoremlink to construct a basis for $\mathbb{R}^n$ using $\boldsymbol{q}_1$. Suppose this basis is:

We now use the Gram-Schmidt processlink to convert this basis into an orthonormal basislink $\{\boldsymbol{q}_1,\boldsymbol{q}_2,\cdots,\boldsymbol{q}_n\}$ for $\mathbb{R}^n$. Let's define an orthogonal matrix $\boldsymbol{Q}_1$ whose column vectors are $\boldsymbol{q}_1$, $\boldsymbol{q}_2$, $\cdots$, $\boldsymbol{q}_n$ like so:

Now, consider $\boldsymbol{B}= \boldsymbol{Q}_1^{T}\boldsymbol{A}\boldsymbol{Q}_1$. Let's first show that $\boldsymbol{B}$ is symmetric:

Note that we used theoremlink for the first step. Since $\boldsymbol{B}^T=\boldsymbol{B}$, we have that $\boldsymbol{B}$ is a symmetric matrix by definitionlink.

Let's now evaluate the right-hand side of $\boldsymbol{B}= \boldsymbol{Q}^T_1\boldsymbol{A}\boldsymbol{Q}_1$ like so:

Here, we used theoremlink for the last step. The top-left entry of $\boldsymbol{B}$ is:

Now, recall that $\boldsymbol{q}_1$ is an eigenvector corresponding to the eigenvalue $\lambda_1$. By definition then, the following is true:

Substituting \eqref{eq:nwSUU2wYAAmUmcPgtBv} into the right-hand side of \eqref{eq:rWZWVlSi936aOGhV9hP} gives:

Here, we used:

• the theoremlink that $\boldsymbol{q}_1\cdot\boldsymbol{q}_1= \Vert\boldsymbol{q}_1\Vert^2$.

• $\Vert\boldsymbol{q}_1\Vert=1$ since $\boldsymbol{q}_1$ is orthonormal and thus has a magnitude of $1$.

Let's now focus on the other entries of the first column of $\boldsymbol{B}$ in \eqref{eq:ZaNbHzF3mH8VKKOMxcd}. The $2$nd, $3$rd, $\cdots$, $n$-th entries of the first column are:

This means that the composition of the first column of $\boldsymbol{B}$ is:

• the first entry is $\lambda_1$.

• the rest of the entries is $0$.

Let's now focus on the first row of $\boldsymbol{B}$. We have proven that $\boldsymbol{B}$ is a symmetric matrix, which means that the first column of $\boldsymbol{B}$ is equal to the first row of $\boldsymbol{B}$. Therefore, the composition of the first row of $\boldsymbol{B}$ is:

• the first entry is $\lambda_1$.

• the rest of the entries is $0$.

Therefore, we have that:

Here, we are using representing $\boldsymbol{B}$ as a block matrixlink:

• $\boldsymbol{0}$ is a zero matrix.

• $\boldsymbol{C}$ represents the blue sub-matrix.

We don't know the exact entries of $\boldsymbol{C}$ but we do know the following:

• shape of $\boldsymbol{C}$ is $(n-1)\times(n-1)$.

• $\boldsymbol{C}$ is symmetric because $\boldsymbol{B}$ is symmetric.

We now use the inductive assumption that any $(n-1)\times(n-1)$ symmetric matrix is orthogonally diagonalizable. This means that $\boldsymbol{C}$ is orthogonally diagonalizable. By definitionlink of orthogonally diagonalizable matrices, we have that:

Where $\boldsymbol{D}$ is an $(n-1)\times(n-1)$ diagonal matrix and $\boldsymbol{P}$ is an $(n-1)\times(n-1)$ orthogonal matrix, which we define as a collection of row vectors:

Now, define an $n\times{n}$ block matrix $\boldsymbol{Q}_2$ like so:

Our goal is to show that $\boldsymbol{Q}_1\boldsymbol{Q}_2$ orthogonally diagonalizes $\boldsymbol{A}$. By definitionlink then, we must show that:

• $\boldsymbol{Q}_1\boldsymbol{Q}_2$ is orthogonal.

• $(\boldsymbol{Q}_1\boldsymbol{Q}_2)^T \boldsymbol{A} (\boldsymbol{Q}_1\boldsymbol{Q}_2)$ results in a diagonal matrix.

Let's start by showing that $\boldsymbol{Q}_2$ is orthogonal. By theoremlink, the transpose of $\boldsymbol{Q}_2$ is:

By theoremlink, we can evaluate $\boldsymbol{Q}_2\boldsymbol{Q}^T_2$ in block form like so:

Because $\boldsymbol{P}$ is orthogonal, we have that $\boldsymbol{PP}^T= \boldsymbol{I}_{n-1}$ by definitionlink. This means $\boldsymbol{Q}_2\boldsymbol{Q}^T_2=\boldsymbol{I}_n$ and so $\boldsymbol{Q}_2$ is orthogonal by definitionlink. Now, by theoremlink, because $\boldsymbol{Q}_1$ and $\boldsymbol{Q}_2$ are both orthogonal, we have that their product $\boldsymbol{Q}_1\boldsymbol{Q}_2$ is also orthogonal.

Now, we must show that $(\boldsymbol{Q}_1\boldsymbol{Q}_2)^T \boldsymbol{A} (\boldsymbol{Q}_1\boldsymbol{Q}_2)$ results in a diagonal matrix:

Note the following:

• for the first equality, we used theoremlink $(\boldsymbol{AB})^T=\boldsymbol{B}^T\boldsymbol{A}^T$.

• for the third equality, we used the definition $\boldsymbol{B}=\boldsymbol{Q}^T_1\boldsymbol{A}\boldsymbol{Q}_1$.

• for the multiplication of block matrices, we used theoremlink.

• for the last equality, we used the definition $\boldsymbol{D}=\boldsymbol{P}^T\boldsymbol{C}\boldsymbol{P}$.

Since $\boldsymbol{D}$ is a diagonal matrix, we have that \eqref{eq:e3E4DXBim5OT3VSMhMO} is diagonal.

Because $\boldsymbol{Q}_1\boldsymbol{Q}_2$ is orthogonal and $(\boldsymbol{Q}_1\boldsymbol{Q}_2)^T \boldsymbol{A}(\boldsymbol{Q}_1\boldsymbol{Q}_2)$ results in a diagonal matrix, we conclude that $\boldsymbol{Q}_1\boldsymbol{Q}_2$ orthogonally diagonalizes $\boldsymbol{A}$. In other words, $\boldsymbol{A}$ is orthogonally diagonalizable. This completes the proof.

Proof. We first prove the forward proposition. Let $\boldsymbol{A}$ be an $n\times{n}$ orthogonally diagonalizable matrix, which means that there exists an orthogonal matrix $\boldsymbol{Q}$ and a diagonal matrix $\boldsymbol{D}$ such that:

Since an orthogonally diagonalizable matrix is also a diagonalizable matrix by theoremlink, we can apply the diagonalization theoremlink. This means that the columns of $\boldsymbol{Q}$ are the eigenvectors of $\boldsymbol{A}$. Since $\boldsymbol{Q}$ is an orthogonal matrix, the columns of $\boldsymbol{Q}$ are orthogonal by propertylink. Therefore, the set of eigenvectors of $\boldsymbol{A}$ is orthogonal. By theoremlink, we can convert this orthogonal set into an orthonormal set. This completes the proof of the forward proposition.

Let's now prove the converse. Let $\boldsymbol{A}$ be an $n\times{n}$ matrix with an orthonormal set of $n$ eigenvectors $\boldsymbol{q}_1$, $\boldsymbol{q}_2$, $\cdots$, $\boldsymbol{q}_n$. Let the corresponding eigenvalues be $\lambda_1$, $\lambda_2$, $\cdots$, $\lambda_n$. By definitionlink of eigenvalues and eigenvectors, the following equations hold:

Let $\boldsymbol{Q}$ be a matrix whose column vectors are $\boldsymbol{q}_1$, $\boldsymbol{q}_2$, $\cdots$, $\boldsymbol{q}_n$ like so:

Since the column vectors of $\boldsymbol{Q}$ are orthonormal, $\boldsymbol{Q}$ is an orthogonal matrix by theoremlink. Using theoremlink, the product $\boldsymbol{AQ}$ can be written as:

Now, we use \eqref{eq:ZyE5KJCsAVLL48QgSrz} to get:

Using theoremlink, this can be separated into:

Therefore, we have that $\boldsymbol{AQ}=\boldsymbol{QD}$. Because $\boldsymbol{Q}$ is an orthogonal matrix, $\boldsymbol{Q}$ is invertible by propertylink and so $\boldsymbol{Q}^{-1}$ exists. Finally, we perform some basic matrix manipulation:

This means that $\boldsymbol{A}$ is orthogonally diagonalizable by definitionlink. This completes the proof.

Proof. $(1)\Longleftrightarrow(2)$ is true by the real spectral theoremlink. $(1)\Longleftrightarrow(3)$ is true by theoremlink. Therefore, we have that:

This completes the proof.

Proof. Let $\boldsymbol{A}$ be a symmetric matrix. Denote any two distinct eigenvalues of $\boldsymbol{A}$ as $\lambda_1$ and $\lambda_2$ with corresponding eigenvectors $\boldsymbol{x}_1$ and $\boldsymbol{x}_2$. Our goal is to show that $\boldsymbol{x}_1$ and $\boldsymbol{x}_2$ are orthogonal.

By definitionlink of eigenvalues and eigenvectors, we have that:

Let's focus on the first equation. Taking the transpose of both sides gives:

By propertylink and propertylink of matrix transpose, we have that:

Since $\boldsymbol{A}$ is symmetric, $\boldsymbol{A}^T=\boldsymbol{A}$. Therefore, we have:

Multiplying both sides by eigenvector $\boldsymbol{x}_2$ gives:

Using the second equation of \eqref{eq:iR4kSnCnYf90PSjY8zB}, we get:

Because $\lambda_2$ and $\lambda_1$ are distinct, we have that $\lambda_2-\lambda_1\ne0$ and thus:

By theoremlink, $\boldsymbol{x}_1$ and $\boldsymbol{x}_2$ must be orthogonal. This completes the proof.

Solution. The characteristic polynomiallink of $\boldsymbol{A}$ is:

The eigenvalues of $\boldsymbol{A}$ are $\lambda_1=3$ and $\lambda_2 =-1$. We now find the eigenvectors corresponding to each of these eigenvalues:

Let $x_{12}=r$ where $r$ is some scalar. Using the first row, we get $x_{11}=r$. Therefore, the eigenvectors corresponding to $\lambda_1=3$ can be expressed as:

Let's now get the eigenvectors corresponding to $\lambda_2=-1$ below:

Let $x_{22}=t$ where $t\in\mathbb{R}$. Using the first row, we get $x_{21}=-t$. Therefore, the eigenvectors corresponding to $\lambda_2=-1$ can be expressed as:

Let's now check that the eigenvectors corresponding to $\lambda_1$ and $\lambda_2$ are orthogonal:

Since the dot product of the two eigenvectors is $0$, they are orthogonal by theoremlink.

Solution. Firstly, since matrix $\boldsymbol{A}$ is symmetric, $\boldsymbol{A}$ is orthogonally diagonalizable by theoremlink. This means that there exists an orthogonal matrix $\boldsymbol{Q}$ and a diagonal matrix $\boldsymbol{D}$ such that:

In examplelink, we found that:

Let's normalize the eigenvectors:

We can now orthogonally diagonalize $\boldsymbol{A}$ like so: