## Section 4.1 Boundary value problems

*Note: 2 lectures, similar to §3.8 in [EP], §10.1 and §11.1 in [BD]*

### Subsection 4.1.1 Boundary value problems

Before we tackle the Fourier series, we study the so-called *boundary value problems* (or *endpoint problems*). Consider

for some constant \(\lambda\text{,}\) where \(x(t)\) is defined for \(t\) in the interval \([a,b]\text{.}\) Previously we specified the value of the solution and its derivative at a single point. Now we specify the value of the solution at two different points. As \(x=0\) is a solution, existence of solutions is not a problem. Uniqueness of solutions is another issue. The general solution to \(x'' + \lambda x = 0\) has two arbitrary constants^{ 1 }. It is, therefore, natural (but wrong) to believe that requiring two conditions guarantees a unique solution.

###### Example 4.1.1.

Take \(\lambda = 1\text{,}\) \(a=0\text{,}\) \(b=\pi\text{.}\) That is,

Then \(x = \sin t\) is another solution (besides \(x=0\)) satisfying both boundary conditions. There are more. Write down the general solution of the differential equation, which is \(x= A \cos t + B \sin t\text{.}\) The condition \(x(0) = 0\) forces \(A=0\text{.}\) Letting \(x(\pi) = 0\) does not give us any more information as \(x = B \sin t\) already satisfies both boundary conditions. Hence, there are infinitely many solutions of the form \(x = B \sin t\text{,}\) where \(B\) is an arbitrary constant.

###### Example 4.1.2.

On the other hand, consider \(\lambda = 2\text{.}\) That is,

Then the general solution is \(x= A \cos ( \sqrt{2}\,t) + B \sin ( \sqrt{2}\,t)\text{.}\) Letting \(x(0) = 0\) still forces \(A = 0\text{.}\) We apply the second condition to find \(0=x(\pi) = B \sin ( \sqrt{2}\,\pi)\text{.}\) As \(\sin ( \sqrt{2}\,\pi) \not= 0\) we obtain \(B = 0\text{.}\) Therefore \(x=0\) is the unique solution to this problem.

What is going on? We will be interested in finding which constants \(\lambda\) allow a nonzero solution, and we will be interested in finding those solutions. This problem is an analogue of finding eigenvalues and eigenvectors of matrices.

### Subsection 4.1.2 Eigenvalue problems

For basic Fourier series theory we will need the following three eigenvalue problems. We will consider more general equations and boundary conditions, but we will postpone this until Chapter 5.

and

A number \(\lambda\) is called an *eigenvalue* of (4.1) (resp. (4.2) or (4.3)) if and only if there exists a nonzero (not identically zero) solution to (4.1) (resp. (4.2) or (4.3)) given that specific \(\lambda\text{.}\) A nonzero solution is called a corresponding *eigenfunction*.

Note the similarity to eigenvalues and eigenvectors of matrices. The similarity is not just coincidental. If we think of the equations as differential operators, then we are doing the same exact thing. Think of a function \(x(t)\) as a vector with infinitely many components (one for each \(t\)). Let \(L = -\frac{d^2}{{dt}^2}\) be the linear operator. Then the eigenvalue/eigenfunction pair should be \(\lambda\) and nonzero \(x\) such that \(Lx = \lambda x\text{.}\) In other words, we are looking for nonzero functions \(x\) satisfying certain endpoint conditions that solve \((L- \lambda)x = 0\text{.}\) A lot of the formalism from linear algebra still applies here, though we will not pursue this line of reasoning too far.

###### Example 4.1.3.

Let us find the eigenvalues and eigenfunctions of

We have to handle the cases \(\lambda > 0\text{,}\) \(\lambda = 0\text{,}\) \(\lambda < 0\) separately. First suppose that \(\lambda > 0\text{.}\) Then the general solution to \(x''+\lambda x = 0\) is

The condition \(x(0) = 0\) implies immediately \(A = 0\text{.}\) Next

If \(B\) is zero, then \(x\) is not a nonzero solution. So to get a nonzero solution we must have that \(\sin ( \sqrt{\lambda}\, \pi) = 0\text{.}\) Hence, \(\sqrt{\lambda}\, \pi\) must be an integer multiple of \(\pi\text{.}\) In other words, \(\sqrt{\lambda} = k\) for a positive integer \(k\text{.}\) Hence the positive eigenvalues are \(k^2\) for all integers \(k \geq 1\text{.}\) Corresponding eigenfunctions can be taken as \(x=\sin (k t)\text{.}\) Just like for eigenvectors, constant multiples of an eigenfunction are also eigenfunctions, so we only need to pick one.

Now suppose that \(\lambda = 0\text{.}\) In this case the equation is \(x'' = 0\text{,}\) and its general solution is \(x = At + B\text{.}\) The condition \(x(0) = 0\) implies that \(B=0\text{,}\) and \(x(\pi) = 0\) implies that \(A = 0\text{.}\) This means that \(\lambda
= 0\) is *not* an eigenvalue.

Finally, suppose that \(\lambda < 0\text{.}\) In this case we have the general solution^{ 2 }

Letting \(x(0) = 0\) implies that \(A = 0\) (recall \(\cosh 0 = 1\) and \(\sinh 0 = 0\)). So our solution must be \(x = B \sinh ( \sqrt{-\lambda}\, t )\) and satisfy \(x(\pi) = 0\text{.}\) This is only possible if \(B\) is zero. Why? Because \(\sinh \xi\) is only zero when \(\xi=0\text{.}\) You should plot sinh to see this fact. We can also see this from the definition of sinh. We get \(0 = \sinh \xi = \frac{e^\xi - e^{-\xi}}{2}\text{.}\) Hence \(e^\xi = e^{-\xi}\text{,}\) which implies \(\xi = -\xi\) and that is only true if \(\xi=0\text{.}\) So there are no negative eigenvalues.

In summary, the eigenvalues and corresponding eigenfunctions are

###### Example 4.1.4.

Let us compute the eigenvalues and eigenfunctions of

Again we have to handle the cases \(\lambda > 0\text{,}\) \(\lambda = 0\text{,}\) \(\lambda < 0\) separately. First suppose that \(\lambda > 0\text{.}\) The general solution to \(x''+\lambda x = 0\) is \(x = A \cos ( \sqrt{\lambda}\, t) + B \sin ( \sqrt{\lambda}\, t)\text{.}\) So

The condition \(x'(0) = 0\) implies immediately \(B = 0\text{.}\) Next

Again \(A\) cannot be zero if \(\lambda\) is to be an eigenvalue, and \(\sin ( \sqrt{\lambda}\, \pi)\) is only zero if \(\sqrt{\lambda} = k\) for a positive integer \(k\text{.}\) Hence the positive eigenvalues are again \(k^2\) for all integers \(k \geq 1\text{.}\) And the corresponding eigenfunctions can be taken as \(x=\cos (k t)\text{.}\)

Now suppose that \(\lambda = 0\text{.}\) In this case the equation is \(x'' = 0\) and the general solution is \(x = At + B\) so \(x' = A\text{.}\) The condition \(x'(0) = 0\) implies that \(A=0\text{.}\) The condition \(x'(\pi) = 0\) also implies \(A=0\text{.}\) Hence \(B\) could be anything (let us take it to be 1). So \(\lambda = 0\) is an eigenvalue and \(x=1\) is a corresponding eigenfunction.

Finally, let \(\lambda < 0\text{.}\) In this case the general solution is \(x = A \cosh ( \sqrt{-\lambda}\, t) + B \sinh ( \sqrt{-\lambda}\, t)\) and

We have already seen (with roles of \(A\) and \(B\) switched) that for this expression to be zero at \(t=0\) and \(t=\pi\text{,}\) we must have \(A=B=0\text{.}\) Hence there are no negative eigenvalues.

In summary, the eigenvalues and corresponding eigenfunctions are

and there is another eigenvalue

The following problem is the one that leads to the general Fourier series.

###### Example 4.1.5.

Let us compute the eigenvalues and eigenfunctions of

We have not specified the values or the derivatives at the endpoints, but rather that they are the same at the beginning and at the end of the interval.

Let us skip \(\lambda < 0\text{.}\) The computations are the same as before, and again we find that there are no negative eigenvalues.

For \(\lambda = 0\text{,}\) the general solution is \(x = At + B\text{.}\) The condition \(x(-\pi) = x(\pi)\) implies that \(A=0\) (\(A\pi + B = -A\pi +B\) implies \(A=0\)). The second condition \(x'(-\pi) = x'(\pi)\) says nothing about \(B\) and hence \(\lambda=0\) is an eigenvalue with a corresponding eigenfunction \(x=1\text{.}\)

For \(\lambda > 0\) we get that \(x = A \cos ( \sqrt{\lambda}\, t ) + B \sin ( \sqrt{\lambda}\, t)\text{.}\) Now

We remember that \(\cos (- \theta) = \cos (\theta)\) and \(\sin (-\theta) = - \sin (\theta)\text{.}\) Therefore,

Hence either \(B=0\) or \(\sin ( \sqrt{\lambda}\, \pi) = 0\text{.}\) Similarly (exercise) if we differentiate \(x\) and plug in the second condition we find that \(A=0\) or \(\sin ( \sqrt{\lambda}\, \pi) = 0\text{.}\) Therefore, unless we want \(A\) and \(B\) to both be zero (which we do not) we must have \(\sin ( \sqrt{\lambda}\, \pi ) = 0\text{.}\) Hence, \(\sqrt{\lambda}\) is an integer and the eigenvalues are yet again \(\lambda = k^2\) for an integer \(k \geq 1\text{.}\) In this case, however, \(x = A \cos (k t) + B \sin (k t)\) is an eigenfunction for any \(A\) and any \(B\text{.}\) So we have two linearly independent eigenfunctions \(\sin (kt)\) and \(\cos (kt)\text{.}\) Remember that for a matrix we can also have two eigenvectors corresponding to a single eigenvalue if the eigenvalue is repeated.

In summary, the eigenvalues and corresponding eigenfunctions are

### Subsection 4.1.3 Orthogonality of eigenfunctions

Something that will be very useful in the next section is the *orthogonality* property of the eigenfunctions. This is an analogue of the following fact about eigenvectors of a matrix. A matrix is called *symmetric* if \(A = A^T\) (it is equal to its transpose). *Eigenvectors for two distinct eigenvalues of a symmetric matrix are orthogonal.* The differential operators we are dealing with act much like a symmetric matrix. We, therefore, get the following theorem.

###### Theorem 4.1.1.

Suppose that \(x_1(t)\) and \(x_2(t)\) are two eigenfunctions of the problem (4.1), (4.2) or (4.3) for two different eigenvalues \(\lambda_1\) and \(\lambda_2\text{.}\) Then they are *orthogonal* in the sense that

The terminology comes from the fact that the integral is a type of inner product. We will expand on this in the next section. The theorem has a very short, elegant, and illuminating proof so let us give it here. First, we have the following two equations.

Multiply the first by \(x_2\) and the second by \(x_1\) and subtract to get

Now integrate both sides of the equation:

The last equality holds because of the boundary conditions. For example, if we consider (4.1) we have \(x_1(a) = x_1(b) = x_2(a) = x_2(b) = 0\) and so \(x_2' x_1 - x_2 x_1'\) is zero at both \(a\) and \(b\text{.}\) As \(\lambda_1 \not= \lambda_2\text{,}\) the theorem follows.

###### Exercise 4.1.1.

*(easy)* Finish the proof of the theorem (check the last equality in the proof) for the cases (4.2) and (4.3).

The function \(\sin (n t)\) is an eigenfunction for the problem \(x''+\lambda x = 0\text{,}\) \(x(0) = 0\text{,}\) \(x(\pi) = 0\text{.}\) Hence for positive integers \(n\) and \(m\) we have the integrals

Similarly,

And finally we also get

and

### Subsection 4.1.4 Fredholm alternative

We now touch on a very useful theorem in the theory of differential equations. The theorem holds in a more general setting than we are going to state it, but for our purposes the following statement is sufficient. We will give a slightly more general version in Chapter 5.

###### Theorem 4.1.2. Fredholm alternative.

^{ 3 }

Exactly one of the following statements holds. Either

has a nonzero solution, or

has a unique solution for every function \(f\) continuous on \([a,b]\text{.}\)

The theorem is also true for the other types of boundary conditions we considered. The theorem means that if \(\lambda\) is not an eigenvalue, the nonhomogeneous equation (4.5) has a unique solution for every right-hand side. On the other hand if \(\lambda\) is an eigenvalue, then (4.5) need not have a solution for every \(f\text{,}\) and furthermore, even if it happens to have a solution, the solution is not unique.

We also want to reinforce the idea here that linear differential operators have much in common with matrices. So it is no surprise that there is a finite-dimensional version of Fredholm alternative for matrices as well. Let \(A\) be an \(n \times n\) matrix. The Fredholm alternative then states that either \((A-\lambda I) \vec{x} = \vec{0}\) has a nontrivial solution, or \((A-\lambda I) \vec{x} = \vec{b}\) has a unique solution for every \(\vec{b}\text{.}\)

A lot of intuition from linear algebra can be applied to linear differential operators, but one must be careful of course. For example, one difference we have already seen is that in general a differential operator will have infinitely many eigenvalues, while a matrix has only finitely many.

### Subsection 4.1.5 Application

Let us consider a physical application of an endpoint problem. Suppose we have a tightly stretched quickly spinning elastic string or rope of uniform linear density \(\rho\text{,}\) for example in \(\unitfrac{kg}{m}\text{.}\) Let us put this problem into the \(xy\)-plane and both \(x\) and \(y\) are in meters. The \(x\)-axis represents the position on the string. The string rotates at angular velocity \(\omega\text{,}\) in \(\unitfrac{radians}{s}\text{.}\) Imagine that the whole \(xy\)-plane rotates at angular velocity \(\omega\text{.}\) This way, the string stays in this \(xy\)-plane and \(y\) measures its deflection from the equilibrium position, \(y=0\text{,}\) on the \(x\)-axis. Hence the graph of \(y\) gives the shape of the string. We consider an ideal string with no volume, just a mathematical curve. We suppose the tension on the string is a constant \(T\) in Newtons. Assuming that the deflection is small, we can use Newton's second law (let us skip the derivation) to get the equation

To check the units notice that the units of \(y''\) are \(\unitfrac{m}{m^2}\text{,}\) as the derivative is in terms of \(x\text{.}\)

Let \(L\) be the length of the string (in meters) and the string is fixed at the beginning and end points. Hence, \(y(0) = 0\) and \(y(L) = 0\text{.}\) See Figure 4.1.

We rewrite the equation as \(y'' + \frac{\rho \omega^2}{T} y = 0\text{.}\) The setup is similar to Example 4.1.3, except for the interval length being \(L\) instead of \(\pi\text{.}\) We are looking for eigenvalues of \(y'' + \lambda y = 0, y(0) = 0, y(L) = 0\) where \(\lambda = \frac{\rho \omega^2}{T}\text{.}\) As before there are no nonpositive eigenvalues. With \(\lambda > 0\text{,}\) the general solution to the equation is \(y = A \cos ( \sqrt{\lambda} \,x ) + B \sin ( \sqrt{\lambda} \,x )\text{.}\) The condition \(y(0) = 0\) implies that \(A = 0\) as before. The condition \(y(L) = 0\) implies that \(\sin ( \sqrt{\lambda} \, L) = 0\) and hence \(\sqrt{\lambda} \, L = k \pi\) for some integer \(k > 0\text{,}\) so

What does this say about the shape of the string? It says that for all parameters \(\rho\text{,}\) \(\omega\text{,}\) \(T\) not satisfying the equation above, the string is in the equilibrium position, \(y=0\text{.}\) When \(\frac{\rho \omega^2}{T} = \frac{k^2 \pi^2}{L^2}\text{,}\) then the string will “pop out” some distance \(B\text{.}\) We cannot compute \(B\) with the information we have.

Let us assume that \(\rho\) and \(T\) are fixed and we are changing \(\omega\text{.}\) For most values of \(\omega\) the string is in the equilibrium state. When the angular velocity \(\omega\) hits a value \(\omega = \frac{k \pi \sqrt{T}}{L\sqrt{\rho}}\text{,}\) then the string pops out and has the shape of a sin wave crossing the \(x\)-axis \(k-1\) times between the end points. For example, at \(k=1\text{,}\) the string does not cross the \(x\)-axis and the shape looks like in Figure 4.1. On the other hand, when \(k=3\) the string crosses the \(x\)-axis 2 times, see Figure 4.2. When \(\omega\) changes again, the string returns to the equilibrium position. The higher the angular velocity, the more times it crosses the \(x\)-axis when it is popped out.

For another example, if you have a spinning jump rope (then \(k=1\) as it is completely “popped out”) and you pull on the ends to increase the tension, then the velocity also increases for the rope to stay “popped out”.

### Subsection 4.1.6 Exercises

Hint for the following exercises: Note that when \(\lambda > 0\text{,}\) then \(\cos \bigl( \sqrt{\lambda}\, (t - a) \bigr)\) and \(\sin \bigl( \sqrt{\lambda}\, (t - a) \bigr)\) are also solutions of the homogeneous equation.

###### Exercise 4.1.2.

Compute all eigenvalues and eigenfunctions of \(x'' + \lambda x = 0, ~ x(a) = 0, ~ x(b) = 0\) (assume \(a < b\)).

###### Exercise 4.1.3.

Compute all eigenvalues and eigenfunctions of \(x'' + \lambda x = 0, ~ x'(a) = 0, ~ x'(b) = 0\) (assume \(a < b\)).

###### Exercise 4.1.4.

Compute all eigenvalues and eigenfunctions of \(x'' + \lambda x = 0, ~ x'(a) = 0, ~ x(b) = 0\) (assume \(a < b\)).

###### Exercise 4.1.5.

Compute all eigenvalues and eigenfunctions of \(x'' + \lambda x = 0, ~ x(a) = x(b), ~ x'(a) = x'(b)\) (assume \(a < b\)).

###### Exercise 4.1.6.

We skipped the case of \(\lambda < 0\) for the boundary value problem \(x'' + \lambda x = 0, ~ x(-\pi) = x(\pi), ~ x'(-\pi) = x'(\pi)\text{.}\) Finish the calculation and show that there are no negative eigenvalues.

###### Exercise 4.1.101.

Consider a spinning string of length 2 and linear density 0.1 and tension 3. Find smallest angular velocity when the string pops out.

\(\omega = \pi \sqrt{\frac{15}{2}}\)

###### Exercise 4.1.102.

Suppose \(x'' + \lambda x = 0\) and \(x(0)=1\text{,}\) \(x(1) = 1\text{.}\) Find all \(\lambda\) for which there is more than one solution. Also find the corresponding solutions (only for the eigenvalues).

\(\lambda_k = 4 k^2 \pi^2\) for \(k = 1,2,3,\ldots\) \(x_k = \cos (2k\pi t) + B \sin (2k\pi t)\) (for any \(B\))

###### Exercise 4.1.103.

Suppose \(x'' + x = 0\) and \(x(0)=0\text{,}\) \(x'(\pi) = 1\text{.}\) Find all the solution(s) if any exist.

\(x(t) = - \sin(t)\)

###### Exercise 4.1.104.

Consider \(x' + \lambda x = 0\) and \(x(0)=0\text{,}\) \(x(1) = 0\text{.}\) Why does it not have any eigenvalues? Why does any first order equation with two endpoint conditions such as above have no eigenvalues?

General solution is \(x = C e^{-\lambda t}\text{.}\) Since \(x(0) = 0\) then \(C=0\text{,}\) and so \(x(t) = 0\text{.}\) Therefore, the solution is always identically zero. One condition is always enough to guarantee a unique solution for a first order equation.

###### Exercise 4.1.105.

*(challenging)* Suppose \(x''' + \lambda x = 0\) and \(x(0)=0\text{,}\) \(x'(0) = 0\text{,}\) \(x(1) = 0\text{.}\) Suppose that \(\lambda > 0\text{.}\) Find an equation that all such eigenvalues must satisfy. Hint: Note that \(-\sqrt[3]{\lambda}\) is a root of \(r^3+\lambda = 0\text{.}\)

\(\frac{\sqrt{3}}{3} e^{\frac{-3}{2}\sqrt[3]{\lambda}} - \frac{\sqrt{3}}{3} \cos \bigl( \frac{\sqrt{3}\, \sqrt[3]{\lambda}}{2} \bigr) + \sin \bigl( \frac{\sqrt{3}\, \sqrt[3]{\lambda}}{2}\bigr) = 0\)