Note: more than 1 lecture, §1.1 in [EP], chapter 1 in [BD]
Subsection0.2.1Differential equations
The laws of physics are generally written down as differential equations. Therefore, all of science and engineering use differential equations to some degree. Understanding differential equations is essential to understanding almost anything you will study in your science and engineering classes. You can think of mathematics as the language of science, and differential equations are one of the most important parts of this language as far as science and engineering are concerned. As an analogy, suppose all your classes from now on were given in Swahili. It would be important to first learn Swahili, or you would have a very tough time getting a good grade in your classes.
You saw many differential equations already without perhaps knowing about it. And you even solved simple differential equations when you took calculus. Let us see an example you may not have seen:
\begin{equation}
\frac{dx}{dt} + x = 2 \cos t .\tag{1}
\end{equation}
Here \(x\) is the dependent variable and \(t\) is the independent variable. Equation (1) is a basic example of a differential equation. It is an example of a first order differential equation, since it involves only the first derivative of the dependent variable. This equation arises from Newton’s law of cooling where the ambient temperature oscillates with time.
Subsection0.2.2Solutions of differential equations
Solving the differential equation means finding \(x\) in terms of \(t\text{.}\) That is, we want to find a function of \(t\text{,}\) which we call \(x\text{,}\) such that when we plug \(x\text{,}\)\(t\text{,}\) and \(\frac{dx}{dt}\) into (1), the equation holds; that is, the left hand side equals the right hand side. It is the same idea as it would be for a normal (algebraic) equation of just \(x\) and \(t\text{.}\) We claim that
\begin{equation*}
x = x(t) = \cos t + \sin t
\end{equation*}
is a solution. How do we check? We simply plug \(x\) into equation (1)! First we need to compute \(\frac{dx}{dt}\text{.}\) We find that \(\frac{dx}{dt} =
-\sin t + \cos t\text{.}\) Now let us compute the left-hand side of (1).
\begin{equation*}
\frac{dx}{dt} + x =
\underbrace{(-\sin t + \cos t)}_{\frac{dx}{dt}}
+
\underbrace{(\cos t + \sin t)}_{x}
=
2\cos t .
\end{equation*}
Yay! We got precisely the right-hand side. But there is more! We claim \(x = \cos t + \sin t + e^{-t}\) is also a solution. Let us try,
\begin{equation*}
\frac{dx}{dt} = -\sin t + \cos t - e^{-t} .
\end{equation*}
\begin{equation*}
\frac{dx}{dt} + x =
\underbrace{(-\sin t + \cos t - e^{-t})}_{\frac{dx}{dt}} +
\underbrace{(\cos t + \sin t + e^{-t})}_{x}
= 2\cos t .
\end{equation*}
And it works yet again!
So there can be many different solutions. For this equation all solutions can be written in the form
\begin{equation*}
x = \cos t + \sin t + C e^{-t} ,
\end{equation*}
for some constant \(C\text{.}\) Different constants \(C\) will give different solutions, so there are really infinitely many possible solutions. See Figure 1 for the graph of a few of these solutions. We will see how we find these solutions a few lectures from now.
Figure1.Few solutions of \(\frac{dx}{dt} + x = 2 \cos t\text{.}\)
Solving differential equations can be quite hard. There is no general method that solves every differential equation. We will generally focus on how to get exact formulas for solutions of certain differential equations, but we will also spend a little bit of time on getting approximate solutions. And we will spend some time on understanding the equations without solving them.
Most of this book is dedicated to ordinary differential equations or ODEs, that is, equations with only one independent variable, where derivatives are only with respect to this one variable. If there are several independent variables, we get partial differential equations or PDEs.
Even for ODEs, which are very well understood, it is not a simple question of turning a crank to get answers. When you can find exact solutions, they are usually preferable to approximate solutions. It is important to understand how such solutions are found. Although in real applications you will leave much of the actual calculations to computers, you need to understand what they are doing. It is often necessary to simplify or transform your equations into something that a computer can understand and solve. You may even need to make certain assumptions and changes in your model to achieve this.
To be a successful engineer or scientist, you will be required to solve problems in your job that you never saw before. It is important to learn problem solving techniques, so that you may apply those techniques to new problems. A common mistake is to expect to learn some prescription for solving all the problems you will encounter in your later career. This course is no exception.
Subsection0.2.3Differential equations in practice
So how do we use differential equations in science and engineering? First, we have some real-world problem we wish to understand. We make some simplifying assumptions and create a mathematical model. That is, we translate the real-world situation into a set of differential equations. Then we apply mathematics to get some sort of a mathematical solution. There is still something left to do. We have to interpret the results. We have to figure out what the mathematical solution says about the real-world problem we started with.
Learning how to formulate the mathematical model and how to interpret the results is what your physics and engineering classes do. In this course, we will focus mostly on the mathematical analysis. Sometimes we will work with simple real-world examples so that we have some intuition and motivation about what we are doing.
Let us look at an example of this process. One of the most basic differential equations is the standard exponential growth model. Let \(P\) denote the population of some bacteria on a Petri dish. We assume that there is enough food and enough space. Then the rate of growth of bacteria is proportional to the population—a large population grows quicker. Let \(t\) denote time (say in seconds) and \(P\) the population. Our model is
Suppose there are 100 bacteria at time 0 and 200 bacteria 10 seconds later. How many bacteria will there be 1 minute from time 0 (in 60 seconds)?
First we need to solve the equation. We claim that a solution is given by
\begin{equation*}
P(t) = C e^{kt} ,
\end{equation*}
where \(C\) is a constant. Let us try:
\begin{equation*}
\frac{dP}{dt} = C k e^{kt} = k P .
\end{equation*}
And it really is a solution.
OK, now what? We do not know \(C\text{,}\) and we do not know \(k\text{.}\) But we know something. We know \(P(0) = 100\text{,}\) and we know \(P(10) = 200\text{.}\) Let us plug these conditions in and see what happens.
At one minute, \(t=60\text{,}\) the population is \(P(60) = 6400\text{.}\) See Figure 2.
Figure2.Bacteria growth in the first 60 seconds.
Let us talk about the interpretation of the results. Does our solution mean that there must be exactly 6400 bacteria on the plate at 60s? No! We made assumptions that might not be true exactly, just approximately. If our assumptions are reasonable, then there will be approximately 6400 bacteria. Also, in real life \(P\) is a discrete quantity, not a real number. However, our model has no problem saying that for example at 61 seconds, \(P(61) \approx 6859.35\text{.}\)
Normally, the \(k\) in \(P' = kP\) is known, and we want to solve the equation for different initial conditions. What does that mean? Take \(k=1\) for simplicity. Suppose we want to solve the equation \(\frac{dP}{dt} = P\) subject to \(P(0) = 1000\) (the initial condition). Then the solution turns out to be (exercise)
We call \(P(t) = C e^t\)the general solution, as every solution of the equation can be written in this form for some constant \(C\text{.}\) We need an initial condition to find out what \(C\) is, in order to find the particular solution we are looking for. Generally, when we say “particular solution,” we just mean some solution.
Subsection0.2.4Four fundamental equations
A few equations appear often and it is useful to just memorize what their solutions are. Let us call them the four fundamental equations. Their solutions are reasonably easy to guess by recalling properties of exponentials, sines, and cosines. They are also simple to check, which is something that you should always do. No need to wonder if you remembered the solution correctly.
First such equation is
\begin{equation*}
\frac{dy}{dx} = k y ,
\end{equation*}
for some constant \(k > 0\text{.}\) Here \(y\) is the dependent and \(x\) the independent variable. The general solution for this equation is
\begin{equation*}
y(x) = C e^{kx} .
\end{equation*}
We saw above that this function is a solution, although we used different variable names.
Next,
\begin{equation*}
\frac{dy}{dx} = -k y ,
\end{equation*}
for some constant \(k > 0\text{.}\) The general solution for this equation is
\begin{equation*}
y(x) = C e^{-kx} .
\end{equation*}
Exercise0.2.1.
Check that the \(y\) given is really a solution to the equation.
Next, take the second order differential equation
\begin{equation*}
\frac{d^2y}{{dx}^2} = -k^2 y ,
\end{equation*}
for some constant \(k > 0\text{.}\) The general solution for this equation is
For those that do not know, \(\cosh\) and \(\sinh\) are defined by
\begin{equation*}
\cosh x = \frac{e^{x} + e^{-x}}{2} , \qquad
\sinh x = \frac{e^{x} - e^{-x}}{2} .
\end{equation*}
They are called the hyperbolic cosine and hyperbolic sine. These functions are sometimes easier to work with than exponentials. They have some nice familiar properties such as \(\cosh 0 = 1\text{,}\)\(\sinh 0 = 0\text{,}\) and \(\frac{d}{dx} \cosh x = \sinh x\) (no that is not a typo) and \(\frac{d}{dx} \sinh x = \cosh x\text{.}\)
Exercise0.2.3.
Check that both forms of the \(y\) given are really solutions to the equation.
Example0.2.2.
In equations of higher order, you get more constants you must solve for to get a particular solution and hence you need more initial conditions. The equation \(\frac{d^2y}{dx^2} = 0\) has the general solution \(y = C_1 x + C_2\text{;}\) simply integrate twice and don’t forget about the constant of integration. Consider the initial conditions \(y(0) =
2\) and \(y'(0) = 3\text{.}\) We plug in our general solution and solve for the constants:
In other words, \(y = 3x + 2\) is the particular solution we seek.
An interesting note about \(\cosh\text{:}\) The graph of \(\cosh\) is the exact shape of a hanging chain. This shape is called a catenary. Contrary to popular belief this is not a parabola. If you invert the graph of \(\cosh\text{,}\) it is also the ideal arch for supporting its weight. For example, the Gateway Arch in Saint Louis is an inverted graph of \(\cosh\)—if it were just a parabola it might fall. The formula used in the design is inscribed inside the arch:
Show that \(x = e^{4t}\) is a solution to \(x'''-12 x'' + 48 x' - 64 x = 0\text{.}\)
Exercise0.2.5.
Show that \(x = e^{t}\) is not a solution to \(x'''-12 x'' + 48 x' - 64 x = 0\text{.}\)
Exercise0.2.6.
Is \(y = \sin t\) a solution to \({\left( \frac{dy}{dt} \right)}^2 = 1 - y^2\text{?}\) Justify.
Exercise0.2.7.
Let \(y'' + 2y' - 8y = 0\text{.}\) Now try a solution of the form \(y = e^{rx}\) for some (unknown) constant \(r\text{.}\) Is this a solution for some \(r\text{?}\) If so, find all such \(r\text{.}\)
Exercise0.2.8.
Verify that \(x = C e^{-2t}\) is a solution to \(x' = -2x\text{.}\) Find \(C\) to solve for the initial condition \(x(0) = 100\text{.}\)
Exercise0.2.9.
Verify that \(x = C_1 e^{-t} + C_2 e^{2t}\) is a solution to \(x'' - x' -2 x =
0\text{.}\) Find \(C_1\) and \(C_2\) to solve for the initial conditions \(x(0) = 10\) and \(x'(0) = 0\text{.}\)
Exercise0.2.10.
Find a solution to \({(x')}^2 + x^2 = 4\) using your knowledge of derivatives of functions that you know from basic calculus.
Exercise0.2.11.
Solve:
\(\displaystyle \dfrac{dA}{dt} = -10 A, \quad A(0)=5\)
Is there a solution to \(y' = y\text{,}\) such that \(y(0) = y(1)\text{?}\)
Exercise0.2.13.
The population of city X was 100 thousand 20 years ago, and the population of city X was 120 thousand 10 years ago. Assuming constant growth, you can use the exponential population model (like for the bacteria). What do you estimate the population is now?
Exercise0.2.14.
Suppose that a football coach gets a salary of one million dollars now, and a raise of \(10\%\) every year (so exponential model, like population of bacteria). Let \(s\) be the salary in millions of dollars, and \(t\) is time in years.
What is \(s(0)\) and \(s(1)\text{.}\)
Approximately how many years will it take for the salary to be 10 million.
Approximately how many years will it take for the salary to be 20 million.
Approximately how many years will it take for the salary to be 30 million.
Note: Exercises with numbers 101 and higher have solutions.
Exercise0.2.101.
Show that \(x = e^{-2t}\) is a solution to \(x'' + 4x' + 4x = 0\text{.}\)
Let \(xy'' - y' = 0\text{.}\) Try a solution of the form \(y = x^r\text{.}\) Is this a solution for some \(r\text{?}\) If so, find all such \(r\text{.}\)
\(y=x^r\) is a solution for \(r=0\) and \(r=2\text{.}\)
Exercise0.2.104.
Verify that \(x=C_1e^t+C_2\) is a solution to \(x''-x' = 0\text{.}\) Find \(C_1\) and \(C_2\) so that \(x\) satisfies \(x(0) = 10\) and \(x'(0) = 100\text{.}\)
