Calc3.9

This is an old revision of this page, as edited by JacobB (talk | contribs) at 06:01, February 27, 2010. It may differ significantly from current revision.

Frequently we encounter equations in which we are solving for a function instead of a number. If such an equation involves an unknown function as well as its derivatives, it is called a differential equation. These equations have numerous applications in a variety of fields, including physics, engineering, chemistry, and biology. In this lecture, we will dipping our toes into the theory of ordinary differential equations, which means differential equations in which the unknown function(s) involves only one variable.

The Basics

We can immediately solve some of the most basic equations, such as  , where k is a constant, from our knowledge of the basic derivatives.

Integrable Equations

The easiest differential equations to solve, at least in theory, are those where we can manipulate the equation algebraically to get Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle y'} on one side and some expression only involving x and constants on the other side. Then, we can just integrate both sides to get y. Integrable equations may not be presented in this format right away; often times, some manipulation is required to reach an integrable format. Take a look at Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle xy' -2x^2 =1 \ } . We can manipulate this to get

Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle y'=\frac{1+2x^2}{x}}

and integrate to get

Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle y= \int x^{-1}dx+\int 2xdx = \ln(|x|) + x^2}

Let's check that this fits:

Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle x (\frac{1}{x} +2x) - 2x^2 = 1+2x^2-2x^2=1}

as expected.

Separable Equations

Most equations are not integrable. But sometimes, we're very lucky, and we find that we separate the dy and the dx from each other, and that we can arrange the equation such that only terms of y appear on one side, and only terms of x on the other. Let's do an example of this by solving Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle y^2y'-\cos(x)=1 \ } .

We can rewrite this

Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle y^2\frac{dy}{dx}-\cos(x)=1}

and separate it as

Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle y^2dy=(1+\cos(x))dx \ }

Now it's a simple matter of integrating!

Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \int y^2dy=\int (1+\cos(x))dx}

Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \frac{y^3}{3}+c=x+\sin(x)}

which is an implicit equation with explicit solution

Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle y=\sqrt[3]{3x+3\sin(x)+c}}

where we change the arbitrary constant c.

Not all separable equations are this obviously separable; sometimes much manipulation is needed to get it into a separable form.

First-Order Equations

A first-order equation involves only Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle y, y' \ } and no higher order derivatives. We've already seen such an equation in our separable example, but that wasn't linear. Right now, we're going to solve all linear first order equations.

Constant Co-efficients

This is the simplest one, which we've already addressed. Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle y'+ay=0 \ } has the obvious solution Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle y=e^{-ax} \ } . It isn't hard to check that all multiples of this solution are also solutions.

Variable Co-efficients

We begin by considering Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle P(x)y'+Q(x)y=0 \ } . Where ever Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle P(x)\neq 0 \ } , we can divide out by P to get Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle y'' +a(x)y =0 \ } , which will make our lives much easier. Points Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle x_0 \ } where Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle P(x_0)=0 \ } are called singular points and require special treatment we won't address here.

Second-Order Equations

A second order equation is an equation which contains a Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle y'' \ } term, but no higher derivatives. We will consider only linear equations for now: this means that the coefficients of the derivatives of y do not contain terms in y.

Constant Co-efficients

When we solved Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle y'+ay=0 \ } , we found that Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle y=e^{-ax} \ } was a solution. Note that Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle -a=t \ } is a root of the equation Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle t+a=0 \ } . Therefore, it makes sense to suppose that solutions of the equation Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle y''+ay'+by=0 \ } may be found with Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle y=e^{r_1x}, y=e^{r_2x} \ } , where Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle t=r_1, r_2 \ } are roots of the equation Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle t^2+at+b=0 \ } . Let r represent a specific root (either the first or second), and observe:

Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle y=e^{rx}, y' = r e^{rx}, y''=r^2 e^{rx} \ }

Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle y''+ay'+b=r^2e^{rx}+are^{rx}+be^{rx}= e^{rx} (r^2+ar+b)= e^{rx}(0) = 0 \ }

as desired. Hence we have found two possible solutions. An interesting thing happens if we consider linear combinations of these two solutions:

Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle u=py_1+qy_2=pe^{r_1x}+qe^{r_2x} \ }

Taking all the relevant derivatives, we have

Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle u'' = r_1^2pe^{r_1x}+r_2^2qe^{r_2x}, u' = r_1pe^{r_1x}+qr_2e^{r_2x}, u=pe^{r_1x}+qe^{r_2x} \ }

and examining the behavior of u in the LHS of the differential equation

Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle u'' + au' + bu = r_1^2pe^{r_1x}+r_2^2qe^{r_2x} + ar_1pe^{r_1x}+aqr_2e^{r_2x} + bpe^{r_1x}+bqe^{r_2x} =pe^{r_1x}(r_1^2+ar_1+b) + qe^{r_2x}(r_2^2 +ar_2+b) }

Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle = pe^{r_1x}(0) + qe^{r_2x}(0) = 0+0 = 0 \ }

reveals u is also a solution.

What about when the discriminant is 0, that is, when Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle r_1=r_2 \ } ? In this case, lets drop the subscript and just call our root Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle r=-a/2 \ } .

Obviously, Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle y=e^{rx} \ } will still be a solution, but is there a second solution, as there was before? The key insight needed to answer this question is that for a double root Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle r=-a/2 \ } , not only is the characteristic polynomial Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle t^2+at+b=0 \ } , so is the derivative Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle 2t+a=0 \ } . Therefore, it makes sense to consider the derivative of the solution Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle y=e^{rx} \ } with respect to r as another possible solution. Let's check:

Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle y=xe^{rx}, y'= e^{rx}+xre^{rx}, y'' = re^{rx}+re^{rx}+xr^2e^{rx} \ }

Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle y''+ay'+by=2re^{rx}+xr^2e^{rx}+ae^{rx}+axre^{rx}+bxe^{rx} = (2r+a)e^{rx}+(r^2+ar+b)xe^{rx} = (0)e^{rx}+(0)xe^{rx}=0 \ } .

As before, any linear combination Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle u=pe^{rx}+qxe^{rx} \ } is also a solution.

Variable Co-efficients

We turn now to the equation Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle y''+a(x)y'+b(y)=0 \ }

Higher-Order Equations

It should come as no surprise by now to learn that given an equation Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle y^{(n)}+c_{n-1}y^{(n-1}+\dots+c_0=0} , a general solution is given by Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle y=a_1e^{r_1x}+a_2e^{r_2x}+\dots+a_ne^{r_nx} \ } , where the Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle r_j \ } are roots of the polynomial Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \sum_{k=0}^n c_kt^k \ } . If two roots   are equal, then   are both solutions; if three roots   are equal, then   are all solutions; if four roots   are equal, then   are all solutions, and so on.

Non-homogeneous Equations

Infinite Series

Keeping in mind how many functions can be represented with infinite sums created with Taylor series, we assume a function has an infinite series representation.

For example, let's solve Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle y''-xy'+x^2y=e^x} by assuming there exists   such that Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle y=\sum_{n=0}^\infty a_nx^n} . Then our differential equation becomes

Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle (2a_2+(3)(2)a_3x+(4)(3)a_4x^2+\dots)-x(a_1+2a_2x+3a_3x^2+\dots)+x^2(a_0+a_1x+a_2x^2+\dots) = 1+x+\frac{x^2}{2!}+\frac{x^3}{3!}+\dots}

Grouping like terms, we have

Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle (2a_2)+(6a_3-a_1)x+(12a_4-2a_2+a_0)x^2 + \dots }

so that for Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle n\geq 2} , the coefficient of Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle x^n} on the right hand side is Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle (n+1)(n+2)a_{n+2}-na_n+a_{n-2}} . So we need only set this equal to Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle 1/(n!)} to find an infinite series representation of our solution. If we're given the values of Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle y(0), y'(0) \ } , as we frequently are in applications (remember what we said about having two "degrees of freedom" in a DEQ involving second-order derivatives?) we can solve this completely. Let's say Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle y(0)=0, y'(0)=1} . We have

Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle a_0=0 \ } Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle a_1=1 \ } Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle a_2 = 1/2 \ } , since Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle 2a_2=1 \ } Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle a_3 = 1/3 \ } , since Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle 6a_3-a_1=1 \ } and so on.

This method may not seem particularly useful. After all, unless we can find a closed form solution for the Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle a_n} , we are going to have to keeping solving this linear equations in Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle a_n} forever to get the solution. However, it may happen, on occasion, that we can find such a closed form representation. Or, it may happen that we find no closed form, but recognize it as similar or equivalent to a function which has been studied for decades or centuries, so that all the properties we wish to know about are easily available to us. Or, we may not care about a closed form - near 0, those higher powers will become very small, and a low-order approximation becomes highly accurate.

Functional Transformations