Calc3.3
Directional Derivatives
The partial derivatives we've studied in the last lecture allow us to compute how fast a multivariable function is changing along the x and y (and possibly z) directions. But what if we want to know how fast a function is changing along an arbitrary direction? Directional derivatives are the easy way to do this.
When we want to know the rate of change of a function in a given direction, we must specify what direction we're talking about. Clearly, vectors are perfectly suited to our purposes.
The direction derivative is defined just as you might expect: pick a vector Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \vec{h}} in the direction you want to differentiate in, and we define
Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \partial_\vec{h} f(\vec{p}) = \lim_{|\vec{h}|\to 0} \frac{f(\vec{p}+\vec{h})-f(\vec{p})}{|\vec{h}|}}
where Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \vec{p}=x\vec{i}+y\vec{j}} , ie, Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle f(\vec{p}) = f(x,y)}
Is there an easier way to compute these kinds of derivatives, without Only vectors of unit length are useful to us; other lengths will mess up our rates of change.
So, first we pick a vector, Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \vec{u}} . Now we must normalize it to give it unit length: this is easy enough, we define a new vector, Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \vec{w}=\vec{u}/|\vec{u}|} will do the trick.
Our directional derivative is now quite easy to compute:
Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \partial_\vec{u} f = \begin{pmatrix}\partial_x f\\\partial_y f\end{pmatrix} \cdot \vec{u}}
The Gradient
We've discussed partial derivatives, but it seems there should be a way to find a derivative which is in some sense "complete." We'll address this concept for vector fields in the next lecture, but for now let's examine the gradient, a differential operator for scalar functions. For every point in a scalar field, the gradient is a vector in the direction of greatest change, with length equal to the rate of change in that direction (ie, the directional derivative).
The gradient is easily computed:
.
If we wanted to construct a more concise version of this, we can always form the "vector" often called del or nabla:
.
Then, if we just take this operator of f, we get the gradient: . Remember this operator; we'll encounter it again.
Parametric Curves and Surfaces
Earlier, we described lines in three dimensional space by referring to a non-coordinate variable, t. In the challenging exercises, we also explored using this method to create curves in space. This method of describing geometric objects is called a parametric representation. Parametric representations are able to describe more varied and complex figures than the kinds of curves which can be described by equations like or , and often the parametric equations can yield more insights into the structure of the object than a representation using only coordinates.
Just as it is customary to use x,y,z for coordinates, so it is customary to use t as the parameter for curves, and u,v as the parameters for surfaces. Occasionally, we use when the parameters are easily envisioned as angles.
Curves
In the plane, we frequently encounter curves which cannot be described in form. The circle is the simplest example of this - it takes two such equations to represent a circle, , and these equations become impossible to differentiate at the points (-1,0) and (1,0). This violates our intuition about what a circle is: it's not made of two pieces stuck together, and there are no points different from any other.
Let's take a look at a parametric representation of the circle: . What does this mean? If we picture a point traveling in the plane, these equations give its x and y coordinates at some time t. At time t=0, the point is at (1,0). If you've memorized your essential trig function values, it won't be difficult for you to complete a graph of this and you'll find this does indeed describe a circle.
Frequently, we describe a parametric representation as a vector function: . This gives us one tidy function describing a circle, which is differentiable everywhere. Quite an improvement over our previous representation of the circle!
It is just as simple to describe curves in space, and students completing the challenging exercises will already have some familiarity with this. In fact, this method is used to describe curves so often, we even call lines "curves" - they're just straight curves. Below is a curve you're probably familiar with in space, the helix:
Now take a look at these two curves:
.
Compute some points along these curves, and you'll see that they're the same curve. A single geometric object can have many different parametric representations.
expand
Surfaces in Space
We also frequently describe surfaces in space with parametric representations. Let's take a look at an illuminating example, the unit sphere.
Before continuing, make sure you understand why these equations describe a sphere. For example, set ; then these describe a circle in three dimensions. What happens as we vary ?
Now, there are several important points to make at this point. Remember sin and cos are both periodic, with for any u, and similarly for cos, so many different values of are mapped to the same point on the sphere. To prevent this, let's impose the limits . The second point to note is that this doesn't completely solve the problem: every point is taken to (0,0,1), regardless of the value of . A similar problem arises for points .
Although this sort of thing happens often, it doesn't actually cause much of a difficulty in the analysis of the surface, which we turn to now.
Extrema of Multivariate Functions
In single variable calculus, we found that extrema, that is, maximum and minimum values for a function, could only occur at points where the derivative was 0. Dealing with multivariate functions, it should come as no surprise, then, that extrema can only occur when all of the partial derivatives are 0, or, to say the same thing, that the gradient is the zero length vector .
As in the single variable case, having isn't sufficient to demonstrate that an extreme value of a function exists. It is necessary to rule out the possibility of a non-extremal stationary point, and, as in the single variable case, this is done with an examination of the second-order derivative.
In the single variable case, we recall, a function has an extrema at a point if Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle f'(x_0)=0 \ } and Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle f''(x_0)\neq0} . On the other hand, we have an inflection point if Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle f'(x_0)=f''(x_0)=0 \ } . See the illustration at right.
It should come as no surprise then that we examine the second-order derivative of a multivariate function to determine when an extrema has taken place. We examine one of the most important operators in higher mathematics now, the Laplacian: Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \Delta = \nabla^2} .
In Cartesian coordinates, we will have
Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \Delta f = \frac{\partial^2 f}{\partial x^2}+\frac{\partial^2 f}{\partial y^2}}
and in three dimensions, we will of course add on the term Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \partial_{zz}f} . In polar coordinates, the Laplacian is
Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \Delta f = {1 \over r} {\partial \over \partial r} \left( r {\partial f \over \partial r} \right) + {1 \over r^2} {\partial^2 f \over \partial \theta^2} \ }
and in spherical coordinates,
Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \Delta f = {1 \over r^2} {\partial \over \partial r} \left( r^2 {\partial f \over \partial r} \right) + {1 \over r^2 \sin \phi} {\partial \over \partial \phi} \left( \sin \phi {\partial f \over \partial \phi} \right) + {1 \over r^2 \sin^2 \phi} {\partial^2 f \over \partial \theta^2}}
where we maintain our convention of using Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \theta} for the azimuth and Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \phi} for the zenith angle. For more on how these different forms of the Laplacian were calculated, see the Laplacian article.
Optimization with Constraints: Lagrange Multipliers
We will introduce Lagrange multipliers with functions of only two variables, so that we can visualize what we're talking about easily. First, we will develop the theory, and then we will work a concrete example to demonstrate the technique.
The Gradient and the Level Curve
The first order of business will be to show that the direction of the gradient of a function is perpendicular to its level curve.
Let's pick a point Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \vec{x}_0 = (x_0,y_0,z_0)} and define its isocurve Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \left\{{\vec{x}:f(\vec{x})=f(\vec{x_0 }) }\right\}} . We will parametrize this isocurve with a function Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \vec{\gamma}(t)} , and adjust it so that Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \vec{\gamma}(0)=\vec{x_0}} . Then note that Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle f(\vec{\gamma}(0))=f(\vec{x_0})} .
Let us investigate the derivative of Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle f ( \vec{\gamma}(t))} . By the chain rule, it is simple Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \nabla f (\vec{\gamma}(t))\cdot\vec{\gamma}'(t)} . Since Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \vec{\gamma}(0)=\vec{x_0} } , when we evaluate the derivative of Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle f ( \vec{\gamma}(t))} at Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle t=0 \ } we get Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \nabla f(\vec{x_0}) \cdot \vec{\gamma}'(0)} .
Since Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \vec{\gamma}} parametrizes the level curve of f, it is obvious that its derivative should be a vector tangent to the curve. If this expression is 0, and neither the gradient nor the derivative of Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \vec{\gamma}} are themselves 0, then we are correct in our belief that that the gradient of a function is perpendicular to its level curves by the definition of dot product. But remember, Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \vec{\gamma}} parametrizes a level set of f: for some constant c, it satisfies Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle f(\vec{\gamma}(t))=c} by definition, and hence any derivative of Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle f(\vec{\gamma}(t))} is zero.
Extrema with regard to a constraint
Suppose that we wanted to know what the greatest (or least) value of a multivariate function was, but only with respect to a curve. For example, a person might wish to know the greatest wind speed at a point on Earth. Well, the wind speed at different points on Earth could be described as a function of two variables, longitude and latitude, but suppose this person doesn't care what the greatest wind speed on Earth is, just what the greatest windspeed along say, a route taken by an airplane.
The first step is to describe the function you wish to find the extreme of (in the above example, windspeed) as Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle f(x,y)} . Next, you want to be able to describe the curve you wish to maximize f on as Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle g(x,y)=c} for some constant c.
Problems
Review Problems
Main Problems
Challenging Problems
| |||||||||||