Difference between revisions of "Gradient"
m |
(slightly reworked intro, links, bold, subcat) |
||
| Line 1: | Line 1: | ||
{{math-a}} | {{math-a}} | ||
| − | In [[mathematics]], the gradient of a | + | In [[mathematics]], the '''gradient''' is a [[vector]] associated to a point <math>p</math> of a [[differentiable]] [[function]] <math>f(x_1,...,x_n)</math> which takes [[real]] values. Specifically, the gradient at <math>p</math> is a vector in <math>R^n</math> which points in the direction in which <math>f</math> increases most rapidly at <math>p</math>. The magnitude of the gradient at <math>p</math> is equal to the maximum [[directional derivative]] of <math>f</math> at <math>p</math>. The gradient is an extension of the idea of [[derivative]] to functions with more than one [[variable]]. |
| − | More precisely, we define the gradient, <math>\nabla f</math> of <math>f</math> to be the vector | + | More precisely, we define the gradient, <math>\nabla f</math> of <math>f</math> to be the [[vector field]]: |
<math> | <math> | ||
| Line 9: | Line 9: | ||
</math> | </math> | ||
| − | If <math>u</math> is a unit vector in <math>R^n</math>, then, by the chain rule, the directional derivative of <math>f</math> in the direction of <math>u</math> is simply the dot product: | + | consisting of the various [[partial derivative]]s of <math>f</math>. If <math>u</math> is a [[unit vector]] in <math>R^n</math>, then, by the [[chain rule]], the directional derivative of <math>f</math> in the direction of <math>u</math> is simply the [[dot product]]: |
<math> | <math> | ||
| Line 15: | Line 15: | ||
</math> | </math> | ||
| − | Evidently by the Cauchy-Schwartz inequality, the directional derivative in the direction <math>u</math> is maximal in the direction of the gradient, and equal to <math>||\nabla f||</math> for <math>u</math> a unit vector in the direction of the gradient. | + | Evidently by the [[Cauchy-Schwartz inequality]], the directional derivative in the direction <math>u</math> is maximal in the direction of the gradient, and equal to <math>||\nabla f||</math> for <math>u</math> a unit vector in the direction of the gradient. |
==Properties of the Gradient== | ==Properties of the Gradient== | ||
| − | If <math>f</math> is a differentiable function with smooth level | + | If <math>f</math> is a differentiable function with smooth [[level set]]s <math>f^{-1}(c)</math>, then the gradient vector field <math>\nabla f</math> is [[perpendicular]] to the level sets of <math>f</math>. For fix a level set <math>S = f^{-1}(c)</math>, and let <math>v</math> be a vector [[tangent]] to <math>S</math> at <math>p</math>. Then we can find a [[curve]] <math>\gamma(t)</math> on <math>S</math> with <math>\gamma'(0) = v</math>. Now |
<math> | <math> | ||
| Line 32: | Line 32: | ||
Thus, <math>\nabla f</math> is perpendicular to <math>v</math> at <math>p</math>, i.e., the gradient of <math>f</math> is perpendicular to the level sets of <math>f</math>. | Thus, <math>\nabla f</math> is perpendicular to <math>v</math> at <math>p</math>, i.e., the gradient of <math>f</math> is perpendicular to the level sets of <math>f</math>. | ||
| − | [[Category: | + | |
| + | [[Category:calculus]] | ||
Revision as of 16:54, July 14, 2008
| This article/section deals with mathematical concepts appropriate for a student in late university or graduate level. |
In mathematics, the gradient is a vector associated to a point of a differentiable function Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle f(x_1,...,x_n)} which takes real values. Specifically, the gradient at Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle p} is a vector in Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle R^n} which points in the direction in which Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle f} increases most rapidly at Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle p} . The magnitude of the gradient at Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle p} is equal to the maximum directional derivative of Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle f} at Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle p} . The gradient is an extension of the idea of derivative to functions with more than one variable.
More precisely, we define the gradient, Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \nabla f} of Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle f} to be the vector field:
Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \nabla f = (\frac{\partial f}{\partial x_1},...,\frac{\partial f}{\partial x_n}) }
consisting of the various partial derivatives of Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle f} . If Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle u} is a unit vector in Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle R^n} , then, by the chain rule, the directional derivative of Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle f} in the direction of Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle u} is simply the dot product:
Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \nabla f \cdot u }
Evidently by the Cauchy-Schwartz inequality, the directional derivative in the direction Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle u} is maximal in the direction of the gradient, and equal to Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle ||\nabla f||} for Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle u} a unit vector in the direction of the gradient.
Properties of the Gradient
If Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle f} is a differentiable function with smooth level sets Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle f^{-1}(c)} , then the gradient vector field Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \nabla f} is perpendicular to the level sets of Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle f} . For fix a level set Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle S = f^{-1}(c)} , and let Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle v} be a vector tangent to Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle S} at Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle p} . Then we can find a curve Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \gamma(t)} on Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle S} with Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \gamma'(0) = v} . Now
Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle f\circ\gamma(t) = c }
since Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle S} is a level set. Taking derivatives of both sides and applying the chain rule, we get that
Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \nabla f\cdot \gamma'(0) = \nabla f\cdot v = 0 }
Thus, Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle \nabla f} is perpendicular to Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle v} at Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle p} , i.e., the gradient of Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle f} is perpendicular to the level sets of Failed to parse (MathML with SVG or PNG fallback (recommended for modern browsers and accessibility tools): Invalid response ("Math extension cannot connect to Restbase.") from server "https://wikimedia.org/api/rest_v1/":): {\displaystyle f} .