Gradients and Directional Derivatives

Normalize a direction and use the gradient to predict local increase along it.

Builds on Partial Derivatives and Differentiability

The bigger question: How does a surface change in different directions?

On this page

Combine coordinate rates into one vector

For differentiable ff, the gradient is ∇f=(fx,fy)\nabla f=(f_x,f_y), or (fx,fy,fz)(f_x,f_y,f_z) in space. The derivative per unit distance in a unit direction uu is Duf=∇f⋅uD_uf=\nabla f\cdot u. A vector describing a direction must be normalized before using this as a rate per unit distance.

Cauchy–Schwarz gives ∣Duf∣≤∥∇f∥|D_uf|\le\|\nabla f\|. At a point with nonzero gradient, greatest increase occurs in direction ∇f/∥∇f∥\nabla f/\|\nabla f\| and has rate ∥∇f∥\|\nabla f\|. The opposite direction gives greatest decrease. At a zero gradient, every first-order directional rate is zero; higher-order changes may still occur.

Worked example: normalize before measuring

For f=x2+y2f=x^2+y^2 at (1,2)(1,2), the gradient is (2,4)(2,4). Direction v=(3,4)v=(3,4) has length five, so u=(3/5,4/5)u=(3/5,4/5). The directional derivative is 6/5+16/5=22/56/5+16/5=22/5.

Using vv directly would give 2222, the derivative along the path (1,2)+tv(1,2)+tv per unit tt, whose speed is five. Both numbers have meanings, but they answer different rate questions.

Explore

Direction and rate of change

Try this. At (1,1), compare directions 45°, 135° and 225°: the rate is positive, zero and negative. Move to (0,0); every directional derivative is zero.

Direction and rate of changexy-2-2-1-11122
f(x,y) = x² + y². At (1, 1), f = 2, gradient = (2, 2). Directional rate = 2; maximum rate = 2.828. Orange: chosen unit direction. Green: unit direction of greatest increase. Rings: equal heights. Arrows show direction, not gradient magnitude.

The explorer uses f=x2+y2f=x^2+y^2. Its green arrow shows the unit direction of greatest increase, not the gradient’s magnitude. Orange shows the chosen unit direction; the readout gives the resulting rate.

PAUSE & THINKA quick check, not a grade

Try it yourself.

Choose an answer and explain your reasoning to yourself. Use a hint if you get stuck.

For a differentiable f, at a point where ∇f=(3,4), what is the maximum directional derivative over unit directions?

Hint 1 · Find a starting point

The maximum is the gradient’s magnitude.

Hint 2 · Take the next step

A unit direction along the gradient makes the dot product largest.

Show the reasoning

Answer: 5

||∇f||=√(9+16)=5, attained along (3/5,4/5).

Before moving on: what would make one of the other answers wrong? Saying why is part of understanding.

Worked example: perpendicular to a level curve

For f=x2+y2f=x^2+y^2, the level curve through (1,2)(1,2) is x2+y2=5x^2+y^2=5. A tangent direction there is (−2,1)(-2,1), whose dot product with (2,4)(2,4) is zero. Moving tangentially causes no first-order height change.

More generally, differentiating f(r(t))=cf(r(t))=c gives ∇f⋅r′=0\nabla f\cdot r'=0. At regular points, the gradient is normal to the level set. A zero gradient cannot supply a normal direction and can mark a crossing, cusp or other exceptional behavior.

Practice

  1. Find the greatest directional rate of f=3x−4yf=3x-4y.
  2. Find its derivative in direction (1,1)(1,1).
  3. What are all first-order directional derivatives of x2+y2x^2+y^2 at zero?
Show worked solutions
  1. ∥(3,−4)∥=5\|(3,-4)\|=5.
  2. Normalize to (1,1)/2(1,1)/\sqrt2, giving −1/2-1/\sqrt2.
  3. All are zero because the gradient vanishes, although the function increases quadratically away from zero.

Further study

MIT OpenCourseWare: Multivariable Calculus provides a full university course with additional lectures and exercises.

MAKE IT YOURS

Pause before the next idea.

Can you explain how the visualization connects to this lesson’s goal? If a step still feels uncertain, put this lesson on your review list and try the check again another day.

Optional marks, not a grade. Saved in this browser only. Open notebook →