Lagrange Multipliers and Constraint Geometry

Find constrained candidates while checking regularity and the complete feasible set.

Builds on Absolute Extrema on Closed Regions

The bigger question: Where is the best value when movement has limits?

On this page

At an extremum, allowed directions cannot improve the value

On a regular constraint g(x,y)=cg(x,y)=c, tangent directions are perpendicular to ∇g\nabla g. At a differentiable constrained extremum, ∇f\nabla f is also perpendicular to those tangent directions. Thus

∇f=λ∇g,\nabla f=\lambda\nabla g, g=c,g=c,

provided ∇g≠0\nabla g\ne0. The multiplier is an additional unknown, not a replacement for the constraint. The equations produce candidates that still require comparison or classification.

Visual guide

VISUAL GUIDEAt an extremum, the level line is tangent
Maximizing x + 2y on x² + y² = 5 puts the maximum at (1, 2). The level line x + 2y = 5 is tangent to the circle there. Its normal is parallel to the constraint gradient, expressing ∇f = λ∇g.-3-3-1.5-1.5001.51.533xy
  • Constraint circle
  • Maximum level x + 2y = 5
Maximizing x + 2y on x² + y² = 5 puts the maximum at (1, 2). The level line x + 2y = 5 is tangent to the circle there. Its normal is parallel to the constraint gradient, expressing ∇f = λ∇g.

Worked example: a linear objective on a circle

Maximize and minimize f=x+2yf=x+2y on x2+y2=5x^2+y^2=5. The equations are 1=2λx1=2\lambda x, 2=2λy2=2\lambda y, so y=2xy=2x. Substituting into the circle gives 5x2=55x^2=5, yielding (1,2)(1,2) and (−1,−2)(-1,-2).

Their values are 55 and −5-5. Compactness of the circle and continuity of ff ensure extrema exist, and the constraint gradient never vanishes there. Therefore these candidates supply the absolute maximum and minimum.

PAUSE & THINKA quick check, not a grade

Try it yourself.

Choose an answer and explain your reasoning to yourself. Use a hint if you get stuck.

At a regular constrained extremum of f with g=c, how are ∇f and ∇g related?

Hint 1 · Find a starting point

Allowed motion is tangent to the constraint.

Hint 2 · Take the next step

Both gradients are normal to that tangent at the candidate.

Show the reasoning

Answer: ∇f=λ∇g for some λ

The gradients are parallel when ∇g≠0. This produces candidates, which still need checking.

Before moving on: what would make one of the other answers wrong? Saying why is part of understanding.

Worked example: a singular constraint

Take g(x,y)=x2+y2=0g(x,y)=x^2+y^2=0. The feasible set consists only of the origin, so every objective reaches both its feasible maximum and minimum there. But ∇g(0,0)=0\nabla g(0,0)=0. For f=xf=x, the multiplier equation (1,0)=λ(0,0)(1,0)=\lambda(0,0) has no solution.

The method missed a genuine feasible extremum because the constraint qualification failed. Always inspect points where the constraint gradient vanishes. For several constraints, their gradients must be linearly independent for the standard multiplier conclusion; then ∇f=∑jλj∇gj\nabla f=\sum_j\lambda_j\nabla g_j.

A multiplier can also describe sensitivity. Under suitable smoothness of the optimizing branch, the derivative of the optimal value with respect to the constraint level cc equals λ\lambda with the convention ∇f=λ∇g\nabla f=\lambda\nabla g. This interpretation depends on the chosen scaling of gg and is not itself a proof of optimality.

Practice

  1. Maximize xyxy on x2+y2=2x^2+y^2=2.
  2. Why must g=cg=c be included in the equation system?
  3. Can a finite candidate list alone prove an extremum exists on an unbounded feasible set?
Show worked solutions
  1. The maximum is 11 at (1,1)(1,1) and (−1,−1)(-1,-1), since 2xy≤x2+y2=22xy\le x^2+y^2=2; multiplier equations recover these points.
  2. Otherwise a gradient relation may hold away from the feasible set.
  3. No. Behavior at infinity must also be controlled; the objective may be unbounded or approach an unattained limit.

Further study

MIT OpenCourseWare: Multivariable Calculus provides a full university course with additional lectures and exercises.

MAKE IT YOURS

Pause before the next idea.

Can you explain how the visualization connects to this lesson’s goal? If a step still feels uncertain, put this lesson on your review list and try the check again another day.

Optional marks, not a grade. Saved in this browser only. Open notebook →