Infinitesimal calculus MOC

Lagrange multiplier

Lagrange multipliers are an optimisation technique under a constraint particularly useful when it is impossible or difficult to reduce the function to be optimised to a single variable function. It forms the basis of the Lagrangian function.¹

Statement

Given a function to be optimised and constraining function , a maximising or minimising input will satisfy

where is called the Lagrangian multiplier.

Multiple constraints

In the case of optimising under multiple constraints

the equation to be satisfied becomes

Intuitive justification

The constraint forms a Level set of . Therefore any inputs to which satisfy the constraint correspond to intersections of the level curve and some level curve . For any optimising (i.e. maximising or minimising) input of , the two level curves will be tangent. Since Gradient vectors are perpendicular to level curves, this necessarily implies the the gradients and are parallel, and hence there exists some nonzero such that²

Usage

In order to solve an optimisation problem using Lagrangian multipliers with input of dimension (i.e. ), one must solve a system of equations.

Significance of the multiplier

The lambda multiplier is not an arbitrary, meaningless value. It is the derivative of the optimised value with respect to the constraining value where is the constraint.

See also

• Duality of optimisation problems

Practice problems

• 2022. MATH1011: Multivariable calculus, pp. 65–66 (example 4.29; exercise 4.4.1)
• 2016. Calculus, pp. 1017–1018 (§14.8 exercises)
• 2023. Advanced Mathematical Methods, p. 77 (§4 problems)

---

tidy | sembr | en | review

Footnotes

1. 2022. MATH1011: Multivariable calculus, pp. 65–66 ↩

2. 2016. Calculus, pp. 1011–1012 ↩