History of Dantzig-Wolfe Decomposition
Trace the development of Dantzig-Wolfe Decomposition from its 1960 origins through to its lasting influence on modern column generation and large-scale optimisation.
Origins of the Algorithm
In 1960, George Dantzig and Philip Wolfe published a landmark paper introducing the decomposition principle for linear programming. Their work appeared in the journal Operations Research and addressed a fundamental computational challenge: at the time, many real-world linear programs of practical interest were far too large to solve directly by the simplex method.
The motivation was clear: solving large-scale linear programs that were computationally intractable by direct simplex methods required a fundamentally different approach. Dantzig and Wolfe recognised that many such problems possessed a special structure β a form β that could be exploited algorithmically.
By decomposing the problem into a coordinating a set of smaller
s, they showed that the full optimum could be recovered without ever handling the entire problem at once.
Dantzig, G. B. and Wolfe, P. (1960). Decomposition Principle for Linear Programs . Operations Research, 8(1), 101β111. doi:10.1287/opre.8.1.101Relationship to the Simplex Method
The simplex method, developed by George Dantzig in 1947, remains the dominant algorithm for linear programming. Dantzig-Wolfe Decomposition is not a replacement β it is a structured application of simplex to problems with a particular geometry.
Block-Angular Structure
Many real-world LP formulations exhibit structure: a set of
linking otherwise independent sub-problems. This arises naturally in multi-divisional planning, transportation networks, and scheduling problems.
Dantzig-Wolfe exploits this structure by representing feasible solutions to each sub-problem as
s (or extreme rays) of the sub-problemβs feasible region. The then selects a convex combination of these extreme points that satisfies the coupling constraints and minimises the objective.
This is precisely the simplex method applied to a reformulated problem β but working in the space of extreme points rather than original variables. The column generation procedure that drives Dantzig-Wolfe decomposition adds new extreme points (columns) to the master problem on demand, guided by the of the coupling constraints.
Dantzig, G. B. (1963). Linear Programming and Extensions. Princeton University Press. Dantzig, G. B. and Wolfe, P. (1960). Decomposition Principle for Linear Programs . Operations Research, 8(1), 101β111. doi:10.1287/opre.8.1.101Early Industrial Applications
Following its 1960 introduction, Dantzig-Wolfe Decomposition was rapidly adopted in industrial planning contexts where large-scale LP problems were endemic.
Transportation and Logistics
The multi-commodity flow problem β routing multiple commodities through a shared network subject to capacity constraints β is a natural fit for decomposition. Each commodityβs flow can form an independent sub-problem, with the coupling constraints enforcing shared capacity limits. This formulation was studied extensively in the 1960s by Ford, Fulkerson, and others.
Ford, L. R. and Fulkerson, D. R. (1962). Flows in Networks. Princeton University Press.Energy Systems Planning
Electric utility planning in the 1960s and 1970s involved large LP models for generation dispatch and capacity expansion. The block-angular structure arising from multi-period, multi-region models made decomposition methods attractive.
Manne, A. S. (1956). Scheduling of Petroleum Refinery Operations. Harvard University Press.Production Planning
Multi-product, multi-period production planning problems provided another early application domain. Each product line or time period could be treated as a sub-problem, with shared resource constraints acting as .
Lasdon, L. S. (1970). Optimization Theory for Large Systems. Macmillan.Column Generation and Its Origins
One of the most important legacies of Dantzig-Wolfe Decomposition is the technique of
, which has since become a foundational tool across integer programming and combinatorial optimisation.
Pricing Sub-Problems as the Conceptual Origin
In Dantzig-Wolfeβs original formulation, the algorithm iterates between a
and a set of s. At each iteration, the sub-problems are solved using the from the master problem to determine whether any new column (extreme point) can improve the master objective. This is determined by computing the of candidate columns.
The recognition that sub-problems need only generate improving columns β those with negative reduced cost in a minimisation problem β meant that exponentially large master problems could be solved by implicitly maintaining the column pool.
Legacy: Cutting Stock and Crew Scheduling
Gilmore and Gomory formalised this insight for the cutting-stock problem in 1961β1963, explicitly citing the Dantzig-Wolfe decomposition principle as their inspiration. Their work spawned a vast literature on column generation for combinatorial optimisation.
Gilmore, P. C. and Gomory, R. E. (1961). A Linear Programming Approach to the Cutting Stock Problem . Operations Research, 9(6), 849β859. doi:10.1287/opre.9.6.849 Barnhart, C. et al. (1998). Branch-and-Price: Column Generation for Solving Huge Integer Programs . Operations Research, 46(3), 316β329. doi:10.1287/opre.46.3.316Bibliography
The following references underpin the historical account presented on this page. All citations follow standard academic format; DOI links connect to the original publications where available.
Dantzig, G. B. and Wolfe, P. (1960). Decomposition Principle for Linear Programs . Operations Research, 8(1), 101β111. doi:10.1287/opre.8.1.101 Dantzig, G. B. (1963). Linear Programming and Extensions. Princeton University Press. Ford, L. R. and Fulkerson, D. R. (1962). Flows in Networks. Princeton University Press. Gilmore, P. C. and Gomory, R. E. (1961). A Linear Programming Approach to the Cutting Stock Problem . Operations Research, 9(6), 849β859. doi:10.1287/opre.9.6.849 Lasdon, L. S. (1970). Optimization Theory for Large Systems. Macmillan. Manne, A. S. (1956). Scheduling of Petroleum Refinery Operations. Harvard University Press. Barnhart, C. et al. (1998). Branch-and-Price: Column Generation for Solving Huge Integer Programs . Operations Research, 46(3), 316β329. doi:10.1287/opre.46.3.316