Groundwater remediation design using physics-based flow, transport, and optimization technologies
© Deschaine et al.; licensee Springer. 2013
Received: 18 December 2012
Accepted: 10 April 2013
Published: 4 May 2013
The purpose of this work was to demonstrate an approach to groundwater remedial design that is automated, cost-effective, and broadly applicable to contaminated aquifers in different geologic settings. The approach integrates modeling and optimization for use as a decision support framework for the optimal design of groundwater remediation systems employing pump and treat and re-injection technologies. The technology resulting from the implementation of the methodology, which we call Physics-Based Management Optimization (PBMO), integrates physics-based groundwater flow and transport models, management science, and nonlinear optimization tools to provide stakeholders with practical, optimized well placement locations and flow rates for remediating contaminated groundwater at complex sites.
The algorithm implementation, verification, and effectiveness testing was conducted using groundwater conditions at the Umatilla Chemical Depot in Umatilla, Oregon, as a case study. This site was the subject of a government-sponsored remedial optimization study. Our methodology identified the optimal solution 40 times faster than other methods, did not fail to perform when the physics-based models failed to converge, and did not require human intervention during the solution search, in contrast to the other methods. The integration of the PBMO and Lipschitz Global Optimization (LGO) methods with standalone physically based models provides an approach that is applicable to a wide range of hydrogeological flow and transport settings.
The global optimization based solutions obtained from this study were similar to those found by others, providing method verification. Automation of the optimal search strategy combined with the reliability to overcome inherent difficulties of non-convergence when using physics models in optimization promotes its usefulness. The application of our methodology to the Umatilla case study site represents a rigorous testing of our optimization methodology for handling groundwater remediation problems.
KeywordsGroundwater modeling Contamination Remediation Optimization
The increasing scarcity and degradation of potable water resources is an issue of global concern. Sources of water quality contamination include releases of chemical and radionuclide contaminants from point-source and non-point source origins. The costs of addressing water quality issues on a global scale are substantial. Regulatory agencies such as the U.S. Environmental Protection Agency (EPA) and counterpart agencies in other countries must consider economic and human health costs with budgetary constraints in their efforts to clean up contaminated groundwater and restore water resources to beneficial reuse. The EPA documents this need to perform groundwater remediation in an optimal manner in the “National Strategy to Expand Superfund Optimization Practices from Site Assessment to Site Completion” (USEPA, 2012).
The objective of this research is to develop and demonstrate an automated, cost-effective, and broadly applicable approach to groundwater remedial design applicable to contaminated aquifers in different geologic settings. This paper presents the development, scope and application of the simulation-optimization approach for remediating contaminated groundwater including reliability and efficiency verification to find globally optimized solutions to groundwater remediation problems. The approach is demonstrated using a well-studied, publically documented site example that was the subject of a government-sponsored remedial optimization study.
Key features and limitations of previous optimization tools
Key features and limitations
GWM: Ground-Water Management Process for the U.S. Geological Survey (USGS) MODFLOW-2000 (Ahlfeld, et al., 2005)
● Performs optimization using Linear Programming (LP) or Sequential Linear Programming (SLP).
● Tightly integrated to the MODFLOW code.
● Handles only confined flow and mildly non-linear unconfined flow situations.
MGO: Modular Groundwater Optimizer (Zheng and Wang, 2003) based on MODFLOW and the MT3DMS code (Zheng and Wang, 1999) for contaminant transport simulation
● Performs optimization using heuristic global optimization methods, including Genetic Algorithm (GA) and Tabu Search (TS).
● Tightly integrated to the MODFLOW and MT3DMS codes.
● Computationally burdensome and cumbersome to use even for relatively straightforward practical situations.
SOMOS: Simulation/Optimization Modeling System (Peralta, 2004)
● Performs optimization using a combination of GA, TS, and Artificial Neuron Network (ANN) in conjunction with groundwater flow and solute transport modeling.
SEA: Successive Equimarginal Approach, a hybrid of the gradient-based method and the deterministic heuristic-based method (Guo, et al., 2007)
● Performs optimization using SEA to alleviate some of the computational burden of MGO.
● Integrated with MODFLOW and MT3DMS.
● Cumbersome to use requires frequent user intervention and may not lead to a global optimum.
DoD/ESTCP Simulation-optimization demonstration project
This approach is tested using a study problem posed as part of the joint U.S. Department of Defense (DoD)/Environmental Security Technology Certification Program (ESTCP) Groundwater Remediation Optimization Study (Minsker et al. 2004); the groundwater contamination remediation design at the Umatilla Chemical Depot in Umatilla, Oregon. The site has a pre-existing and operational remedy-in-place (RIP) installed to remediate the Royal Demolition Explosive (RDX) and 2,4,6-Trinitrotoluene (TNT) contaminated groundwater plumes. The RIP consists of a groundwater pump and treat remediation system.
The original research teams used three optimization approaches during the DoD/ESTCP study. The DoD/ESTCP report presents these approaches in their entirety in Appendix D, Volume II. The design approaches consisted of Subject Matter Expertise (SME); the Modular Groundwater Optimization (MGO) (Zheng and Wang 2002), and; the Simulation/Optimization Modeling Optimization Software System (SOMOS) (Systems Simulation/Optimization Laboratory SSOL 2002). The team from the University of Alabama applied the MGO approach, the team from Utah State University applied the SOMOS approach, and the group from GeoTrans applied an SME-based subjective engineering approach. The publically available project web site (http://www.frtr.gov/estcp) provides the DoD/ESTCP study reports, groundwater flow and transport models, and modeling files of the final solutions to this problem.
The Umatilla research problem formulation used for testing is ESTCP Formulation 1. The goal of the formulation aims to reduce the projected clean up times of RDX and TNT at minimal cost, subject to constraints on the total allowable pumping and injection, treatment capacity, and the number of new wells needed. The experimental design of the DoD/ESTCP study directed the investigators to consider the existing flow and transport models as “up-to-date and acceptable for design purposes”. The groundwater flow model code is USGS MODFLOW-96 (McDonald and Harbaugh 1988; Harbaugh and McDonald 1996). The model code MT3DMS4 (Zheng and Wang 1999) for multispecies contaminant transport. The objective function calculator provided by ESTCP evaluates the cost associated with a remedial design and its performance. U.S. Army Corps of Engineers USACE (1996) developed and provided the MODFLOW-96 groundwater flow and MT3DMS4 solute transport models to the ESTCP study group.
The algorithm developed in this study - Physics-Based Management Optimization (PBMO) – is an automated simulation-optimization based method. Examination of the optimal design solution from PBMO with those from the ESTCP study demonstrates its effectiveness. The PBMO solution acceptance metric is a cost equal to or lower than developed by the MGO team. MGO provided one of the lowest costs with the least amount of computational effort of the automated approaches. Using the same physically based models and objective function calculator in all the studies isolates the performance of the demonstrated optimization algorithms.
Umatilla chemical depot, Umatilla Oregon site background and description
Briefly, Umatilla is a 19,728-acre military reservation established in 1941 as an ordnance depot for the storage, renovation, and demilitarizing of conventional munitions, and for the storage of chemical munitions. As of 1994, the Umatilla site only stored chemical munitions awaiting destruction. A washout plant operated at the site in the 1950s and 1960s. Discharges to unlined lagoons consisted of an estimated 85 million gallons washout water laden with RDX and TNT. The water table is present about 47 feet beneath the bottoms of the lagoons. The resulting soil and groundwater contamination caused the placement of Umatilla on the EPA National Priorities List (NPL) in 1984. Section 3.1.1 of the study report (Minsker et al. 2004) provides additional description of the Umatilla site and historical summary.
Strategic planning for groundwater remediation, water resources planning and dewatering for mineral and resource mining requires tools that incorporate the complex constraints associated with the environment and support decision making with varying levels of uncertainty. This can include uncertainty in the conceptual site model, subsurface characterization (e.g. geologic material location and properties), chemical transport (e.g. reactions, natural attenuation, biodegradation), and funding levels (e.g. annual and total life cycle project) (ITRC, 2007).
Comprehensive: Physics-based models incorporate realistic and measurable physical parameters required for accurately describing the fate and transport of dissolved contaminants within aquifers. Optimal solutions based on physics-based models are more reliable than those from “lumped” parameter or ad hoc approximations.
Efficient and Effective: Physics-based models are superior to lumped parameter or ad hoc models in accounting for changes in contaminant mass within aquifers. Increased accuracy yields solutions that better manage the use of remedial technologies and optimize costs and, therefore, be in complete control of the utilization of available funding.
Flexible: Physics-based models can readily incorporate extended physical analysis to enable the development of optimal planning scenarios for processes that are outside of historical (data) observations, whereas models built on regression, interpolation, or extrapolation methods may not be representative.
Groundwater remediation problems amenable to physics-based decision optimization include the development of cost-effective and sustainable remedial designs; RIP evaluation and operation and maintenance (O&M) optimization; the development of optimized exit strategies to minimize life-cycle costs; the development of site completion/closure strategies; and water quality management issues for riparian and lacustrine settings, wetlands, and estuaries. This approach provides decision support to program and project managers regarding the best methods for remediating a site with contaminated groundwater.
Cost minimization is the overall optimization objective. In the case of groundwater remediation, well locations and their extraction or injection rates are the decision variables, and the simulated hydraulic heads and contaminant concentrations in groundwater are the state variables. Decision variables are the design elements of the problem studied. State variables represent the resultant simulated system. The objective function is a systematic accounting of costs which include the number, operation, and maintenance of the design elements (decision variables) and account for the changes in the modeled system (state variables) response from the candidate design. Computed over the life cycle of the simulation, the objective function represents the total remediation cost. The incorporation of constraints ensures the solution is practical and implementable. Constraints capture mechanical or physical process limitations (such as maximum pumping rates, and treatment train capacities) or interim and final values of state variables at discrete or continuous regions of the modeled domain. Assessment of candidate solution s is conducted by examining the cost value and the constraint compliance. A single model function evaluation is the cycle of the decision variable selection, process simulation, model objective function evaluation and constraint evaluation of a candidate design. Optimization is the automatic, guided process of the decision variable selection and application through repeated model function evaluations to arrive at the optimal objective function value that satisfies all constraints. The automatic adjustment of decisions variables terminates (ideally) at the global optimum (least cost).
Subsurface simulators represent the physical processes of flow and transport in a mathematical form. Problem-specific, physics-based models represent the groundwater processes/conditions under investigation. From an optimization perspective, these simulation models can be “black-boxes”, that is models that receive input to produce an output without revealing the process. Since these groundwater flow and transport processes can occur in saturated or variably saturated conditions, in porous or fractured media, the numerical model used for the simulation will have a linearity category; the simulation can be linear, mildly non-linear (assumedly or provably convex), or highly non-linear (assumedly or provably non-convex). The system under consideration can be either single phase (water) or multiphase (water-NAPL-gas). The transport processes can be represented simply by using advective particle tracking, as a single non-reactive solute that undergoes dispersion and diffusion, or as a multicomponent system whose constituents interact with each other and the surrounding environment and are subject to hysteresis. The equations that govern these processes are Lipschitz-continuous, whose state-space representation can range from elliptic to parabolic or nearly hyperbolic when advection dominated. When no or low diffusion and dispersion are present relative to advection, steep fronts or shocks occur in the solutions. A complication for efficient optimization approach design arises when that the decision variables used in a candidate model evaluation during optimization change the model linearity category. Typically, the simulation of groundwater flow with slight drawdown is linear to mildly non-linear (because the saturated aquifer thickness does not change appreciably), whereas the simulation of significant groundwater drawdown or coupled groundwater flow and transport are most often highly non-linear. For the model scenario considered in this study, the flow system will range from linear far from the remediation system and contaminant plumes to highly non-linear in the contaminant plumes and near the remediation wells. The objective function is non-linear.
Where K xx , K yy and K zz are the values of hydraulic conductivity [L/T] along the x, y, and z coordinate axes, respectively, assumed to be parallel to the major axes of hydraulic conductivity; h is the potentiometric head [L]; q s is a volumetric flux per unit volume of the aquifer and represents sources (injection wells) and/or sinks (extraction wells) of water [1/T]; Ss is the specific storage of the aquifer material [1/L]; and t is time (T).
Where θ is the porosity of the aquifer material [-]; C k is the dissolved concentration of species k [M/L3]; x i,j is the distance along the respective coordinate axis, x, y or z [L]; D ij is the hydrodynamic dispersion coefficient tensor [L2/T]; v i is the seepage or linear pore water velocity [L/T]; is the concentration of the source or sink flux for species k [M/L3], and; ∑ R n is the chemical reaction term [M/(L3T)].
To provide an optimization solver with the capability and efficiency to address this range of model types, PBMO is developed and implemented leveraging a suite of optimization algorithms that efficiently solve the various formulations expected to occur in the optimal decision support approaches presented here.
HGL_OPT is the master optimization driver. It comprises machine learning, objective function estimating methods, and SME-developed heuristics specifically useful for quickly developing high quality solutions to complex problems such as contaminant flow and transport remedial design (Deschaine 1992 and Deschaine 2003; Deschaine and Pintér 2003; and Deschaine et al. 19982001 and Deschaine et al. 2011). These solutions can be used to focus (or initialize) the LGO-specific global and local optimization solvers.
The optimization algorithms included in the optimizer suite include linear programming (LP), sequential linear programming (SLP), sequential linear approximation (SLA), sequential quadratic programming (SQP), generalized reduced gradient (GRG), outer approximation (OA), Branch and Bound (BB), Globally Adaptive Random Search (GARS), and Multi-start Random Search (MS). Specifically, LP solves linear models; OA, SLP, SLA, SQP, and GRG serve to deal with mildly non-linear models; BB, GARS, and MS―in proper combination with SLA, SQP, and GRG―serve to handle highly nonlinear models.
Minimize the [arbitrary linear or nonlinear] objective function f(x)
- ii.Subject to bound constraints and [arbitrary linear or nonlinear] constraints:(4)
where x is a decision vector, an element of the real n-space R n ; f(x) is a continuous objective function, f: R n R, (R=R 1 ); D is a non-empty set of admissible decisions, a subset of R n . As shown by (4), the set D is defined by l, u which is an explicit, finite n-vector bound of x (a “box”) in R n ; and g(x) which is an m-vector of additional continuous constraint functions, g: R n R m .
where [L j ] is the Lipschitz constant. This equation means that the variability of the values computed by the objective function calculator is bounded with respect to the variability of the system input variables [x] by the Lipschitz constant. This condition is an expected property of all physically based models.
Here, the objective function f(x) is a simplified version of life cycle cost for illustrative purposes. It consists of the flow rate from extraction wells [q i ], a unit cost to process and treat the water [α i ]; and it assesses if an extraction well is pre-existing or not by examining for ∀ i locations and assigning a (0,1) multiplier if a well installation required (δ i =1) or is pre-existing (δ i =0). The actual formulations of the objective function for optimal design problems often involve quite extensive and detailed cost information and functions such as used in this study. The constraint requires the installed system pumps at least some minimum volume of water Q. The constraint sets upper limits on a flow at each of the ith candidate well. The constraints ensure aquifer remediation to a certain acceptable residual level for all j locations. The constraints set minimum allowable water table elevations in the aquifer at all k locations. The t ≤ T max constraint limits the allowable time for the activity to achieve the specified goals. These general constraints, like the cost function, can be modified and adapted as dictated by the needs of the project. For example, one can use this framework to incorporate constraints for differential land subsidence due to dewatering by using differencing constraints and adding constraints on the maximum slope of the water table or land surface. Similar approaches are effective for assessing depressurization and geotechnical stability.
The goal of constrained global optimization is to find at least one point x * within the feasible region that satisfies f(x * ) ≤ f(x) for all x or to show that such a point does not exist. If no solution exists, then the decision makers realize it is an infeasible problem formulation. This enables the problem be reformulated. It is critical to determine if a feasible solution does not exist when solving a complex decision problem. This is a valuable capability of the physics-based optimization methodology. Many other optimization methods, specifically including heuristic techniques, cannot determine that a problem is infeasible: as a result, users can waste precious time and money searching for solutions with no hope of finding a feasible solution.
Umatilla optimization problem formulation
The three optimization problem formulations considered in the DoD/ESTCP study were:
Formulation 1: Minimize the cost to remediate RDX and TNT in 20 years or less using the current treatment plant maximum operating flow rate of 1,300 (gpm) as an upper limit on the total groundwater extraction rate;
Formulation 2: Same as Formulation 1, except the maximum treatment flow rate increased to 1,950 (gpm);
Formulation 3: Minimize the aggregate remaining mass of RDX and TNT in 20 years using the current treatment plant flow rate.
The PBMO approach addresses all these types of optimization formulations. This exercise focuses on finding a solution to the problem as stated by Formulation 1. Appendix D, Volume II of the DoD/ESTCP report (Minsker et al. 2004) provides the mathematical formulation of the problem statement in detail.
N y is the modeling year when cleanup is achieved [yr] as defined by [C RDX ] ≤ 2.1 μg/L and [C TNT ] ≤ 2.8 μg/L as measured by the nodal concentration value in the top layer.
N Wi is the total number of new extraction wells (except well EW-2) installed in year i. New wells may only be installed in years corresponding to the beginning of a 5-year management period. Capital costs do not apply to pre-existing extraction wells.
I EW2 is a flag indicator; 1 when well EW-2 first comes into service, 0 otherwise.
75 is the cost of installing a new well [K$].
25 is the cost of putting existing well EW-2 into service [K$].
c is the cost
r is the annual discount rate [1/yr]
y is the value of i in the summation
N Bi is the total number of new infiltration basins installed in year i. New recharge basins may only be installed in years corresponding to the beginning of a 5-year management period. The infiltration flux is evenly distributed throughout the basin.
25 is the cost of installing a new recharge basin independent of its location [K$/yr].
237 is the fixed annual O&M labor cost [K$/yr].
3.6 is the fixed annual electric cost [K$/yr].
I Wij is a flag indicator; 1 if well j is active in year i, 0 otherwise.
β is a conversion factor to produce the result in units of [kg/yr].
I A is the initial plume area in layer 1 of the model based on the extent of RDX and TNT as measured in January 2003 where RDX and TNT exceeded their respective cleanup goals (2.1 and 2.8 μg/L, respectively) [m2]
150 is the annual sampling cost (as of January 2001) and considers both labor and analysis costs [K$/yr]
N col is the number of grid cell columns in the x direction
N row is the number of grid cell rows in the y direction
Δx j is the width of the jth grid cell column [m]
Δy k is the width of the kth grid cell row [m]
The modeling period consists of four 5-year management periods beginning with January 2003 (i or year = 1).
Modifications to the system may only occur at the beginning of each management period.
Remediation in the top layer of the model must be achieved within 20 years (e.g., RDX ≤ 2.1 μg/L and TNT ≤ 2.8 μg/L everywhere in top model layer).
- 4)The total pumping rate, adjusted for the average amount of uptime, cannot exceed the treatment capacity of 1,300 (gpm) in any stress period. Evaluation of this constraint occurs at the beginning of each 5-year management period. It is computed as:(20)
α is a coefficient that accounts for the amount of average uptime (α=0.9)
Q* is the total modeled flow rate during a 5-year management period.
- 5)The hydrology dictates the upper sustainable flow limit on extraction wells. Extraction wells in Zone 1 may pump at a maximum rate of 400 (gpm), whereas extraction wells in Zone 2 may operate to a maximum of 1,000 (gpm). See Figure 2 for definitions of Zones 1 and 2:(21)
Zone(j,k) is a function of the jth grid cell column and kth grid cell row that returns 1 if model grid (j,k) corresponds to Zone 1, and returns 2 if (j,k) corresponds to Zone 2is the modeled extraction rate at model grid location (j,k).
It is unallowable for the extent of groundwater contamination to increase beyond initial conditions at any time during the remediation.
- 7)Total pumping and infiltration rates must be balanced at the beginning of every management period(22)
where:is the number of injection wells operating in year i.
In summary, the optimization problem can be stated as follows: find the combination of simulated extraction and injection well locations and their operating rates that minimize the cost of reducing RDX and TNT concentrations within a 20 year time horizon while satisfying all the constraints on well, remedy operations, and plume behavior. The remedial system designs use the calendar year 2003 as the starting point.
The groundwater flow and transport models provided for the study simulate 20 years with four management periods of five years each. The extraction and injection flow rates can vary across the management periods, but not within a management period. The locations of the extraction and injection infrastructure can only vary between candidate solutions, not between management periods.
Optimization solution approach
The optimization problem is solved by defining the regions to search for the globally optimal settings of the decision variables, and prescribe how to conduct the search. The decision variable search regions mimicked, as closely as possible, the regions established for new well locations and infiltration basins by the MGO team. The MGO team confined their search for new extraction well locations to regions where the plume densities were highest as shown on Figure 2. Each region contains the areas of the highest concentration for the three principal lobes of the two contaminant plumes. In addition to these search areas for extraction wells, locations for three new infiltration basins, IF-A, IF-B, and IF-C in the original study at the extent of the RDX plume to the east, southeast, and southwest as alternatives to the four pre-existing recharge basins. In all, a total of 11 candidate regions exist for locating decision variables: four extraction areas and seven injection/recharge areas; the locations as defined by the MGO team. These 11 regions make up the infrastructure search areas of the remedy used to alter the distribution of RDX and TNT in groundwater. Active remediation solutions require non-zero total extraction and injection fluxes; hence, there must be at least one extraction location and one injection location active for all viable candidate solutions.
Number of candidate extraction well locations in each of the three search boxes
Number of potential extraction well locations(1)
(40,53) to (63,73)
(82,63) to (91,83)
(82,90) to (90, 96)
Allowing an extraction well(s) to be located in any of the three search boxes results in 302,253 potential extraction well location combinations. The 128 different candidate location configurations for the infiltration basins results in a total of 38,688,384 candidate infrastructure system designs. Simultaneously, when determining the infrastructure configuration design, the water flow rates are optimized. This magnitude of options illustrates the difficulty of finding the optimal solution either by random searching or by using the SME subjective engineering judgment.
Evaluate the cost of the RIP. The RIP consists of three extraction wells and three infiltration basins. Store these results as a current minimum.
- 2)Begin evaluation of different combinations of extraction wells and infiltration basins.
Set number of evaluation epochs equal to one.
Initial extraction location: Initiate the solution using the study maximum number of new wells (two), located in Box 1 (which contains the RDX and TNT plumes).
Initial injection location: IFL located in Box 1, the innermost infiltration basin.
Initiate search strategy. Begin to cycle through and test the 4 pumping areas and 7 injection areas for quality of solution, use extraction rate total = system maximum capacity of 1170 (gpm) (which is 1,300 (gpm) * 90% uptime) as done by the MGO team.
Set search cycle a minimum number of evaluations (12).
- f.Upon finding a cost lower than current minimum cost:
Select the solutions with the two lowest costs.
Explore these regions by conducting brief local random searches (LRS) on each solution to (statistically) determine the most promising configuration of wells and basins. Perform initial analysis using the physically-based model. The optimization search progresses and generates an increasing number of function evaluations. Machine learning is invoked to provide candidate solution objective function evaluation estimation which reduces computation burden when model evaluations models are extensively time consuming.
Store these results (configuration, rates, cost).
- h.Evaluate best current solution.
If solution improves, replace previous remedial design configuration and objective function value.
- 3)Initiate a global optimization analysis using the LGO search options of GARS followed by GRG; initialize using currently best identified solution.
- a.Upon finding a cost lower than current minimum cost:
Store these results.
- 4)If termination criteria met,
Else, increment number of evaluation epochs by 1 until the user-specified maximum number reached. Store and print results.
Go to step 2.
PBMO’s partition and exploration approach enables implementation of the search strategy be conducted on multiple central processing units (CPUs). However, this test used a sequential implementation to mimic ESTCP test conditions. The search continues until the termination criterion satisfied. The termination criterion can either be the targeted optimal cost, the total number of flow and transport simulations, the number of simulations since the optimal value was last improved, or the total simulation (CPU) time consumed. In this case, the termination criterion was the optimal total remedial cost as published by the MGO team. The initial starting point for the total flow rate is the maximum treatment plant flow rate 1,170 (gpm) and mimics the MGO team. Initially, all extraction wells in Box 1 equally pumped; all extracted water injected into the single infiltration gallery IFL, and new candidate extraction wells placed randomly during the infrastructure search phases.
Results and discussion
Optimal pumping strategies found using SME, MGO and PBMO for formulation 1 at Umatilla compared with existing RIP design
Location (Layer, Row, Column)
Pumping/injection rate (gpm)
Formulation 1 solutions
Stress period 1
Stress period 2
Stress period 1
Stress period 1
Total cost in net present value ($)
The termination criterion in the test was the MGO cost value. PBMO found a lower cost that MGO in fewer than 120 model evaluations. Additional optimization analysis performed during reliability testing produced multiple solutions with lower costs - as low as $1,663,240 – and with different new well extraction locations and different rates in the extraction wells. These subsequent findings illustrate the multi-extremal structure of this design problem, thereby calling for global optimization based solution approaches.
Simulation model reliability over the range of feasible inputs is essential for determining the globally optimal variable values. We observed that 10.7% of the viable candidate designs simulated in the groundwater flow and transport models during the optimization search failed to converge. This primarily occurred when the extraction well flow rates were set near the high end of the acceptable range and which caused flow model cells to dewater. In instances where model cells become dewatered, the groundwater flow simulator could not converge to a solution without the application of a non-physical lower bound on the head in the dewatered cella. Given that the two simulators execute sequentially during a function evaluation (groundwater flow followed by fate and transport), the failure of the flow simulator to provide a convergent solution prevents the transport simulator from predicting contaminant distributions resulting in a lost candidate design evaluation cycle.
PBMO addresses issues that arise in model simulations due to these harsh modeling scenarios imposed by formal optimization. PBMO examines the model simulation solution time and the flow and transport mass balance errors. Automated solver parameter adjustments can take place if the solution becomes unstable or inefficient. If a model nevertheless fails to converge after a user-specified maximum number of numerical solver parameter setting attempts, penalty functions divert the optimal search from exploring this solution region. Hence, while the algorithm handles the non-convergent model issue, should the simulations be noted to fail to converge either at an appreciable rate or in regions of the search space where the suspected location of the optimal value, a more robust model code should be used. This will alleviate the risk of not locating the true globally optimal solution. This study design necessarily used the modeling system used by the other teams in spite of the 10.7% model simulation failure rate.
Breakdown of the capital and O&M costs of RIP, SME, MGO and PBMO designs
RIP existing design
MGO optimal strategy
PBMO optimal strategy
Capital costs of new wells (C CW )
Capital costs of new infiltration basins (C CB )
Fixed costs of labor (F CL )
Fixed costs of electricity (F CE )
Variable costs of electricity for operating wells (V CE )
Variable costs of changing GAC units (V CG )
Variable costs of sampling (V CS )
Objective function value
Examining the performance comparisons of the algorithmsb reported in the ESTCP study for the number of flow and transport simulations, PBMO found its solution using under 120 flow and transport simulations as compared to the estimated 5,000 simulations reported by the MGO investigators [see Volume II of the DoD/ESTCP report (Minsker et al., 2004)]. This is a significant improvement in efficiency, by an estimated factor of over 40. Furthermore, PBMO ran unattended, whilst MGO required numerous human interventions.
Remediation well starting position: sensitivity tests
PBMO computational performance during robustness testing
Starting locations for new wells (L,R,C)
Optimal locations (L,R,C)
Optimal cost ($K)
# Flow/transport iterations to optimal3
CPU time to optimal (min)1,2
The study demonstrates the effectiveness of an automated, cost-effective, and broadly applicable approach to groundwater remedial design. The application of the PBMO methodology to the Umatilla case study site represents a rigorous testing and validation exercise. This numerical analysis efficiently and automatically identified the best solution found by others. Extension of the approach for evaluation and optimal aquifer remediation management for different sites in different geologic settings is accomplished by using a site specific calibrated groundwater flow and transport model. The approach identified the optimal solution about 40 times faster than any of the other methods by reducing the number of time consuming flow and transport model evaluations. Comprehensive automation promotes efficiency, effectiveness and usability. Merit for reliably optimizing complicated systems is achieved through the ability to overcome the inherent non-convergence difficulties that occur when using numerical models for process simulation.
aThis approach was explicitly applied to one of the other study sites in the DoD/ESTCP study – see Section 126.96.36.199 in Volume I of Minsker et al. (2004).
bThe model files representing the optimal solution identified by MGO and SOMOS are on the web site, however, the input files to MGO or SOMOS to recreate the optimization study and generate the optimal solution are not available. Therefore, it was not possible to independently verify the reported operational performance of MGO or SOMOS. Hence, we use the reported values for the number of model runs, with MGO being the lesser number of ~5,000. To put this efficiency result in perspective, it would take nearly 5 days of clock time on a modern computer (~1.4 minutes per flow and transport simulation) to solve the problem using MGO, whereas PBMO found a somewhat better solution in less than 3 hours. In addition, the MGO solution required several stops and starts as well as other interceding actions by the investigators to reach the final answer presented in the study. PBMO required a single execution without any human intervention: the optimization process was completely automated.
Larry M Deschaine PE is a graduate of MIT (1984), the University of Connecticut (1992) and is completing his PhD work in Complex Systems at Chalmers University of Technology in Göteborg, Sweden (expected 2013). He is a Principal Engineer at HydroGeoLogic and a recognized expert in the development and application of simulation and optimization techniques to large-scale energy and environmental engineering problems. His work covers the range of surface water, ocean and groundwater characterization and simulation; remedial design and construction; monitoring optimization; detection of unexploded ordnance, and; the development of self-learning adaptive algorithms which support optimization of electric power distribution networks including grid integration of renewables. His work has received numerous awards, including a US Vice-Presidential Hammer Award, and he has written more than 100 journal articles, book chapters, and other technical documents.
János D. Pintér is a researcher and practitioner with four decades of experience in the area of systems modeling and optimization, including algorithm and software development. He holds MSc, PhD and DSc degrees in Mathematics, with specialization in the Operations Research area. He has authored and edited books including an award-winning monograph, and has written more than 200 journal articles, book chapters, and other technical documents. Dr. Pintér is an active member and officer of several professional organizations, and he serves on the editorial board of several professional journals.
Theodore P. Lillys PE is a Senior Engineer at HydroGeoLogic, Inc. with over fifteen years of experience in research and applications in groundwater modeling, optimization, statistics, and software development. He holds and MS (1997) in civil and environmental engineering specializing in subsurface hydrology, numerical methods, and mathematical optimization techniques. Mr. Lillys’ areas of expertise lie in groundwater modelling, management optimization of subsurface remedial designs and resource management, optimization of long term monitoring networks, and software development.
Branch and Bound (optimization method in LGO)
Capital Costs of New Wells
Capital Costs of New Infiltration Basins
central processing unit
U.S. Department of Defense
U.S. Environmental Protection Agency
Environmental Security Technology Certification Program
Fixed Costs of Labor
Fixed Costs of Electricity
Granular activated carbon
Globally Adaptive Random Search (optimization method in LGO)
Gallons per minute
Generalized reduced gradient (optimization method in LGO)
Lipschitz Global Optimization software package
Local random search
Micrograms per liter
Modular Groundwater Optimization
Modular Finite-Difference Ground-Water Flow ModelMS, multi start random search (optimization method in LGO)
Modular 3-D Multi-Species Transport Model
National Priorities List
Net present value
Operations and maintenance
Physics-Based Management Optimization
Part per billion
Royal Demolition Explosive
Remedy In Place
Sequential linear approximation
Sequential linear programming
Subject matter expert
Simulation/Optimization Modeling Optimization Software System
Sequential quadratic programming
Umatilla Chemical Depot
Variable Costs of Electricity for Operating Wells
Variable Costs of Changing GAC Units
Variable Costs of Sampling.
This research was conducted in concert with LD’s PhD studies in Complex Systems at Chalmers University, with financial support by HydroGeoLogic, Inc, 11107 Sunset Hills Road, Suite 400, Reston, VA 20190 (http://www.hgl.com). An animation of this case study has been prepared; see (http://www.hglsoftware.com/cleanup.cfm).
- Ahlfeld DP, Barlow PM, Mulligan AE: GWM – a ground-water management process for the US Geological Survey modular ground-water model (MODFLOW – 2000). US Geological Survey; 2005. Open-File Report 2005–1072, 124 Pages, 2005. https://water.usgs.gov/nrp/gwsoftware/mf2005_gwm/OFR2005_1072.pdf Open-File Report 2005-1072, 124 Pages, 2005.
- Deschaine LM: Cost evaluation and optimization of ground water pump and treat programs, MSCE thesis. Storrs, Connecticut: University of Connecticut; 1992.
- Deschaine LM, Ahlfeld DP, Ades MJ, O’Brien D: An optimization algorithm to minimize the life cycle cost of implementing an aquifer remediation project - theory and case history. Society for Modeling and Simulation International, Simulators International XV, Simulation Series 1998,30(3):53–58.
- Deschaine LM, Regmi S, Patel JJ, Fox TA, Ades MJ, Katyal A: Design optimization of groundwater quality management challenges using the outer approximation method, The Society for Modeling and Simulation International. Seattle, WA, USA: Advanced Simulation Technology Conference; 2001:pages 88–93. April 2001 April 2001
- Deschaine LM: Simulation and optimization of large-scale subsurface environmental impacts; investigations, remedial design and long term monitoring. Journal of Mathematical Machines and Systems, Kiev 2003,3(4):Pages 201–218.
- Deschaine LM, Pintér JD: A comparison of the outer approximation method and lipschitz global optimization on optimal groundwater quality management. Atlanta, Georgia: Presented at the INFORMS Annual Meeting Conference; 2003. October 19–22, 2003 October 19-22, 2003
- Deschaine LM, Nordin JP, Pintér JD: A computational geometric /information theoretic method to invert physics-based mec-model attributes for mec discrimination. Journal of Mathematical Machines and Systems, National Academy of Sciences of Ukraine, Kiev 2011, 2: 50–61.
- Guo X, Zhang CM, Borthwick JC: Technical Report. Water Resources Research Journal 2007,43(No. 8):WO8416–14 Pages. August. http://onlinelibrary.wiley.com/doi/10.1029/2006WR004947/abstract August.View Article
- Harbaugh AW, McDonald MG: User’s documentation for modflow-96, an update to the u.s. geological survey modular finite-difference ground-water flow model. Reston VA: U.S. Geological Survey Open-File Report 96–485; 1996:56–485.
- HydroGeoLogic, Inc. (HGL): MODFLOW-SURFACT™ Version 3.0; User’s manual and guide. VA, USA; 2012. 20190 20190
- ITRC: In-Situ Bioremediation of Chlorinated Ethene DNAPL Source Zones: Case Studies. Prepared by The Interstate Technology and Regulatory Council, Bioremediation of Dense Non-Aqueous Phase Liquids (Bio DNAPL) Team. Refer to Chapter 9 “Simulation and Optimization of Subsurface Environmental Impacts; Investigations, Remedial Design and Long Term Monitoring of BioNAPL Remediation Systems”.. 2007, 128–147. April 2007. http://www.itrcweb.org/Guidance/GetDocument?documentID=11 April 2007.
- McDonald MG, Harbaugh AW: A modular three-dimensional finite-difference groundwater flow model, Techniques of Water Resources Investigations Book 6. Washington, D.C: U.S. Geological Survey; 1988.
- Minsker B, Zhang Y, Greenwald R, Peralta R, Zheng C, Harre K, Becker D, Yeh L, Yager K: Final technical report for application of flow and transport optimization codes to ground water pumping and treat systems, Technical Report to the Environmental Security Technology Certification Program. Volumes I-III. TR-2237-ENV. California: Engineering Service Center, Port Hueneme; 2004. http://www.frtr.gov/estcp/estcp.htm
- Peralta RC: “SOMOS: Simulation/Optimization Modeling System”. User’s Manual, Software Engineering Division, Department of Biological and Irrigation Engineering. Logan, UT: Utah State University; 2004:48 Pages. April 2004. http://www.frtr.gov/estcp/source_codes.htm April 2004.
- Pintér JD: Global optimization in action. Kluwer Academic Publishers, Dordrecht Boston London, 1996. New York: Now distributed by Springer Science + Business Media; 1996.
- Pintér JD: Global optimization: software, test problems, and applications. In Handbook of Global Optimization, Volume 2. Edited by: Pardalos PM, Romeijn HE. Dordrecht: Kluwer Academic Publishers; 2002:515–569.View Article
- Pintér JD: Software development for global optimization. Edited by: Pardalos PM, Coleman TF. Providence, RI: American Mathematical Society; 2009.
- Pintér JD: LGO - A model development and solver system for global-local nonlinear optimization user’s guide. Canada: Published and distributed by Pintér Consulting Services, Inc; 2013. . First edition: June 1995; Current edition: March 2013 http://www.pinterconsulting.com . First edition: June 1995; Current edition: March 2013
- Rios M, Sahinidis N: “Derivative-free optimization: A review and comparison of software implementations”. J Glob Optim 2012. http://link.springer.com/content/pdf/10.1007%2Fs10898–012–9951-y.pdf 10.1007/s10898-012-9951-y
- Systems Simulation/Optimization Laboratory (SSOL): Simulation/Optimization Modeling System (SOMOS) Users Manual. Logan, UT: SS/OL, Biological & Irrig. Eng. USU; 2002:457.
- U.S. Army Corps of Engineers (USACE): Defense Environmental Restoration Program, Final Record of Decision, Umatilla Depot Activity Explosives Washout Lagoons Ground Water Operable Unit. 1994. June 7, 1994 June 7, 1994
- U.S. Army Corps of Engineers (USACE): Final Remedial Design Submittal, Contaminated Groundwater Remediation, Explosives Washout Lagoons, Umatilla Depot Activity, Hermiston Oregon. 1996. January 1996 January 1996
- USEPA: National strategy to expand superfund optimization practices from site assessment to site completion. 2012. (September 2012) (PDF) OSWER 9200.3–75 http://www.epa.gov/oerrpage/superfund/cleanup/postconstruction/optimize.htm (September 2012) (PDF) OSWER 9200.3-75
- Zheng C, Wang PP: MT3DMS: A modular three-dimensional multispecies transport model for simulation of advection, dispersion and chemical reactions of contaminants in groundwater systems; documentation and user’s guide, Contract Report SERDP-99–1. Vicksburg, MS: U.S. Army Engineer Research and Development Center; 1999. available at http://hydro.geo.ua.edu/mt3d available at
- Zheng C, Wang PP: MGO – A modular groundwater optimizer incorporating modflow/mt3dms, documentation and user’s guide. Draft. 2002. April 2002. http://www.frtr.gov/estcp/source_codes.htm April 2002.
- Zheng C, Wang P: “Application of flow and transport optimization codes to groundwater pump-and-treat systems: Umatilla Army Depot, OR”. Technical Report, Revised version 2/2003. Tuscaloosa, AL: University of Alabama; 2003:pp. 41. http://www.frtr.gov/estcp/demonstration_sites.htm
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.