About

This tool was developed as part of a collaborative U.S. Bureau of Reclamation and RAND Corporation project titled Building Capacity for Addressing Climate Uncertainty in Long Term Planning and Decision Making.

The project was overseen by Kenneth Nowak (of Reclamation’s Research and Development Office) and managed by David Groves (RAND). Nidhi Kalra, Edmundo Molina-Perez, James Syme, and Chandra Garber contributed to the development of the case studies.

Funding Information

This research was funded by Reclamation’s Science and Technology program within its Research and Development Office for the purpose of curating and raising awareness within Reclamation and the water planning community of methods for decisionmaking under uncertainty and their applicability to long-term water resources planning.

Community Health and Environmental Policy Program

RAND Social and Economic Well-Being is a division of the RAND Corporation that seeks to actively improve the health and social and economic well-being of populations and communities throughout the world. This research was conducted in the Community Health and Environmental Policy Program within RAND Social and Economic Well-Being. The program focuses on such topics as infrastructure, science and technology, community design, community health promotion, migration and population dynamics, transportation, energy, and climate and the environment, as well as other policy concerns that are influenced by the natural and built environment, technology, and community organizations and institutions that affect well-being. For more information, email chep@rand.org.

References

• Alexander, Elliot A., Searching for a Robust Operation of Lake Mead, thesis, Boulder, Colo.: University of Colorado, 2018. As of February 23, 2021: https://www.colorado.edu/cadswes/node/500/attachment
• Bennett, Vivienne, The Politics of Water: Urban Protest, Gender, and Power in Monterrey, Mexico, Pittsburgh, Pa.: University of Pittsburgh Press, 1995.
• Brick, Timothy F., Jeffrey Kightlinger, and Debra C. Man, Integrated Water Resources Plan: 2010 Update, Los Angeles, Calif.: Metropolitan Water District of Southern California, Report No. 1373, October 2010. As of December 10, 2020: http://www.mwdh2o.com/WWAMaterials%20Provided%20to%20WaterDM/2010%20IRP.pdf
• Bryant, Benjamin P., “sdtoolkit: Scenario Discovery Tools to Support Robust Decision Making,” rdrr.io webpage, undated. As of December 7, 2020: https://rdrr.io/cran/sdtoolkit/
• Bryant, Benjamin P., “sdtoolkit: Scenario Discovery Tools to Support Robust Decision Making,” CRAN webpage, February 16, 2014. As of December 7, 2020: https://cran.r-project.org/web/packages/sdtoolkit/index.html
• California Department of Water Resources, “Delta Conveyance,” webpage, undated-a. As of December 11, 2020: https://water.ca.gov/deltaconveyance
• California Department of Water Resources, “Previous Updates: Update 2013,” webpage, undated-b. As of December 11, 2020: https://water.ca.gov/Programs/California-Water-Plan/Previous-Updates
• California Natural Resources Agency, California Water Action Plan, Sacramento, Calif., undated. As of January 12, 2021: https://www.waterboards.ca.gov/waterrights/water_issues/programs/instream_flows/cwap_enhancing/docs/cwap_final.pdf
• California Water Boards, “California WaterFix,” webpage, September 18, 2019. As of December 9, 2020: https://www.waterboards.ca.gov/waterrights/water_issues/programs/bay_delta/california_waterfix/
• Castro, José Esteban, “Urban Water and the Politics of Citizenship: The Case of the Mexico City Metropolitan Area During the 1980s and 1990s,” Environment and Planning A, Vol. 36, No. 2, February 2004, pp. 327–346.
• Diringer, Sarah, Heather Cooley, Matthew Heberger, Rapichan Phurisamban, Kristina Donnelly, Andrea Turner, John McKibbin, and Mary Ann Dickinson, Integrating Water Efficiency into Long-Term Demand Forecasting, Oakland, Calif.: Pacific Institute, August 2018. As of December 11, 2020: https://pacinst.org/publication/integrating-water-efficiency-into-long‐term-demand-forecasting/
• EMA Workbench, “EMA Workbench Documentation,” webpage, undated. As of December 7, 2020: https://emaworkbench.readthedocs.io/en/latest
• Flores, Lourdes, “Entierra el Bronco el acueducto Monterrey VI [The Bronco Buries the Monterrey VI Aqueduct],” el Economista, September 18, 2016. As of December 9, 2020: https://www.eleconomista.com.mx/estados/Entierra-el-Bronco-el-acueducto-Monterrey-VI-20160918-0052.html
• Fondo de Agua Metropolitano de Monterrey, homepage, undated. As of December 10, 2020: https://famm.mx/
• Friedman, Jerome H., and Nicholas I. Fisher, “Bump Hunting in High-Dimensional Data,” Statistics and Computing, Vol. 9, No. 2, 1999, pp. 123–143.
• Groves, David G., Martha Davis, Robert Wilkinson, and Robert J. Lempert, “Planning for Climate Change in the Inland Empire,” Water Resources IMPACT, Vol. 10, No. 4, July 2008, pp. 14–17.
• Groves, David G., Jordan R. Fischbach, Evan Bloom, Debra Knopman, and Ryan Keefe, Adapting to a Changing Colorado River: Making Future Water Deliveries More Reliable Through Robust Management Strategies, Santa Monica, Calif.: RAND Corporation, RR-242-BOR, 2013. As of December 7, 2020: https://www.rand.org/pubs/research_reports/RR242.html
• Groves, David G., Jordan R. Fischbach, Nidhi Kalra, Edmundo Molina-Perez, David Yates, David Purkey, Amanda Fencl, Vishal K. Mehta, Ben Wright, and Grantley Pyke, Developing Robust Strategies for Climate Change and Other Risks: A Water Utility Framework, Santa Monica, Calif.: RAND Corporation, RR-977-WRF, 2014. As of December 11, 2020: https://www.rand.org/pubs/research_reports/RR977.html
• Groves, David G., and Robert J. Lempert, “A New Analytic Method for Finding Policy-Relevant Scenarios,” Global Environmental Change, Vol. 17, No. 1, February 2007, pp. 73–85.
• Groves, David G., Robert J. Lempert, Deborah W. May, James R. Leek, and James Syme, Using High-Performance Computing to Support Water Resource Planning: A Workshop Demonstration of Real-Time Analytic Facilitation for the Colorado River Basin, Santa Monica, Calif.: RAND Corporation, CF-339-RC, 2016. As of December 7, 2020: https://www.rand.org/pubs/conf_proceedings/CF339.html
• Hadka, David, Jonathan Herman, Patrick Reed, and Klaus Keller, “An Open Source Framework for Many-Objective Robust Decision Making,” Environmental Modelling and Software, Vol. 74, December 2015, pp. 114–129.
• Intergovernmental Panel on Climate Change, Climate Change 2014: Synthesis Report—Contribution of Working Groups I, II, and III to the Fifth Assessment Report of the Intergovernmental Panel on Climate Change, Geneva, Switzerland, 2014. As of December 8, 2020: https://www.ipcc.ch/site/assets/uploads/2018/02/SYR_AR5_FINAL_full.pdf
• IPCC—See Intergovernmental Panel on Climate Change.
• Kwakkel, Jan H., “The Exploratory Modeling Workbench: An Open Source Toolkit for Exploratory Modeling, Scenario Discovery, and (Multi-Objective) Robust Decision Making,” Environmental Modelling and Software, Vol. 96, October 2017, pp. 239–250.
• Lempert, Robert J., David G. Groves, Steven W. Popper, and Steve C. Bankes, “A General, Analytic Method for Generating Robust Strategies and Narrative Scenarios,” Management Science, Vol. 52, No. 4, April 2006.
• Lempert, Robert J., Nidhi Kalra, Suzanne Peyraud, Zhimin Mao, Sinh Bach Tan, Dean Cira, and Alexander Lotsch, Ensuring Robust Flood Risk Management in Ho Chi Minh City, Washington, D.C.: World Bank, Policy Research Working Paper 6465, May 2013. As of December 7, 2020: http://documents1.worldbank.org/curated/en/749751468322130916/pdf/WPS6465.pdf
• Lempert, Robert J., Steven W. Popper, and Steven C. Bankes, Shaping the Next One Hundred Years: New Methods for Quantitative, Long-Term Policy Analysis, Santa Monica, Calif.: RAND Corporation, MR-1626-RPC, 2003. As of December 7, 2020: https://www.rand.org/pubs/monograph_reports/MR1626.html
• Lempert, Robert J., Steven W. Popper, David G. Groves, Nidhi Kalra, Jordan R. Fischbach, Steven C. Bankes, Benjamin P. Bryant, Myles T. Collins, Klaus Keller, Andrew Hackbarth, Lloyd Dixon, Tom LaTourette, Robert T. Reville, Jim W. Hall, Christophe Mijere, and David J. McInerney, Making Good Decisions Without Predictions: Robust Decision Making for Planning Under Deep Uncertainty, Santa Monica, Calif.: RAND Corporation, RB-9701, 2013. As of December 7, 2020: https://www.rand.org/pubs/research_briefs/RB9701.html
• Marchau, Vincent A. W. J., Warren E. Walker, Pieter J. T. M. Bloemen, and Steven W. Popper, eds., Decision Making Under Deep Uncertainty: From Theory to Practice, Cham, Switzerland: Springer, 2019.
• Metropolitan—See Metropolitan Water District of Southern California.
• Metropolitan Water District of Southern California, “The Plan,” webpage, undated. As of December 11, 2020: http://www.mwdwatertomorrow.com/IRP/index.html
• Metropolitan Water District of Southern California, Integrated Water Resources Plan: 2015 Update, Los Angeles, Calif., January 2016a. As of December 9, 2020: http://www.mwdh2o.com/PDF_About_Your_Water/2015%20IRP%20Update%20Report%20(web).pdf
• Metropolitan Water District of Southern California, Integrated Water Resources Plan: 2015 Update—Technical Appendices, Los Angeles, Calif., 2016b. As of December 9, 2020: http://www.mwdh2o.com/PDF_About_Your_Water/2015%20IRP%20Update%20Tech%20App%20(web).pdf
• Molina-Perez, Edmundo, David G. Groves, Steven W. Popper, Aldo I. Ramirez, Rodrigo Crespo-Elizondo, Developing a Robust Water Strategy for Monterrey, Mexico: Diversification and Adaptation for Coping with Climate, Economic, and Technological Uncertainties, Santa Monica, Calif.: RAND Corporation, RR-3017-FAMM, 2019. As of December 7, 2020: https://www.rand.org/pubs/research_reports/RR3017.html
• National Research Council, Informing Decisions in a Changing Climate, Washington, D.C.: National Academies Press, 2009.
• “OpenMORDM,” GitHub webpage, October 22, 2015. As of December 7, 2020: https://github.com/OpenMORDM/OpenMORDM
• RAND Corporation, “Assumption Based Planning,” webpage, undated. As of December 11, 2020: https://www.rand.org/topics/assumption-based-planning.html
• RAND Corporation, “Interactive Scenario Discovery Tool for Decision Making Under Deep Uncertainty (DMDU),” R Shiny tool, October 31, 2019. As of December 7, 2020: https://rand.shinyapps.io/Water-Reclamation-BOR-PRIM/
• Reclamation—See U.S. Bureau of Reclamation.
• Sisto, Nicholas P., Aldo I. Ramírez, Ismael Aguilar-Barajas, and Víctor Magaña-Rueda, “Climate Threats, Water Supply Vulnerability and the Risk of a Water Crisis in the Monterrey Metropolitan Area (Northeastern Mexico),” Physics and Chemistry of the Earth, Parts A/B/C, Vol. 91, February 2016.
• Smith, Rebecca, Joseph Kasprzyk, and Edith Zagona, “Many-Objective Analysis to Optimize Pumping and Releases in Multireservoir Water Supply Network,” Journal of Water Resources Planning and Management, Vol. 142, No. 2, February 2016.
• Tableau, “12 Great Books About Data Visualization,” webpage, undated-a. As of December 7, 2020: https://www.tableau.com/learn/articles/books-about-data-visualization
• Tableau, homepage, undated-b. As of December 8, 2020: https://www.tableau.com/
• University of Colorado Boulder, Center for Advanced Decision Support for Water and Environmental Systems, homepage, undated-a. As of December 8, 2020: https://www.colorado.edu/cadswes/
• University of Colorado Boulder, Center for Advanced Decision Support for Water and Environmental Systems, “RiverWare,” webpage, undated-b. As of December 8, 2020: https://www.colorado.edu/cadswes/creative-works/riverware
• U.S. Bureau of Reclamation, Summary Report: Central Valley Project Integrated Resource Plan, Washington, D.C., U.S. Department of the Interior, undated. As of February 23, 2021: https://www.usbr.gov/mp/ssjbasinstudy/docs/cvp-integrated-resource-plan-summv2.pdf
• U.S. Bureau of Reclamation, “The Law of the River,” webpage, March 2008. As of December 8, 2020: https://www.usbr.gov/lc/region/g1000/lawofrvr.html
• U.S. Bureau of Reclamation, Colorado River Basin Water Supply and Demand Study: Technical Report B—Water Supply Assessment, Washington, D.C.: U.S. Department of the Interior, Interim Report No. 1, June 2011. As of December 8, 2020: https://www.usbr.gov/lc/region/programs/crbstudy/Report1/TechRptB.pdf
• U.S. Bureau of Reclamation, “Pecos River Basin Study,” fact sheet, 2012a. As of December 11, 2020: https://www.usbr.gov/watersmart/bsp/docs/fy2012/FactSheet-PecosRiverBasinStudy.pdf
• U.S. Bureau of Reclamation, Colorado River Basin Water Supply and Demand Study: Study Report, Washington, D.C.: U.S. Department of the Interior, December 2012b. As of December 7, 2020: https://www.usbr.gov/lc/region/programs/crbstudy/finalreport/Study%20Report/CRBS_Study_Report_FINAL.pdf
• U.S. Bureau of Reclamation, West-Wide Climate Risk Assessment: Sacramento and San Joaquin Basins—Climate Impact Assessment, Washington, D.C., U.S. Department of the Interior, September 2014. As of February 23, 2021: https://www.usbr.gov/watersmart/baseline/docs/ssjbia/ssjbia.pdf
• U.S. Bureau of Reclamation, Sacramento and San Joaquin Rivers Basin Study: Basin Study Technical Report, Washington, D.C.: U.S. Department of the Interior, March 2016. As of December 7, 2020: https://www.usbr.gov/watersmart/bsp/docs/finalreport/sacramento-sj/Sacramento_SanJoaquin_TechnicalReport.pdf
• U.S. Bureau of Reclamation, “Lower Colorado Region: Moving Forward Effort,” webpage, December 10, 2018a. As of December 8, 2020: https://www.usbr.gov/lc/region/programs/crbstudy/MovingForward/index.html
• U.S. Bureau of Reclamation, “Lower Colorado Region: Colorado River Basin Water Supply and Demand Study,” webpage, December 13, 2018b. As of December 7, 2020: https://www.usbr.gov/lc/region/programs/crbstudy.html
• U.S. Bureau of Reclamation, “Colorado River Basin Drought Contingency Plans,” webpage, June 5, 2019. As of December 8, 2020: https://www.usbr.gov/dcp/
• U.S. Bureau of Reclamation, Draft Report: Review of the Colorado River Interim Guidelines for Lower Basin Shortages and Coordinated Operations for Lake Powell and Lake Mead, Washington, D.C.: U.S. Department of the Interior, October 2020a. As of December 8, 2020: https://www.usbr.gov/ColoradoRiverBasin/documents/7.D.Review_DraftReport_10-23-2020.pdf
• U.S. Bureau of Reclamation, “Willows Construction Office: Sacramento-San Joaquin Basin Study,” webpage, November 9, 2020b. As of December 7, 2020: https://www.usbr.gov/mp/ssjbasinstudy/index.html
• U.S. Bureau of Reclamation, “Colorado River Basin: Current Focus,” webpage, November 30, 2020c. As of December 8, 2020: https://www.usbr.gov/ColoradoRiverBasin/
• U.S. Fish and Wildlife Service, “Final Biological Opinion for the Carlsbad Project Water Operations and Water Supply Conservation, 2016–2026,” memorandum, Washington, D.C.: U.S. Department of the Interior, December 5, 2017. As of December 5, 2020: https://www.fws.gov/southwest/es/newmexico/documents/BO/2016-F-0506_Carlsbad_Project_Water_Operations_BiOp_Final.pdf
• U.S. Geological Survey, “MODFLOW and Related Programs,” webpage, undated. As of December 9, 2020: https://www.usgs.gov/mission-areas/water-resources/science/modflow-and-related-programs?qt-science_center_objects=0#qt-science_center_objects
• Water Education Foundation, “Conjunctive Use,” webpage, undated. As of December 11, 2020: https://www.watereducation.org/aquapedia/conjunctive-use
• World Climate Research Programme, “CMIP Phase 5 (CMIP5),” webpage, undated. As of January 28, 2021: https://www.wcrp-climate.org/wgcm-cmip/wgcm-cmip5