Motivated Metamodels

Synthesis of Cause-Effect Reasoning and Statistical Metamodeling

Paul K. Davis, James H. Bigelow

ResearchPublished 2003

A metamodel is a relatively simple model that approximates the behavior of one that is more complex. A common and superficially attractive way to develop a metamodel is to generate large-model data and use off-the-shelf statistical methods without attempting to understand the model's internal workings. This monograph describes research illuminating why it can be important to improve the quality of such metamodels by using even modest phenomenological knowledge to help structure them. These "motivated metamodels" may convey an understandable, if only approximate, story-i.e., an explanation. Further, even if they provide little or no improvements to average goodness of fit, motivated metamodels can be much better for supporting decisions. For example, if the modeled system could fail if any of several critical components fail, then motivated models can build in the requisite nonlinearity, whereas naive metamodels are misleading. Naive metamodeling may also be misleading about the relative "importance" of inputs, thereby skewing resource-allocation decisions. Motivated metamodels can greatly mitigate such problems. The work contributes to the emerging understanding of multiresolution, multiperspective modeling (MRMPM), as well as providing an interdisciplinary view of how to combine virtues of statistical methodology with virtues of more theory-based work.

Topics

Document Details

Citation

Chicago Manual of Style

Davis, Paul K. and James H. Bigelow, Motivated Metamodels: Synthesis of Cause-Effect Reasoning and Statistical Metamodeling. Santa Monica, CA: RAND Corporation, 2003. https://www.rand.org/pubs/monograph_reports/MR1570.html.
BibTeX RIS

Research conducted by

This publication is part of the RAND monograph report series. The monograph report was a product of RAND from 1993 to 2003. RAND monograph reports presented major research findings that addressed the challenges facing the public and private sectors. They included executive summaries, technical documentation, and synthesis pieces.

This document and trademark(s) contained herein are protected by law. This representation of RAND intellectual property is provided for noncommercial use only. Unauthorized posting of this publication online is prohibited; linking directly to this product page is encouraged. Permission is required from RAND to reproduce, or reuse in another form, any of its research documents for commercial purposes. For information on reprint and reuse permissions, please visit www.rand.org/pubs/permissions.

RAND is a nonprofit institution that helps improve policy and decisionmaking through research and analysis. RAND's publications do not necessarily reflect the opinions of its research clients and sponsors.

Version Note

This publication supersedes a previous version published in 2002 (MR-1570.0-AF).