Cover: Evaluating Expert System Tools

Evaluating Expert System Tools

A Framework and Methodology

Published 1987

by Jeff Rothenberg, Jody Paul, Iris Kameny, James R. Kipps, Marcy Swenson


Download eBook for Free

FormatFile SizeNotes
PDF file 2.6 MB

Use Adobe Acrobat Reader version 10 or higher for the best experience.


Purchase Print Copy

 Format Price
Add to Cart Paperback66 pages $25.00

This report summarizes the results of a study undertaken to develop criteria for evaluating and selecting tools used to build expert systems. The authors used an evaluation framework composed of five elements: (1) application characteristics, which describe the problem and the project to be undertaken; (2) tool capabilities, the capabilities that the tools support; (3) metrics, the quantitative and qualitative measures of merit for expert system tools; (4) assessment techniques, specific ways of applying metrics to tools; and (5) contexts, which describe the ways in which the evaluation criteria depend on the development phases targeted by a project. Many of the study's conclusions relate to software engineering aspects of the expert system endeavor. Robustness, reliability, portability, integrability, database access, concurrent access, performance, and user interface all appear to be increasingly important requirements for tools, as well as eventual requirements for the expert systems that will be produced with those tools. In addition, the expert system paradigm seems to have had a significant and beneficial effect on software engineering itself.

This report is part of the RAND report series. The report was a product of RAND from 1948 to 1993 that represented the principal publication documenting and transmitting RAND's major research findings and final research.

This document and trademark(s) contained herein are protected by law. This representation of RAND intellectual property is provided for noncommercial use only. Unauthorized posting of this publication online is prohibited; linking directly to this product page is encouraged. Permission is required from RAND to reproduce, or reuse in another form, any of its research documents for commercial purposes. For information on reprint and reuse permissions, please visit

RAND is a nonprofit institution that helps improve policy and decisionmaking through research and analysis. RAND's publications do not necessarily reflect the opinions of its research clients and sponsors.