Computer Performance Analysis: Controlled Testing.
This report describes the procedures for selectively limiting the activities of a computer system to discover and verify its execution characteristics. Analysts first define their objectives for a performance analysis and determine the probable cost-effectiveness of the effort. They next formulate specific hypotheses that will be tested to accomplish the objectives. The initial design for testing the hypotheses includes a highly specific documentation of assumptions and variables as well as a detailed operational procedure. A short pilot test is executed to determine the design's adequacy. Only then can analysts execute the entire test and analyze results. Of special concern to analysts are (1) the degree of control to be employed in the test, (2) simulation characteristics that ensure that the system reacts so that pertinent hypotheses can be tested, (3) integrated data collection and analysis, and (4) a cost-benefit analysis for evaluating the effort. 91 pp. Bibliog.