Cover: On Relevance, Probabilistic Indexing and Information Retrieval

On Relevance, Probabilistic Indexing and Information Retrieval

Published in: Journal of the Association for Computing Machinery, v. 7, no. 3, July 1960, p. 216-244

Posted on 1960

by M. E. Maron, J. L. Kuhns

This paper reports on a novel technique for literature indexing and searching in a mechanized library system. The notion of relevance is taken as the key concept in the theory of information retrieval and comparative concept of relevance is explicated in the terms of the theory of probability. The resulting technique called Probabilistic Indexing, allows a computing machine, given a request for information, to make a statistical inference and derive a number (called the relevance number) for each document, which is a measure of the probability that the document will satisfy the given request. The result of a search is an ordered list of those documents which satisfy the request ranked according to their probable relevance. The paper goes on to show that whereas in a conventional library system the cross-referencing (see and see also) is based solely on the semantical closeness between index terms, statistical measures of closeness between index terms can be defined and computed. Thus, given an arbitrary request consisting of one (or many) index term(s), a machine can elaborate on it to increase the probability of selecting relevant documents that would not otherwise have been selected. Finally, the paper suggests an interpretation of the whole library problem as one where the request is considered as a clue on the basis of which the library system makes a concatenated statistical inference in order to provide as an output an ordered list of those documents which most probably satisfy the information needs of the user.

This report is part of the RAND external publication series. Many RAND studies are published in peer-reviewed scholarly journals, as chapters in commercial books, or as documents published by other organizations.

RAND is a nonprofit institution that helps improve policy and decisionmaking through research and analysis. RAND's publications do not necessarily reflect the opinions of its research clients and sponsors.