Describes the history and methodology of computer system evaluations which were examined in order to determine the best way to conduct the evaluation of PROBE, the ERIC computer retrieval search service.