Comparing assessment of appropriateness of diagnostic tests between a human expert and an automated reminder system.

ABSTRACT

This paper describes the validation of the GRIF automated reminder system. The reminder system has been developed to influence diagnostic test ordering of General Practitioners (GPs). It generates critical comments on the basis of accepted guidelines. A retrospective random selection of 253 request forms has been taken. We compared the comments of a human expert to the comments of the reminder system. A panel of two independent reviewers judged the requested tests based on the strict interpretation of the guidelines. The sensitivity, specificity and 'predictive values' of the comments of the reminder system and the human expert were calculated using the judgement of the two reviewers as 'gold standard'.