Evaluation of Medical Decision-Support Systems
In general, approaches to the evaluation of medical decision-support systems are poorly conceptualized and implemented. While these systems are often justified on the basis of clinical benefit, evaluation activities focus on technical issues and in some cases influence on clinical processes. In 1994 Anderson & Aydin published 10 criteria for system assessment. These questions can be used systematically and ethically evaluate an informatics system prior to implementation:
-
Does the system work as designer?
-
Is it used as anticipated?
-
Does it produce the desired results?
-
Does it work better than the procedures it replaced?
-
Is it cost effective?
-
How well have individuals been trained to use it?
-
What are the anticipated long-term effects on how departments interact?
-
What are the long-term effects on the delivery of medical care?
-
Will the system have an impact on control in the organization?
-
To what extent do effects depend on practice settings?
So the effectiveness of a clinical decision-support system will depend on the answers of these questions; however in assessing studies of the effectiveness of medical decision-support systems, it is necessary not only to measure specific indicators, such as proportion of medication errors, but also to understand the underlying causes of those errors.




