Discrete choice experiment to determine preferences of decision-makers in healthcare for different formats of rapid reviews

Abstract

Background

Time-saving formats of evidence syntheses have been developed to fulfill healthcare policymakers’ demands for timely evidence-based information. A discrete choice experiment (DCE) with decision-makers and people involved in the preparation of evidence syntheses was undertaken to elicit preferences for methodological shortcuts in the conduct of abbreviated reviews.

Methods

D-efficient scenarios, each containing 14 pairwise comparisons, were designed for the DCE: the development of an evidence synthesis in 20 working days (scenario 1) and 12 months (scenario 2), respectively. Six attributes (number of databases, number of reviewers during screening, publication period, number of reviewers during data extraction, full-text analysis, types of HTA domains) with 2 to 3 levels each were defined. These were presented to the target population in an online survey. The relative importance of the individual attributes was determined using logistic regression models.

Results

Scenario 1 was completed by 36 participants and scenario 2 by 26 participants. The linearity assumption was confirmed by the full model. In both scenarios, the linear difference model showed a preference for higher levels for “number of reviewers during data extraction”, followed by “number of reviewers during screening” and “full-text analysis”. Subgroup analyses showed that preferences were influenced by participation in the preparation of evidence syntheses.

Conclusion

The surveyed persons expressed preferences for quality standards in the process of literature screening and data extraction.