Delphi Study Information

The University of Stirling Delphi study tool is used to conduct online studies designed to allow a large number of people to reach consensus on a series of questions along a rating scale.

Delphi studies are conducted over a small number of rounds (three is usual) where participants are shown a graphical representation of the distribution of answers from the previous rounds and asked to reconsider their own answers.

The first round has rating scales that look something like this

In subsequent rounds, the same question is repeated but a heat map (which uses depth of colour to indicate frequency of response) is shown to indicate how many people chose each possible answer in the last round. Respondents are now invited to make another rating, possibly changing their mind in light of the responses from their peers.

The system automates all aspects of running the study including contacting the participants and calculating the results.

Studies

• Mass Casualties Clinical Equipment Study, Scottish Ambulance Service
• Developing meta-ethnography reporting guidelines and standards for research (eMERGE)
• Improving Conduct and reporting of Narrative Synthesis of Quantitative data (ICONS-Quant)
• Identifying and assessing different approaches to developing complex interventions (INDEX)
• Neuro-Rehabilitation Outcome Management System (NROMS)
• Developing best multidisciplinary practice for people with Motor Neurone Disease in the UK (CoMMND)
• World Health Organisation Education Strategy Consultation

Publications

• Duncan E, Colver K, Dougall N, Swingler K, Stephenson J & Abhyankar P (2014) Consensus on items and quantities of clinical equipment required to deal with a mass casualties big bang incident: a national Delphi study. BMC Emergency Medicine, 14, Art. No.: 5. link
• France, E. F., Ring, N., Noyes, J., Maxwell, M., Jepson, R., Duncan, E., Turley, R., Jones, D., & Uny, I. (2015). Protocol-developing meta-ethnography reporting guidelines (eMERGe). BMC medical research methodology, 15(1), 103. link
• O'Cathain, A., Croot, L., Duncan, E., Rousseau, N., Sworn, K., Turner, K. M., ... & Hoddinott, P. (2019). Guidance on how to develop complex interventions to improve health and healthcare. BMJ open, 9(8), link
• Duncan, E., O'Cathain, A., Rousseau, N., Croot, L., Sworn, K., Turner, K. M., ... & Hoddinott, P. (2020). Guidance for reporting intervention development studies in health research (GUIDED): an evidence-based consensus study. BMJ open, 10(4) link

Contact