Research methods

Research is critical to ensure that suicide prevention is effective in preventing suicide, reducing distress and improving wellbeing.

While knowing how effective an intervention is at preventing suicide is essential, it is equally important to understand how interventions can be implemented sucessfully across different settings and communities.

How well an intervention is implemented will also impact its effectiveness. Even if an intervention has worked well before, it might not work the same in a different context or setting.

Factors like resources, funding, the complexity of interventions, competing priorities, people’s needs, and equity considerations all impact how well an intervention is implemented and, ultimately, how well it works.

Effective interventions may be poorly implemented, and interventions with limited evidence may be well-resourced and widely implemented.

What is implementation research?

Implementation research aims to understand how and why interventions work in real-world settings and what can be done to improve them1.

Implementation research outcomes differ from clinical or effectiveness outcomes, which might include quality of life, distress, morbidity, and mortality. Proctor et al.2 defines eight distinct outcomes in implementation research:

  1. Acceptability – An individual’s perception that an intervention is agreeable or satisfactory.
  2. Adoption – The intention, decision or action to try or implement an intervention.
  3. Appropriateness – How well the intervention ‘fits’ a setting, provider or person.
  4. Cost – How much does the intervention cost to deliver?
  5. Feasibility – How successfully an intervention can be implemented in a setting.
  6. Fidelity – If an intervention is implemented as described in the original plans.
  7. Penetration – How well an intervention is integrated into the setting and its subsystems.
  8. Sustainability – How an intervention is maintained within a setting or system.

Considerations in suicide prevention

There are some considerations for implementation research in suicide prevention.3

  1. Co-design with people with lived experience of suicide is vital.

    All suicide prevention activities, including implementation research, need to be supported by lived experience. Evidence not being supported by lived experience is often considered a leading barrier to applying evidence in policy and practice.

    Learn more about the role of lived experience in implementation.
  2. Suicide prevention interventions (and settings) can be complex.

    The more moving parts an intervention has, the more important it is to consider implementation research methods. Implementation research can embrace this complexity by exploring how and why interventions do or do not work.

    View Skivington et al.’s (2021) framework for developing and evaluating complex interventions.

How are studies designed?

Researchers take different steps to make sure the results of their study are accurate. This might involve strategies such as:

  • Having a control group who do not receive an intervention
  • Randomly assigning people to groups
  • Account for factors that could also impact the results (for example, age or gender)
  • Following strict, standardised procedures.

These strategies help to improve the internal validity of a study, meaning researchers can be more confident that the intervention rather than other factors cause a change in an outcome.

Though, strict experimental conditions can make it harder to know if the same results would be seen in the real world. This concept is known as external validity.

Different study designs impact the internal and external validity of the research. Common designs used in implementation research includes:

  • Experimental designs

Experimental designs involve researchers changing one variable to see how it affects another while controlling other variables that could also impact the outcome.

A common example of an experimental design is a randomised controlled trial. Due to their strict experimental conditions, randomised controlled trials are the gold standard in research. However, they are time-intensive and may not always be feasible. Types of implementation trials are described in the section below.

Designing and undertaking randomised implementation trials: guide for researchers

  • Quasi-experimental designs

Quasi-experimental designs are a type of experimental study where participants are not randomised into groups. They attempt to establish causation in other ways, such as measuring a variable before and after an intervention.

These studies are often less expensive and time-consuming but lack internal validity and cannot show an intervention caused an outcome.

Selecting and Improving Quasi-Experimental Designs in Effectiveness and Implementation Research

  • Qualitative and mixed methods
Qualitative research involves collecting and analysing non-numerical data to understand concepts, beliefs or experiences. Mixed-method approaches include a combination of quantitative and qualitative methods.

Qualitative and Mixed Methods Research in Dissemination and Implementation Science: Introduction to the Special Issue

Researching implementation and effectiveness outcomes

Similar to how randomised controlled trials provide a high standard of evidence towards the effectiveness of interventions, randomised implementation trials can provide a high standard assessment of implementation strategies.

Trials can assess implementation outcomes alone or alongside intervention effectiveness. Hybrid effectiveness-implementation designs allow us to examine intervention effectiveness and implementation outcomes simultaneously.

There are three types of hybrid designs:

Notes

1

Peters DH, Adam T, Alonge O, Agyepong IA, Tran N. Implementation research: what it is and how to do it. BMJ. 2013;347. doi:10.1136/bmj.f6753

2

Proctor E, Silmere H, Raghavan R, Hovmand P, Aarons G, Bunger A, Griffey R, Hensley M. Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Adm Policy Ment Health. 2011 Mar;38(2):65-76. doi: 10.1007/s10488-010-0319-7

3

Reifels L, Krishnamoorthy S, Kõlves K, Francis J. Implementation Science in Suicide Prevention. Crisis. 2022;43(1):1–7. doi:10.1027/0227-5910/a000846.