Please use this identifier to cite or link to this item:
http://bura.brunel.ac.uk/handle/2438/20966
Title: | Delivering Behaviour Change Interventions: Development of a Mode of Delivery Ontology |
Authors: | Marques, MM Carey, RN Norris, E Evans, F Finnerty, AN Hastings, J Jenkins, E Johnston, M West, R Michie, S |
Keywords: | ontology;intervention;behaviour, reporting;expert feedback;evidence synthesis;delivery |
Issue Date: | 26-Feb-2021 |
Publisher: | F1000 Research on behalf of Wellcome |
Citation: | Marques M.M. et al. (2021) 'Delivering Behaviour Change Interventions: Development of a Mode of Delivery Ontology [version 2; peer review: 2 approved]', Wellcome Open Research, 5, 125, pp. 1 - 27. doi: 10.12688/wellcomeopenres.15906.2. |
Abstract: | Background: Investigating and improving the effects of behaviour change interventions requires detailed and consistent specification of all aspects of interventions. An important feature of interventions is the way in which these are delivered, i.e. their mode of delivery. This paper describes an ontology for specifying the mode of delivery of interventions, which forms part of the Behaviour Change Intervention Ontology, currently being developed in the Wellcome Trust funded Human Behaviour-Change Project. Methods: The Mode of Delivery Ontology was developed in an iterative process of annotating behaviour change interventions evaluation reports, and consulting with expert stakeholders. It consisted of seven steps: 1) annotation of 110 intervention reports to develop a preliminary classification of modes of delivery; 2) open review from international experts (n=25); 3) second round of annotations with 55 reports to test inter-rater reliability and identify limitations; 4) second round of expert review feedback (n=16); 5) final round of testing of the refined ontology by two annotators familiar and two annotators unfamiliar with the ontology; 6) specification of ontological relationships between entities; and 7) transformation into a machine-readable format using the Web Ontology Language (OWL) and publishing online. Results: The resulting ontology is a four-level hierarchical structure comprising 65 unique modes of delivery, organised by 15 upper-level classes: Informational, Environmental change, Somatic, Somatic alteration, Individual-based/ Pair-based /Group-based, Uni-directional/Interactional, Synchronous/ Asynchronous, Push/ Pull, Gamification, Arts feature. Relationships between entities consist of is_a. Inter-rater reliability of the Mode of Delivery Ontology for annotating intervention evaluation reports was a=0.80 (very good) for those familiar with the ontology and a= 0.58 (acceptable) for those unfamiliar with it. Conclusion: The ontology can be used for both annotating and writing behaviour change intervention evaluation reports in a consistent and coherent manner, thereby improving evidence comparison, synthesis, replication, and implementation of effective interventions. |
Description: | First Version Published: 10 Jun 2020, 5:125 (https://doi.org/10.12688/wellcomeopenres.15906.1).
Latest Version Published: 26 Feb 2021, 5:125 (https://doi.org/10.12688/wellcomeopenres.15906.2). Data availability: Underlying data The BCIO is available from: https://github.com/HumanBehaviourChangeProject/ontologies. Archived ontology as at time of publication: https://doi.org/10.5281/zenodo.3824323 (Norris et al., 2021). License: CC-BY 4.0. Extended data: Open Science Framework: Human Behaviour-Change Project. https://doi.org/10.17605/OSF.IO/UXWDB (West et al., 2020). This project contains the following extended data related to this method: Copy of feedback form (PDF) Papers used in HBCP annotations (PDF) Description of the preliminary version of the MoD Ontology (PDF) Step 1 - Inter-Rater Reliability of the preliminary version of the Mode of Delivery Ontology (PDF) Feedback Report feedback and corresponding changes made to the Ontology (PDF) Step 3 - Inter-Rater Reliability of the preliminary version of the Mode of Delivery Ontology (PDF) General guidance for Mode of Delivery Ontology (PDF) Data are available under the terms of the Creative Commons Attribution 4.0 International license (CC-BY 4.0). Code used to calculate alpha for IRR: https://github.com/HumanBehaviourChangeProject/Automation-InterRater-Reliability. Archived code as at time of publication: https://doi.org/10.5281/zenodo.3833816 (Finnerty & Moore, 2020). License: GNU General Public License v3.0 |
URI: | https://bura.brunel.ac.uk/handle/2438/20966 |
DOI: | https://doi.org/10.12688/wellcomeopenres.15906.2 |
Other Identifiers: | ORCID iD: Marta M. Marques https://orcid.org/0000-0002-4797-9557 ORCID iD: Emma Norris https://orcid.org/0000-0002-9957-4025 ORCID iD: Ailbhe N. Finnerty https://orcid.org/0000-0003-2355-4332 ORCID iD: Janna Hastings https://orcid.org/0000-0002-3469-4923 ORCID iD: Ella Jenkins https://orcid.org/0000-0002-2884-0226 ORCID iD: Marie Johnston https://orcid.org/0000-0003-0124-4827 ORCID iD: Robert West https://orcid.org/0000-0002-4797-9557 ORCID iD: Susan Michie https://orcid.org/0000-0003-0063-6378 125 |
Appears in Collections: | Dept of Health Sciences Research Papers |
Files in This Item:
File | Description | Size | Format | |
---|---|---|---|---|
FullText.pdf | Copyright: © 2021 Marques MM et al. This is an open access work distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. | 902.63 kB | Adobe PDF | View/Open |
This item is licensed under a Creative Commons License