Evaluating the implementation of audio abstracts for scientific journal dissemination: a mixed-methods study

Problem

Effective knowledge translation underpins evidence-based medicine, improving healthcare quality, and equipping professionals with up-to-date knowledge. Scientific journals increasingly utilise audio-based content to disseminate research, driven by awareness of their responsibility to communicate findings and translate new research into policy and practice. This is particularly important given an estimated 17-year knowledge translation delay, reflecting a significant evidence-to-practice deficit. Consequently, BJGP Open implemented an ‘audio abstract’ (AA) programme (short audio recordings of articles) to enhance readership engagement and dissemination.

While studies have reported audio-content development, many are limited to process explanations and descriptive studies. In particular, there is a lack of qualitative research examining the experiences of research authors and journal readers with audio content. The aim of this study is to evaluate the implementation of audio abstracts within the BJGP Open journal.

Approach

A mixed-methods study combining multiple data collection methods (1) questionnaire (2) interviews (3) analysis of readership figures. An adaptation of the Consolidated Framework for Implementation Research guides the evaluation of the AA programme’s implementation and effectiveness.

The questionnaire collects opinions of BJGPO readers and authors on familiarity with the AA programme, acceptability, comparison with more traditional methods of journal usage, and impact on dissemination. Interviews with authors and the journal publishing team provides insight into the programme’s initial objectives, and the successes and challenges of implementation. Readership metrics data measures the level of engagement viewers had with AAs vs ‘control’ articles from a variety of article usage, Twitter and video statistics.

Triangulation of data sources using constant-comparative analysis will identify similarities and differences in data to produce a rich evaluation of AA project implementation.

Findings

Questionnaire and interview data collection is underway alongside analysis of readership metrics. The questionnaire has been widely distributed through the BJGPO social media channel, newsletter and emailed to 100 authors recently published at the journal. Thirty-six individuals (comprising authors, editors and publishing team) have been invited to interview. Preliminary readership metrics analysis of twenty AA supported articles versus twenty ‘control’ articles has shown increased engagement with the AA articles (AA abstracts were accessed a total of 1451 times, with 2640 Twitter impressions; control abstracts were accessed 999 times, with 1496 Twitter impressions).

Consequences

This is a novel research area with a robust evaluation framework. The findings will provide evidence for other journals seeking to incorporate audio-based content in dissemination strategies. Results will also highlight areas of programme improvement at BJGP Open to inform future evolution of audio abstracts. Broader implications involve the continued development of research dissemination strategies to shorten the acknowledged prolonged knowledge translation gap.