Measuring research impact: A large cancer research funding programme in Australia

Abstract

Background Measuring research impact is of critical interest to philanthropic and government funding agencies interested in ensuring that the research they fund is both scientifically excellent, and has meaningful impact into health and other outcomes. ‘Cancer Council SA’s Beat Cancer Project’ (BCP) is a AUD $34m cancer research funding scheme which commenced in 2011. It was initiated by an Australian charity (Cancer Council SA), and supported by the South Australian Government and the state’s major Universities. Methods This study applied Bruxton and Hanney’s Payback Framework to assess research impact generated from the BCP after 3 years of funding. Data sources: (i) an audit of peer-reviewed publications from January 2011 to September 2014 from Web of Knowledge; and (ii) a self-report survey of investigators awarded BCP research funding during Years 1-3 (2011-2013). Of the 104 surveys, 92 (88%) were completed. Results The BCP performed well across all 5 categories of the Payback Framework. In terms of (i) knowledge production, 1,257 peer-reviewed publications were generated and the mean impact factor of publishing journals increased annually. There were many (ii) benefits to future research with 21 respondents (23%) reporting career advancement, and 110 higher degrees obtained or expected (including 84 PhDs). Overall, 52% of funded projects generated tools for future research. The funded research attracted substantial further income yielding a very high rate of leverage. For every AUD $1 that the cancer charity invested, the BCP gained an additional AUD $6.06. Five projects (5%) had informed each of (iii) policy and product development with an additional 31 (34%) and 35 (38%), respectively anticipating doing so. In terms of (iv) health and sector and (v) broader economic benefits, eight projects (9%) had influenced practice or behaviour of health staff and 32 (34%) would reportedly to do so in the future. Conclusions Research impact was a priority of charity and government funders and which led to a deliberate funding strategy. Emphasising research impact while maintaining rigorous, competitive processes can achieve the joint objectives of excellence in research, yielding good research impact and high rate of leverage for philanthropic and public investment, as indicated by these early results.