Clinical evidence vs preliminary speculation in newspaper coverage of diabetes innovations: a quantitative analysis

Abstract

OBJECTIVES: Researchers have discussed that journalistic reporting of medical developments is often characterised by exaggeration or lack of context, but additional quantitative evidence to support this claim is needed. This study introduces a quantitative approach to assessing coverage of medical innovations, by aiming at provided references to observed clinical effects. Although observed clinical effects reflect increased chances for future medical applications, it is unknown to which extent newspaper articles refer to it when spreading health information. We aimed to assess, over a 6-year period, newspaper publication characteristics of diabetes innovations, arising from all scientific areas of interest, regarding the total count and the proportion of articles that provide references to demonstrated clinical efficacy. STUDY DESIGN: Quantitative content analysis of newspaper articles covering innovative treatments for diabetes. METHODS: We performed a systematic review of newspaper articles between 2011 and 2016 printed in the largest six Dutch newspapers. By assessing in-article references, it was possible to quickly distinguish between (1) articles that referred to actual clinical efficacy demonstrated in a scientific setting and (2) articles that presented either predictions, fundamental research, preclinical research or personal experiences and recommendations. Proportion differences between scientific areas of interest were analysed using the chi-squared test. RESULTS: A total of 613 articles were categorised. Total newspaper publication frequency increased with 9.9 articles per year (P = .031). In total, 17% of the articles contained a reference to any proven clinical efficacy. Articles about human nutrition science (7%; P = .001) and (neuro)psychology (4.3%; P = .014) less frequently provided a reference to actual clinical efficacy. CONCLUSIONS: Our findings show that less than one in five newspaper articles about diabetes research contains a reference to relevant clinical effects, while the publication count is increasing. These statistics may contribute to feelings of false hope and confusion in patients.