Reporting, handling and assessing the risk of bias associated with missing participant data in systematic reviews

Objectives: To describe how systematic reviewers are reporting missing data for dichotomous outcomes, handling them in the analysis and assessing the risk of associated bias. Methods: We searched MEDLINE and the Cochrane Database of Systematic Reviews for systematic reviews of randomised trials publ...

Descripción completa

Detalles Bibliográficos
Autores: Akl, Elie A.|||0000-0002-3444-8618, Carrasco-Labra, Alonso|||0000-0003-3546-3526, Brignardello-Petersen, Romina|||0000-0002-6010-9900, Neumann, Ignacio|||0000-0001-8406-6880, Johnston, Bradley C.|||0000-0001-8872-8626, Sun, Xin, Briel, Matthias|||0000-0002-2070-5230, Busse, Jason|||0000-0002-0178-8712, Ebrahim, Shanil, Granados, Carlos E.|||0000-0002-1663-4273, Iorio, Alfonso|||0000-0002-3331-8766, Irfan, Affan B., Martínez García, Laura|||0000-0003-0126-8706, Mustafa, Reem|||0000-0002-2091-0875, Ramírez-Morera, Anggie|||0000-0003-0793-4626, Selva, Anna|||0000-0002-2754-3158, Solà Arnau, Ivan|||0000-0003-0078-3706, Juliana Sanabria, Andrea, Tikkinen, Kari A. O., Vandvik, Per Olav|||0000-0001-8958-2710, Vernooij, Robin W. M.|||0000-0001-5734-4566, Zazueta, Oscar E.|||0000-0001-5374-3906, Zhou, Qi, Guyatt, Gordon|||0000-0003-2352-5718, Alonso-Coello, Pablo|||0000-0002-8001-8504
Tipo de recurso: artículo
Fecha de publicación:2015
País:España
Institución:Universitat Autònoma de Barcelona
Repositorio:Dipòsit Digital de Documents de la UAB
Idioma:inglés
OAI Identifier:oai:ddd.uab.cat:300252
Acceso en línea:https://ddd.uab.cat/record/300252
https://dx.doi.org/urn:doi:10.1136/bmjopen-2015-009368
Access Level:acceso abierto
Palabra clave:Bias (Epidemiology)
Data Accuracy
Humans
Meta-Analysis as Topic
Research Design
Review Literature as Topic
Surveys and Questionnaires
Descripción
Sumario:Objectives: To describe how systematic reviewers are reporting missing data for dichotomous outcomes, handling them in the analysis and assessing the risk of associated bias. Methods: We searched MEDLINE and the Cochrane Database of Systematic Reviews for systematic reviews of randomised trials published in 2010, and reporting a meta-analysis of a dichotomous outcome. We randomly selected 98 Cochrane and 104 non-Cochrane systematic reviews. Teams of 2 reviewers selected eligible studies and abstracted data independently and in duplicate using standardised, piloted forms with accompanying instructions. We conducted regression analyses to explore factors associated with using complete case analysis and with judging the risk of bias associated with missing participant data. Results: Of Cochrane and non-Cochrane reviews, 47% and 7% (p<0.0001), respectively, reported on the number of participants with missing data, and 41% and 9% reported a plan for handling missing categorical data. The 2 most reported approaches for handling missing data were complete case analysis (8.5%, out of the 202 reviews) and assuming no participants with missing data had the event (4%). The use of complete case analysis was associated only with Cochrane reviews (relative to non-Cochrane: OR=7.25; 95% CI 1.58 to 33.3, p=0.01). 65% of reviews assessed risk of bias associated with missing data; this was associated with Cochrane reviews (relative to non-Cochrane: OR=6.63; 95% CI 2.50 to 17.57, p=0.0001), and the use of the Grading of Recommendations Assessment, Development and Evaluation (GRADE) methodology (OR=5.02; 95% CI 1.02 to 24.75, p=0.047). Conclusions: Though Cochrane reviews are somewhat less problematic, most Cochrane and non-Cochrane systematic reviews fail to adequately report and handle missing data, potentially resulting in misleading judgements regarding risk of bias.