Min Qi Wang, PhD; Alice F. Yan, MD, PhD; Ralph V. Katz, DMD, MPH, PhD
Grant Support: By grant 1 ORIIR160027-01-00 from the Office of Research Integrity of the U.S. Department of Health and Human Services.
Disclosures: Disclosures can be viewed at www.acponline.org/authors/icmje/ConflictOfInterestForms.do?msNum=M18-1230.
Corresponding Author: Ralph V. Katz, DMD, MPH, PhD, Department of Epidemiology and Health Promotion, New York University College of Dentistry, 433 1st Avenue, Room 706, New York, NY 10010; e-mail, firstname.lastname@example.org.
Current Author Addresses: Dr. Wang: University of Maryland School of Public Health, 2387 School of Public Health Building, College Park, MD 20742.
Dr. Yan: 1660 North Prospect Avenue, Unit 505, Milwaukee, WI 53202.
Dr. Katz: Department of Epidemiology and Health Promotion, New York University College of Dentistry, 433 1st Avenue, Room 706, New York, NY 10010.
Author Contributions: Conception and design: M.Q. Wang, A.F. Yan, R.V. Katz.
Analysis and interpretation of the data: M.Q. Wang, A.F. Yan, R.V. Katz.
Drafting of the article: M.Q. Wang, R.V. Katz.
Critical revision for important intellectual content: M.Q. Wang, A.F. Yan, R.V. Katz.
Final approval of the article: M.Q. Wang, A.F. Yan, R.V. Katz.
Provision of study materials or patients: M.Q. Wang.
Statistical expertise: M.Q. Wang, A.F. Yan.
Obtaining of funding: M.Q. Wang.
Administrative, technical, or logistic support: M.Q. Wang, A.F. Yan.
Collection and assembly of data: M.Q. Wang, A.F. Yan.
Inappropriate analysis and reporting of biomedical research remain a problem despite advances in statistical methods and efforts to educate researchers.
To determine the frequency and severity of requests biostatisticians receive from researchers for inappropriate analysis and reporting of data during statistical consultations.
A randomly drawn sample of 522 American Statistical Association members self-identifying as consulting biostatisticians.
The Bioethical Issues in Biostatistical Consulting Questionnaire soliciting reports about the frequency and perceived severity of specific requests for inappropriate analysis and reporting.
Of 522 consulting biostatisticians contacted, 390 provided sufficient responses: a completion rate of 74.7%. The 4 most frequently reported inappropriate requests rated as “most severe” by at least 20% of the respondents were, in order of frequency, removing or altering some data records to better support the research hypothesis; interpreting the statistical findings on the basis of expectation, not actual results; not reporting the presence of key missing data that might bias the results; and ignoring violations of assumptions that would change results from positive to negative. These requests were reported most often by younger biostatisticians.
The survey provides information on the reported frequency of inappropriate requests but not on how such requests were handled or whether the requests reflected researchers' maleficence or inadequate knowledge about statistical and research methods. In addition, other inappropriate requests may have been made that were not prespecified in the survey.
This survey suggests that researchers frequently make inappropriate requests of their biostatistical consultants regarding the analysis and reporting of their data. Understanding the reasons for these requests and how they are handled requires further study.
U.S. Department of Health and Human Services.
Wang MQ, Yan AF, Katz RV. Researcher Requests for Inappropriate Analysis and Reporting: A U.S. Survey of Consulting Biostatisticians. Ann Intern Med. 2018;169:554–558. [Epub ahead of print 9 October 2018]. doi: https://doi.org/10.7326/M18-1230
Download citation file:
Published: Ann Intern Med. 2018;169(8):554-558.
Published at www.annals.org on 9 October 2018
Copyright © 2020 American College of Physicians. All Rights Reserved.
Print ISSN: 0003-4819 | Online ISSN: 1539-3704
Conditions of Use