Advanced Search
Daniel A. Lopez, Carlos Cardenas-Iniguez, Punitha Subramaniam, Rebekah S Huber, Shana Adise, Katherine L. Bottenhorn, Paola Badilla, Ellen Mukwekwerere, Laila Tally, Omoengheme Ahanmisi, Isabelle L. Bedichek, Serena D. Matera, Gabriela Perez-Tamayo, Nicholas Sissons, Owen Winters, Anya Harkness, Elizabeth Nakiyingi, Jennell Encizo, Zhuoran Xiang, Isabelle G. Wilson, Allison N. Smith, Anthony R. Hill, Amanda K. Adames, Elizabeth Robertson, Joseph R. Boughter, Arturo Lopez-Flores, Emma R. Skoler, Lyndsey Dorholt, Bonnie J. Nagel
doi: https://doi.org/10.1101/2024.05.30.24308222
- Abstract
- Info/History
- Metrics
- Supplementary material
- Data/Code
- Preview PDF
Abstract
BackgroundTransparency can build trust in the scientific process, but scientific findings can be undermined by poor and obscure data use and reporting practices. The purpose of this work is to report how data from the Adolescent Brain Cognitive Development (ABCD) Study has been used to date, and to provide practical recommendations on how to improve the transparency and reproducibility of findings.MethodsArticles published from 2017 to 2023 that used ABCD Study data were reviewed using more than 30 data extraction items to gather information on data use practices. Total frequencies were reported for each extraction item, along with computation of a Level of Completeness (LOC) score that represented overall endorsem*nt of extraction items. Univariate linear regression models were used to examine the correlation between LOC scores and individual extraction items. Post hoc analysis included examination of whether LOC scores were correlated with the logged 2-year journal impact factor. ResultsThere were 549 full-length articles included in the main analysis. Analytic scripts were shared in 30% of full-length articles. The number of participants excluded due to missing data was reported in 60% of articles, and information on missing data for individual variables (e.g., household income) was provided in 38% of articles. A table describing the analytic sample was included in 83% of articles. A race and/or ethnicity variable was included in 78% of reviewed articles, while its inclusion was justified in only 41% of these articles. LOC scores were highly correlated with extraction items related to examination of missing data. A bottom 10% of LOC score was significantly correlated with a lower logged journal impact factor when compared to the top 10% of LOC scores (β=-0.77, 95% -1.02, -0.51; p-value < 0.0001). ConclusionThese findings highlight opportunities for improvement in future papers using ABCD Study data to readily adapt analytic practices for better transparency and reproducibility efforts. A list of recommendations is provided to facilitate adherence in future research.
Competing Interest Statement
The authors have declared no competing interest.
Funding Statement
SA was supported by a K01 from the NIH NIDDK (K01 DK135847), The Southern California Center for Latino Health (Funded by The National Institute on Minority Health and Health Disparities, P50MD017344) and The Saban Research Institute at Children's Hospital of Los Angeles, CCI was supported by NIEHS grant T32ES013678, DL was supported by the Oregon Health & Sciences Office of Research and Innovation. KB was supported by grants R01-ES032295, R01-ES031074, and K99-MH135075. PS was supported by the ABCD grant. RH was supported by the ABCD grant. The ABCD Study is supported by the National Institutes of Health and additional federal partners under award numbers U01DA041048, U01DA050989, U01DA051016, U01DA041022, U01DA051018, U01DA051037, U01DA050987, U01DA041174, U01DA041106, U01DA041117, U01DA041028, U01DA041134, U01DA050988, U01DA051039, U01DA041156, U01DA041025, U01DA041120, U01DA051038, U01DA041148, U01DA041093, U01DA041089, U24DA041123, U24DA041147. A full list of supporters is available at https://abcdstudy.org/federal-partners.html. A listing of participating sites and a complete listing of the study investigators can be found at https://abcdstudy.org/consortium_members/. ABCD consortium investigators designed and implemented the study and/or provided data but did not necessarily participate in the analysis or writing of this report. This manuscript reflects the views of the authors and may not reflect the opinions or views of the NIH or ABCD consortium investigators.
Author Declarations
I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.
Yes
I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.
Yes
I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).
Yes
I have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.
Yes
Data Availability
All data produced are available online at https://osf.io/qkefw/ and github.com/Daniel-Adan-Lopez/ABCD_Transparency_Reproducibility
https://github.com/Daniel-Adan-Lopez/ABCD_Transparency_Reproducibility
Copyright
The copyright holder for this preprint is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC-ND 4.0 International license.
Back to top
PreviousNext
PostedMay 31, 2024.
Download PDF
Supplementary Material
Data/Code
Citation Tools
- Facebook Like
- Google Plus One
Subject Areas
All Articles
Addiction Medicine (325)
Allergy and Immunology (635)
Anesthesia (169)
Cardiovascular Medicine (2420)
Dentistry and Oral Medicine (292)
Dermatology (208)
Emergency Medicine (382)
Endocrinology (including Diabetes Mellitus and Metabolic Disease) (857)
Epidemiology (11842)
Forensic Medicine (10)
Gastroenterology (705)
Genetic and Genomic Medicine (3800)
Geriatric Medicine (353)
Health Economics (642)
Health Informatics (2429)
Health Policy (943)
Health Systems and Quality Improvement (911)
Hematology (344)
HIV/AIDS (796)
Infectious Diseases (except HIV/AIDS) (13376)
Intensive Care and Critical Care Medicine (771)
Medical Education (373)
Medical Ethics (105)
Nephrology (404)
Neurology (3551)
Nursing (201)
Nutrition (531)
Obstetrics and Gynecology (686)
Occupational and Environmental Health (671)
Oncology (1845)
Ophthalmology (541)
Orthopedics (224)
Otolaryngology (288)
Pain Medicine (234)
Palliative Medicine (68)
Pathology (452)
Pediatrics (1046)
Pharmacology and Therapeutics (430)
Primary Care Research (425)
Psychiatry and Clinical Psychology (3217)
Public and Global Health (6216)
Radiology and Imaging (1303)
Rehabilitation Medicine and Physical Therapy (756)
Respiratory Medicine (839)
Rheumatology (381)
Sexual and Reproductive Health (377)
Sports Medicine (328)
Surgery (409)
Toxicology (51)
Transplantation (174)
Urology (148)
