Methods for Authenticating Participants in Fully Web-Based Mobile App Trials from the iReach Project: Cross-sectional Study

• Authors: Jodie Guest, Emory University; Elizabeth Adam, Emory University; Iaah L Lucas, Emory University; Cristian J Chandler, Emory University; Rebecca Filipowicz, Emory University; Nicole Luisi, Emory University; Laura Gravens, Emory University; Kingsley Leung, Emory University; Tanaka Chavanduka, University of Michigan; Erin E Bonar, University of Michigan; Jose A Bauermeister, University of Pennsylvania; Rob Stephenson, University of Michigan, Ann Arbor; Patrick Sullivan, Emory University
• Journal Title: JMIR MHEALTH AND UHEALTH
• Volume: Volume 9, Number 8
• Publisher: JMIR PUBLICATIONS, INC | 2021-08-01, Pages e28232-e28232
• Type of Work: Article | Final Publisher PDF
• Publisher DOI: http://doi.org/10.2196/28232
• Subjects: Health Sciences, Epidemiology
• Keywords: Science & Technology; Life Sciences & Biomedicine; Health Care Sciences & Services; Medical Informatics; HIV; mHealth; recruitment; fraud; adolescent MSM; prevention; MSM; RCT; enrollment; data authentication; data quality; methods; participants; PREVENTION; RECRUITMENT; ONLINE; MEN; SEX

Abstract

Background: Mobile health apps are important interventions that increase the scale and reach of prevention services, including HIV testing and prevention counseling, pre-exposure prophylaxis, condom distribution, and education, of which all are required to decrease HIV incidence rates. The use of these web-based apps as well as fully web-based intervention trials can be challenged by the need to remove fraudulent or duplicate entries and authenticate unique trial participants before randomization to protect the integrity of the sample and trial results. It is critical to ensure that the data collected through this modality are valid and reliable. Objective: The aim of this study is to discuss the electronic and manual authentication strategies for the iReach randomized controlled trial that were used to monitor and prevent fraudulent enrollment. Methods: IReach is a randomized controlled trial that focused on same-sex attracted, cisgender males (people assigned male at birth who identify as men) aged 13-18 years in the United States and on enrolling people of color and those in rural communities. The data were evaluated by identifying possible duplications in enrollment, identifying potentially fraudulent or ineligible participants through inconsistencies in the data collected at screening and survey data, and reviewing baseline completion times to avoid enrolling bots and those who did not complete the baseline questionnaire. Electronic systems flagged questionable enrollment. Additional manual reviews included the verification of age, IP addresses, email addresses, social media accounts, and completion times for surveys. Results: The electronic and manual strategies, including the integration of social media profiles, resulted in the identification and prevention of 624 cases of potential fraudulent, duplicative, or ineligible enrollment. A total of 79% (493/624) of the potentially fraudulent or ineligible cases were identified through electronic strategies, thereby reducing the burden of manual authentication for most cases. A case study with a scenario, resolution, and authentication strategy response was included. Conclusions: As web-based trials are becoming more common, methods for handling suspicious enrollments that compromise data quality have become increasingly important for inclusion in protocols.