Bots are getting smarter: Online survey data collection in the age of sophisticated AI
| dc.creator | Matheis, Maya | |
| dc.creator | Takahashi, Kiriko | |
| dc.creator | Richard, Sarah | |
| dc.date.accessioned | 2023-04-19T22:40:48Z | |
| dc.date.available | 2023-04-19T22:40:48Z | |
| dc.date.issued | 2023-04-14 | |
| dc.description | 2023 Symposium Caring for Data in Hawaiʻi Presentation | |
| dc.description.abstract | In early summer of 2022, our team launched an online survey using SurveyMonkey to collect data about teen health in Hawai’i for a needs assessment being conducted in collaboration with the Hawaii State Department of Health. The survey was for teens and youth with special health care needs, as well as their parents/caregivers, and aimed to collect data about needs and barriers to their healthcare. We offered an incentive of a $20 gift card for participation to reach a few hundred families within the state of Hawai’i. We used flyers with QR code and asked community partners to share via listservs and social media. Within 12 hours of sharing information with community partners, we had over 1500 survey responses. A quick look revealed that the vast majority of the responses were from bots– automated programs designed to complete online surveys offering monetary incentives. In fact, only about 50 responses of 1500 appeared to be submitted by actual humans. We quickly shut down the survey, regrouped, and did some research on survey bots, which very recently have become sophisticated enough to bypass CAPTCHA safeguards. In this presentation, we will share about our experiences in developing strategies to filter out bot responses from datasets, our audit of survey platforms and our new platform-of-choice (REDCap), pre-emptive strategies to build safeguards, and facilitate a discussion on the implications for online data collection. | |
| dc.format | Video | |
| dc.format.extent | 20 minutes | |
| dc.identifier.uri | https://hdl.handle.net/10125/104883 | |
| dc.language | eng | |
| dc.rights | http://rightsstatements.org/vocab/InC/1.0/ | |
| dc.subject | data management | |
| dc.subject | Surveys and Questionnaires | |
| dc.title | Bots are getting smarter: Online survey data collection in the age of sophisticated AI | |
| dcterms.type | MovingImage | |
| dspace.entity.type |