Preprints
https://doi.org/10.5194/egusphere-2026-5876
https://doi.org/10.5194/egusphere-2026-5876
22 Oct 2026
 | 22 Oct 2026
Status: this preprint is open for discussion and under review for Geoscience Communication (GC).

We <3 Skynet: Or, How We Learned to Stop Worrying and Love the Bot Responses in Our Survey Data

Lynda Olman, Benjamin J. Hatchett, Meghan Collins, Anne Heggli, Kathryn Lambrecht, Zach Tolby, and Dominic Charles

Abstract. A case study in methods reveals a way that false responses to online surveys can be leveraged to add rhetorical value to technical communication research. Serendipitously, we discovered during our study of community commonplaces of weather-forecast discussions that open-ended bot responses contained phrases very close to rhetorical commonplaces generated by humans. Using freely available text-mining tools, technical communication researchers can easily mine false responses for indicators of community beliefs, norms, and values. This LESSONS Report (Limitations, Errors, Surprises, Shortcomings, Opportunities for New Science) exemplifies a surprising situation that could introduce limitations or errors (if unaddressed) but instead is converted to an opportunity to increase the robustness of survey data.

Publisher's note: Copernicus Publications remains neutral with regard to jurisdictional claims made in the text, published maps, institutional affiliations, or any other geographical representation in this paper. While Copernicus Publications makes every effort to include appropriate place names, the final responsibility lies with the authors. Views expressed in the text are those of the authors and do not necessarily reflect the views of the publisher.
Share
Lynda Olman, Benjamin J. Hatchett, Meghan Collins, Anne Heggli, Kathryn Lambrecht, Zach Tolby, and Dominic Charles

Status: open (until 17 Dec 2026)

Comment types: AC – author | RC – referee | CC – community | EC – editor | CEC – chief editor | : Report abuse
Lynda Olman, Benjamin J. Hatchett, Meghan Collins, Anne Heggli, Kathryn Lambrecht, Zach Tolby, and Dominic Charles
Lynda Olman, Benjamin J. Hatchett, Meghan Collins, Anne Heggli, Kathryn Lambrecht, Zach Tolby, and Dominic Charles
Metrics will be available soon.
Latest update: 22 Oct 2026
Download
Short summary
Online surveys are valuable data sources supporting social science research. However, they are increasingly susceptible to false responses from both bots that may be difficult to discern from humans. Using free tools, we report a simple method to leverage these false responses to extract indicators of weather-related community beliefs, norms, and values. This situation could introduce errors (if unaddressed) but instead we use it as an opportunity to increase the robustness of survey data.
Share