u/improvedataquality

My takeaways from survey fraud conversations
▲ 9 r/socialscience+1 crossposts

My takeaways from survey fraud conversations

I recently reached out for guidance on webinar topics related to survey fraud, and I received an overwhelming response from both academic and market researchers. Here is the original post: https://www.reddit.com/r/Marketresearch/comments/1rr27st/comment/o9wrwsl/

A few things really stood out, but one in particular was how often fraud is treated as a single, uniform issue. In reality, it takes many different forms, and each one creates different risks for your data.

I put together a short video that walks through the different types of fraud and how they show up in surveys. You can access the video here: https://www.youtube.com/watch?v=4w5bbl4ZGYI&t=17s

I am hoping to keep this conversation going with the community, and I am planning to put together a webinar in the near future. I will share more details as that comes together.

u/improvedataquality — 20 days ago

Possible webinar on AI survey fraud. What questions should it cover?

I am an academic researcher studying survey fraud in online research, particularly how AI agents and bots complete surveys and how effective existing detection methods (e.g., attention checks, open-ended questions) are at identifying them.

As part of this work, I have been running experiments using AI agents such as Manus, Claude, and Google Mariner, as well as AI-enabled browsers like OpenAI Atlas and Perplexity Comet. The goal is to understand how AI systems behave in surveys compared to humans and to develop better ways to detect AI-generated responses.

There seems to be growing concern about AI agents completing surveys and contaminating research data, especially in online panels and crowdsourced samples.

I am considering hosting a webinar (time permitting) to share findings and practical implications for researchers, including:

  1. How well common detection methods work against AI
  2. Behavioral differences between human respondents and AI agents
  3. Emerging risks from AI-powered browsing agents
  4. Potential new detection strategies

Questions for you: Would there be interest in a webinar on this topic? If so, what questions or topics would you most want covered?

reddit.com
u/improvedataquality — 1 month ago