Alex and Emily put on their social scientist hats and take on the churn of research papers suggesting that LLMs could be used to replace human labor in social science research -- or even human subjects. Why these writings are essentially calls to fabricate data.
References:
PNAS: ChatGPT outperforms crowd workers for text-annotation tasks
- Beware the Hype: ChatGPT Didn't Replace Human Data Annotators
- ChatGPT Can Replace the Underpaid Workers Who Train AI, Researchers Say
Political Analysis: Out of One, Many: Using Language Models to Simulate Human Samples
Behavioral Research Methods: Can large language models help augment English psycholinguistic datasets?
Information Systems Journal: Editorial: The ethics of using generative AI for qualitative data analysis
Fresh AI Hell:
Advertising vs. reality, synthetic Willy Wonka edition
- https://x.com/AlsikkanTV/status/1762235022851948668?s=20
- https://twitter.com/CultureCrave/status/1762739767471714379
- https://twitter.com/xriskology/status/1762891492476006491?t=bNQ1AQlju36tQYxnm8BPVQ&s=19
A news outlet used an LLM to generate a story...and it falsely quoted Emily
Trump supporters target Black voters with faked AI images
You can check out future livestreams at https://twitch.tv/DAIR_Institute.
Follow us!
Emily
- Twitter: https://twitter.com/EmilyMBender
- Mastodon: https://dair-community.social/@EmilyMBender
- Bluesky: https://bsky.app/profile/emilymbender.bsky.social
Alex
- Twitter: https://twitter.com/@alexhanna
- Mastodon: https://dair-community.social/@alex
- Bluesky: https://bsky.app/profile/alexhanna.bsky.social
Music by Toby Menon.
Artwork by Naomi Pleasure-Park.
Production by Christie Taylor.
Popular Podcasts
Dateline NBC
Current and classic episodes, featuring compelling true-crime mysteries, powerful documentaries and in-depth investigations.
Stuff You Should Know
If you've ever wanted to know about champagne, satanism, the Stonewall Uprising, chaos theory, LSD, El Nino, true crime and Rosa Parks, then look no further. Josh and Chuck have you covered.
The Nikki Glaser Podcast
Every week comedian and infamous roaster Nikki Glaser provides a fun, fast-paced, and brutally honest look into current pop-culture and her own personal life.