Jonathan Stray @jonathanstray.com · Jun 6 Here’s how we tested. For 20 controversial issues in US politics, we collected 200 charged questions from Reddit, and tested 8 different model/prompt combinations. 7,434 participants on all sides of these issues rated the responses. 3/
2 likes 1 replies
?
Replies
Each participant rated four Reddit question / LLM answer pairs. The questions were intentionally chosen to be leading (in both directions) and the answers were model defaults, plus the models prompted to be “for” or “against” and our experimental “balanced” response. 4/