← Resource library

Research case

Whose opinions do language models reflect? (Santurkar et al., ICML 2023)

Introduces OpinionQA to compare model responses to public-opinion questions with the views of 60 US demographic groups.

What is reported

Models were poorly aligned with the US public overall; some feedback-tuned models leaned left, and groups such as people over 65 were poorly represented.

Before you use it

Tested 2022–23 models on US data; rerun the comparison for current models and your own population.

Sources and review

Original source ↗

Source checked · Not tested by this site

Checked the source record and abstract. Results describe the reported study, not an independent replication by this site.

Evidence / source record ↗

License and reuse

No license has been recorded. Check the source’s license before reusing code, models or data.

A license note is not a license audit. Open source does not guarantee free hosting, model access or commercial reuse.

Related resources