Ai2 releases FairStress to test fairness under pressure in LLM decisions
Ai2 introduced FairStress on 20 October to examine whether language models defend comparable decisions equally when demographic identities change. The downloadable benchmark tests matched persuasive challenges, explanations and selected internal activations alongside final choices, with integration into Olmo-eval underway.
SourcesHugging Face Blog
Read development