Ai2 releases XYBench to test whether AI assistants address underlying goals
Ai2 has released XYBench, an evaluation of whether language-model assistants help with a user's underlying goal instead of reinforcing a mistaken approach. Its reported experiments distinguish mentioning a useful solution from making that solution the focus.
SourcesHugging Face Blog
Read development