AI evaluation basics
Judge AI answers: the better one, the wrong fact, the broken rule.
Chapters · 0 of 3 done
Introduction
By the end you can
- Pick the better of two AI answers and say why
- Find the one wrong fact an answer depends on
- Mark an answer down when it ignores the instruction or isn't safe
Chapters
- 1What AI raters doWhat AI companies pay raters to do4 min
- 2Spotting a wrong factHow to find the fact an answer depends on5 min
- 3Following the instruction, and staying safeWhy a correct answer can still be the worse one6 min