LLM Evals Course: Lesson 2b (office hrs)
A few things from Evals Course office hrs following lesson 2 of Hamel and Shreya's LLM evaluation course.
Error analysis
LLM Evals Lesson 2 Error Analysis
Notes from lesson 2 of Hamel and Shreya's LLM evaluation course - covering error analysis, open and axial coding, and systematic approaches to understanding where AI systems fail.
Error Analysis for Improving LLM Applications
A systematic approach to analysing and improving large language model applications through error analysis.