LLM Evals Course Lesson 3: Building Automated Evaluators
Notes from lesson 3 of Hamel and Shreya's LLM evaluation course - implementing automated evaluators, building reliable LLM-as-judge systems, and avoiding common pitfalls.
Artificial intelligence
View All
Three Things I Learned About Voice Agents from Kwindla Kramer
Three thigns I learned about voice agent architecture, context limitations, and latency trade-offs.
LLM Evals Course: Lesson 2b (office hrs)
A few things from Evals Course office hrs following lesson 2 of Hamel and Shreya's LLM evaluation course.
Recent Post
Connecting Chrome DevTools to FastHTML Apps for Rapid Style Iteration
How to connect Chrome DevTools to your FastHTML applications for fast CSS and HTML debugging and iteration during development.
LLM Evals Course Lesson 3: Building Automated Evaluators
Notes from lesson 3 of Hamel and Shreya's LLM evaluation course - implementing automated evaluators, building reliable LLM-as-judge systems, and avoiding common pitfalls.
Three Things I Learned About Voice Agents from Kwindla Kramer
Three thigns I learned about voice agent architecture, context limitations, and latency trade-offs.
LLM Evals Course: Lesson 2b (office hrs)
A few things from Evals Course office hrs following lesson 2 of Hamel and Shreya's LLM evaluation course.
AI Demystified Book by Antonio Weiss
Pearson FT published AI Demystified offers a gentle introduction for business leaders who want to understand how AI might impact their field.
LLM Evals Lesson 2 Error Analysis
Notes from lesson 2 of Hamel and Shreya's LLM evaluation course - covering error analysis, open and axial coding, and systematic approaches to understanding where AI systems fail.