Blog

Filtered by: Agents & Evals  × clear

5 min read

Thinking of an agent as a Colleague

I was challenged to work out what it would take to think of agents as colleagues. Taken seriously it becomes an operating model: identity, scoped access, governed onboarding context, supervision, evaluation, deprovisioning. Here's what worked when I built that, and the three places it broke.

Continue reading →
5 min read

Make Agent Evals Part of Your Observability

The first agent I worked on had evals, but they only ran in CI/CD: a pre-flight checklist with no in-flight instruments. Here is the case for live, continuous evals as part of your observability: what to measure, what a decent score looks like, and how to tune them over time.

Continue reading →