Two Clocks, One Library: Evaluating Agents Before and Long After You Publish
Most teams evaluate an agent once, the week it launches. Here is the two clock model, a release gate and a surveillance loop, both drawing on one versioned case library.
Expert perspectives on data engineering, AI/ML, cloud architecture, and digital transformation. Practical knowledge to help you build better solutions.
Latest insights and thought leadership
Leveraging deep technical expertise to solve complex business challenges
Design and build scalable data pipelines, warehouses, and lakes that power your analytics.
Implement machine learning models and AI-powered automation for your business processes.
Architect and migrate to cloud-native solutions on AWS, Azure, or GCP.
Guide your organization through technology-driven business transformation.
Stay current with the latest thinking
Most teams evaluate an agent once, the week it launches. Here is the two clock model, a release gate and a surveillance loop, both drawing on one versioned case library.
An agent whose work a human must redo to trust has saved nothing. How to design outputs that are cheap to check, and move from blanket review to earned autonomy.
ISO/IEC 42001, the EU AI Act and AIUC-1 converge on the same eight controls. Build one control plane, let the runtime emit the evidence, and render it three ways.
Cost per token is a procurement metric. Cost per successful outcome is the one that matters. How to attribute agent spend, fix retry loops, and cut cost per outcome by half.
A practical, agent-driven blueprint for reverse engineering BMC Remedy and migrating workflows, forms, CMDB, and integrations into ServiceNow — without freezing the business for two years.
A crystal-clear, beginner-friendly guide to building an evaluation framework for AI agents — covering the four complementary eval approaches, an agentic eval pipeline, the agent types you can test, tooling across open source, Anthropic, OpenAI, Azure, GCP, and AWS, and a turnkey rollout plan with checklists and templates.
Join the newsletter and get expert insights delivered directly to your inbox. No spam, just valuable content.
We typically reply within a few hours