One Agent, Three Frameworks: What Agent Framework, LangGraph and ADK Do When the Model Misbehaves

The same agent built with Microsoft Agent Framework, LangGraph and Google ADK twice, sharing two tools and talking to one scripted stand-in model

The same agent and the same two tools built with Microsoft Agent Framework, LangGraph and Google ADK, run against a scripted model that calls missing tools, sends wrong types, repeats a refund and never stops. The defaults differ, and a few lines of configuration bring them into line.

Read more →

Evaluating Agent Performance: Metrics and Testing Strategies

Evaluating agent performance is harder than evaluating models. After developing evaluation frameworks for 10+ agent systems, I’ve learned what metrics matter and how to test effectively. Here’s the complete guide to evaluating agent performance. Figure 1: Agent Evaluation Metrics Framework Why Agent Evaluation is Different Agent evaluation is more complex than model evaluation: Multi-step reasoning: […]

Read more →