News Feed

Evaluating Skills

LangChain Blog · 2026-03-05 · Evals

By Robert XuRecently at LangChain we’ve been building skills to help coding agents like Codex, Claude Code, and Deep Agents CLI work with our ecosystem: namely, LangChain and LangSmith. This is...

Agent Trace Evaluation with TruLens Scorers in MLflow

MLflow Blog · 2026-03-04 · Evals

Score agent plans, tool calls, and reasoning with TruLens GPA framework through mlflow.genai.evaluate().

LangSmith CLI & Skills

LangChain Blog · 2026-03-04 · Evals

We’re releasing a CLI along with our first set of skills to give AI coding agents expertise in the LangSmith ecosystem. This includes adding tracing to agents, understanding their execution,...

LangChain Skills

LangChain Blog · 2026-03-04 · Evals

We’re releasing our first set of skills to give AI coding agents expertise in the open source LangChain ecosystem. This includes building agents with LangChain, LangGraph, and Deep Agents. On our...

Benchmark Your Way to Better RAG and Agents:Tuning Vector Search with MLflow

MLflow Blog · 2026-03-02 · Evals

High-level summary: problems, approaches, and takeways for better RAG with MLflow

Evals Skills for Coding Agents

Hamel Husain's Blog · 2026-03-02 · Evals

Evals Skills for Coding Agents

You don’t know what your agent will do until it’s in production

LangChain Blog · 2026-02-26 · Evals

You can't monitor agents like traditional software. Inputs are infinite, behavior is non-deterministic, and quality lives in the conversations themselves. This article explains what to monitor,...

Multi-turn Evaluation & Simulation: Enhancing AI Observability with MLflow for Chatbots

MLflow Blog · 2026-02-24 · Evals

MLflow 3.10 introduces multi-turn evaluation and conversation simulation so you can score entire conversations, test agent changes with reproducible scenarios, and catch failures that only surface...

Agent Observability Powers Agent Evaluation

LangChain Blog · 2026-02-22 · Evals

You can't build reliable agents without understanding how they reason, and you can't validate improvements without systematic evaluation.

monday Service + LangSmith: Building a Code-First Evaluation Strategy from Day 1

LangChain Blog · 2026-02-18 · Evals

Learn how monday Service developed an eval-driven development framework for their customer-facing service agents.

OpenEnv in Practice: Evaluating Tool-Using Agents in Real-World Environments

Hugging Face · 2026-02-12 · Evals

MemAlign: Building Better LLM Judges From Human Feedback With Scalable Memory

MLflow Blog · 2026-02-03 · Evals

Introducing MemAlign, a new framework that aligns LLMs with human feedback via a lightweight dual-memory system, achieving competitive or better quality than state-of-the-art prompt optimizers, at...

Introducing DeepEval, RAGAS, and Phoenix Judges in MLflow

MLflow Blog · 2026-01-29 · Evals

Improve your agents using MLflow's extensive, industry-leading suite of high-quality LLM judges.

Alyah ⭐️: Toward Robust Evaluation of Emirati Dialect Capabilities in Arabic LLMs

Hugging Face · 2026-01-27 · Evals

AssetOpsBench: Bridging the Gap Between AI Agent Benchmarks and Industrial Reality

Hugging Face · 2026-01-21 · Evals

Designing AI-resistant technical evaluations

Anthropic Engineering · 2026-01-21 · Evals

What we learned from three iterations of a performance engineering take-home that Claude keeps beating.

LLM Evals: Everything You Need to Know

Hamel Husain's Blog · 2026-01-15 · Evals

LLM Evals: Everything You Need to Know

Demystifying evals for AI agents

Anthropic Engineering · 2026-01-09 · Evals

The capabilities that make agents useful also make them difficult to evaluate. The strategies that work across deployments combine techniques to match the complexity of the systems they measure. \n

Rapidly Prototype and Evaluate Agents with Claude Agent SDK and MLflow

MLflow Blog · 2025-10-15 · Evals

How to quickly prototype an agent using the Claude Agent SDK then instrument and evaluate it with MLflow

Selecting The Right AI Evals Tool

Hamel Husain's Blog · 2025-10-01 · Evals

Selecting The Right AI Evals Tool

AfriMed-QA: Benchmarking large language models for global health

Google Research · 2025-09-24 · Evals

Generative AI

Democratizing AI Safety with RiskRubric.ai

Hugging Face · 2025-09-18 · Evals

Beyond Manually Crafted LLM Judges: Automate Building Domain-Specific Evaluators with MLflow

MLflow Blog · 2025-09-15 · Evals

How to easily create custom evaluators that understand the semantics of your domain and automatically align with human experts

Writing effective tools for agents — with agents

Anthropic Engineering · 2025-09-11 · Evals

Agents are only as effective as the tools we give them. We share how to write high-quality tools and evaluations, and how you can boost performance by using Claude to optimize its tools for itself.

Building and Managing an LLM-based OCR System with MLflow

MLflow Blog · 2025-08-30 · Evals

Building GenAI tools presents a unique set of challenges. As we evaluate accuracy, iterate on prompts, and enable collaboration, we often encounter bottlenecks that slow down our progress toward...

A scalable framework for evaluating health language models

Google Research · 2025-08-26 · Evals

Generative AI

Assessment-focused UIs in MLflow

MLflow Blog · 2025-08-11 · Evals

In MLflow 3.2, we introduced the concept of assessments, which are the quality evaluations and trace annotations that are crucial for understanding and improving your AI applications. With the...