@langchain-ai/langsmith-evaluator

INVOKE THIS SKILL when building evaluation pipelines for LangSmith. Covers three core components: (1) Creating Evaluators - LLM-as-Judge, custom code; (2) Defining Run Functions - how to capture outputs and trajectories from your agent; (3) Running Evaluations - locally with evaluate() or auto-run via LangSmith. Uses the langsmith CLI tool.

View in AI SkillSafe app
90 downloads
0 stars
0 demos
SKILL.md

Embed badges

Add these to your README to show the skill's verification status.

SkillSafe verified badge
Verified badge
[![SkillSafe verified badge](https://api.skillsafe.ai/v1/badge/@langchain-ai/langsmith-evaluator/verified)](https://skillsafe.ai/skill/@langchain-ai/langsmith-evaluator/)
Installs badge
Installs badge
[![Installs badge](https://api.skillsafe.ai/v1/badge/@langchain-ai/langsmith-evaluator/installs)](https://skillsafe.ai/skill/@langchain-ai/langsmith-evaluator/)
Scan badge
Scan badge
[![Scan badge](https://api.skillsafe.ai/v1/badge/@langchain-ai/langsmith-evaluator/scan)](https://skillsafe.ai/skill/@langchain-ai/langsmith-evaluator/)
Eval pass rate badge
Eval pass rate
[![Eval pass rate badge](https://api.skillsafe.ai/v1/badge/@langchain-ai/langsmith-evaluator/eval)](https://skillsafe.ai/skill/@langchain-ai/langsmith-evaluator/)