Ready to supercharge your AI agents?

Install any skill in seconds. Free to start, no credit card required.

langsmith-tracing · a5c-ai | DecimalAI

ai mlby a5c-ai

langsmith-tracing

a5c-ai/langsmith-tracing

Source a5c-ai/babysitter ↗License MIT

LangSmith tracing and debugging setup for LLM applications. Configure observability, capture traces, and enable debugging for LangChain/LangGraph agents.

SkillScore50Maintained

Automatic

AI Engineer pack

Last verified 8/1/2026

What it changes

Passed 11 of 22 test cases with the skill, and 2 of 22 without it.

Without skill9%

With skill50%

Checks it passed that the model alone missed

Includes AG-SAF-004 agent-evaluator.
Marks projectName with required: true.
Includes AG-OPS-004 observability-engineer.

and 15 more in the full report

9 fixed2 passed either way11 still failing0 broke

Pass-rate lift: +41 pp
Tokens: +26%
Agent turns: 0%
Response time: -48%

Model gemini-3.6-flashMeasured 8/1/2026v111 of 22 cases passed with skill

Tokens, turns and time describe resource use, not a dollar price.

Use this skill

Save it into your project's skills folder. Claude Code picks it up in its next session.

curl -fsSL --create-dirs -o .claude/skills/a5c-ai-langsmith-tracing/SKILL.md https://app.decimal.ai/s/a5c-ai-langsmith-tracing/SKILL.md

Want it pinned and updatable? pip install "decimalai>=0.15", then decimalai skills add a5c-ai-langsmith-tracing, and start Claude Code with claude --plugin-dir "$(git rev-parse --show-toplevel)/.agents"

1 · One-time — install the CLI (docs ↗)

pip install "decimalai>=0.15"

2 · Get the skill — writes .agents/skills/a5c-ai-langsmith-tracing/ and pins it in .decimal/skills.lock

decimalai skills add a5c-ai-langsmith-tracing

No CLI? Get the same file — curl · raw file

curl -fsSL --create-dirs -o .claude/skills/a5c-ai-langsmith-tracing/SKILL.md https://app.decimal.ai/s/a5c-ai-langsmith-tracing/SKILL.md

Raw file: /s/a5c-ai-langsmith-tracing/SKILL.md ↗ · machine-readable summary at /s/a5c-ai-langsmith-tracing.json ↗

Safety checks: 3 of 3 passed

Code scan CleanIntent PassedContent Clean

See it in action

One of 9 test cases the skill fixed. Same model, same prompt, with and without the skill.

1 of 9

Prompt

In the babysitter process task definition for setting up observability, how is the projectName input property marked regarding whether callers must supply it?

What was checked, without and with the skill
Checked	Without skill	With skill
Marks projectName with required: true.	Missed	Passed

case-18 · gemini-3.6-flash · 8/1/2026 · answers are capped and redacted

What's inside

The instructions your model reads when the skill loads.

SKILL.md165 linessingle file

langsmith-tracing

Configure LangSmith observability and tracing for LLM applications built with LangChain and LangGraph frameworks.

Overview

LangSmith is the managed observability suite by LangChain that provides:

Dashboards and alerting for LLM applications
Human-in-the-loop evaluation capabilities
Deep LangChain/LangGraph integration
Run Tree model for nested traces
MCP connectivity to Claude, VSCode

Capabilities

Core Tracing Setup

Initialize LangSmith client and API configuration
Configure project/workspace settings
Set up trace collection and sampling
Enable debug logging for agent execution

Integration Patterns

LangChain chain tracing with automatic instrumentation
LangGraph workflow state tracking
Custom span creation for non-LangChain code
Parent-child trace relationships

Debugging Features

Fetch execution traces for analysis
Query run history and metadata
Export traces for offline analysis
Compare runs across different versions

Usage

Environment Setup

# Set required environment variables
export LANGCHAIN_TRACING_V2=true

Track record

Benchmark

11 / 22

test cases passed, vs 2 / 22 without

Adoption

Users: 0
Times used: 0

Safety and source details

SkillSafety

✓ 3 of 3 passed

Code scan15 of 15 checks clean

0 critical · 0 warning · 0 info — scanner v4 — 7/31/2026

View 15 scanner checks

live_secretremote_code_executionreverse_shelldata_exfiltrationssrf_metadataagent_snoopinganti_refusaldestructive_commandsobfuscated_unicodeunicode_homoglyphopaque_blobsuspicious_urltool_overreachtrigger_abuseprompt_injection_phrasing

IntentSafe

LLM judge · does the skill do what it claims

ContentClean

LLM judge · policy & harmful-content review

Source

Imported

a5c-ai / babysitter

library/specializations/ai-agents-conversational/skills/langsmith-tracing/SKILL.md

View on GitHub ↗

License MITImported 7/31/2026Version v1

More skills from the same source and nearby in the registry, with their headline benchmark lift.

Ready to supercharge your AI agents?

See it in action

What's inside

langsmith-tracing

Overview

Capabilities

Core Tracing Setup

Integration Patterns

Debugging Features

Usage

Environment Setup

Track record

Benchmark

Adoption

SkillSafety

Source

Related skills