FreeWorkflowMedium riskv0.9.1

agent-observability-reviewer

Find missing traces, weak evaluations, and operational blind spots in agent systems.

Reviews agent observability: traces, tool calls, eval hooks, cost/latency signals, and incident readiness.

AI Engineering #observability #tracing #agents #ops

Browse topics and task labels

Prompt or reference Build Edit Redesign Critique Design Review Text

Publisher: skillforge/ai-engineering
Source: Kairaxis manifest
Category: AI Engineering

Package validated
Creator reviewed

Overview

Who it is for: Platform teams operating multi-step agents in production.
Not intended for: Generic APM setup with no agent-specific workflows.
Export formats: codex_skill, markdown_export

Sandbox comparison

Generic baseline vs agent-observability-reviewer on the same input, pinned to v0.9.1.

Sample input

gpt-4.1-mini · temp 0.2

Agent has request logs but no tool-call spans or cost attribution.

Generic baseline

42/100

Add more logging and a dashboard.

Skill-enhanced

89/100

Gaps: no tool spans, no token/cost labels, no eval sampling, no failure taxonomy.
Plan: structured traces per step, redaction policy, cost dimensions, weekly eval slice, on-call runbook links.

Rubric

+47 lift

Coverage of failure modes2 5

Actionable recommendations3 5

Measurable next steps2 4

Risk / limitation awareness2 4

Assumptions

Sample input is representative of a real production task
Same model and temperature for baseline and skill-enhanced runs

Runs on registry sample cases through the shared, deterministic sandbox engine.

Usage

01Review the quality signals, limitations, and permissions on this page.
02Inspect upstream content and license before loading a package.
03Apply relevant guidance within your requested scope and verify the result.
04Agents can also read the machine-readable contract at /api/v1/skills/agent-observability-reviewer/manifest.

npx skills add skillforge/ai-engineering --skill agent-observability-reviewer

Example prompts

Requests that put this skill to work.

Review our agent tracing plan before launch
Identify observability gaps in this tool-calling workflow

Limitations

Cannot access private telemetry unless provided in the sandbox input.

Version history

v0.9.1CurrentJun 25, 2026
Beta reviewer pack

At a glance

Installs: 22.1K
8-week activity: 9.8K
Evaluation: Registry example only
Last updated: Jun 25, 2026
Version: 0.9.1

Evidence

Source metadata and registry examples. Content and outcome quality require review.

Package validated
Benchmark tested
Taste calibrated
Creator reviewed

Permissions

Read filesNot needed
Write filesNot needed
Web accessNot needed
API accessNot needed
MCP accessNot needed
Code executionNot needed
External actionsNot needed

Environment fit

Runtime compatibility has not been verified.

Resources

Own this skill?

It is listed under skillforge/ai-engineering. Claim it to manage the listing after review.

False claims may result in permanent bans. Ownership transfer is never automatic.

agent-observability-reviewer

Find missing traces, weak evaluations, and operational blind spots in agent systems.

Reviews agent observability: traces, tool calls, eval hooks, cost/latency signals, and incident readiness.

Publisher

skillforge/ai-engineering

Source

Kairaxis manifest

Overview

Generic baseline

Skill-enhanced

Rubric

Assumptions

Usage

Example prompts

Limitations

Version history

Related workflows and skills

rag-evaluation-checklist

prompt-regression-tester

find-skills

Overview

Generic baseline

Skill-enhanced

Rubric

Assumptions

Usage

Example prompts

Limitations

Version history

Related workflows and skills

rag-evaluation-checklist

prompt-regression-tester

find-skills