Artifact Quality Standards

Required Fields

Every artifact's metadata must include:

| Field | Type | Description | |-------|------|-------------| | source | string | Data source identifier | | confidence | number (0-1) | Confidence score |

Source Identifier Format

training_data        → From model training data (lowest confidence)
estimate             → Extrapolated from known data
web_search:<domain>  → Web search result, specify the domain
government_data      → Official government data
industry_report      → Industry report
api:<service>        → API call result
cross_validated      → Cross-validated

Confidence Scoring Guide

0.9+    → Official data, multi-source validated
0.7-0.9 → Reliable source, single validation
0.5-0.7 → Web search result, not cross-validated
0.3-0.5 → Extrapolation/estimate with reasonable basis
0.1-0.3 → Training data or rough estimate

Cross-Validation

When the CEO or another agent validates an artifact, update the metadata:

bash
wanman artifact put --kind market_data --path "competitors/pricing" \
  --meta '{"source":"cross_validated","confidence":0.85,"verified":true,"verified_by":"ceo","verified_at":"2024-01-15","original_source":"web_search:dianping.com","validation_notes":"consistent with Meituan data"}'

Common Quality Issues

1. Missing source: source is empty or just says "internet"
2. Inflated confidence: Estimated data labeled 0.9+
3. Missing units: Amounts without currency, areas without units
4. Vague timing: No data collection date specified
5. Inconsistent paths: path does not follow a consistent naming convention

Path Naming Convention

costs/{category}/{item}          → Cost data
revenue/{scenario}/{period}      → Revenue forecasts
competitors/{name}/{metric}      → Competitor data
market/{segment}/{metric}        → Market data
location/{area}/{metric}         → Location data