Scorecard Builder

Create and validate YAML scorecards. No code changes needed.

Scorecard YAML

metadata:
  name: "My Custom Scorecard"
  description: "Custom scorecard for my campaign"
  campaign_type: outbound
  model: claude-sonnet-4-6
  version: 1

scoring_weights:
  compliance: 40.0
  script_adherence: 35.0
  performance: 25.0

thresholds:
  pass_threshold: 80.0
  fail_threshold: 50.0

compliance_rules:
  - id: comp_intro
    description: "Agent identifies themselves and company"
    eval_instruction: "Check if the agent stated their name and company."
    weight: 50.0
    fail_threshold: false
    required_evidence: true

- id: comp_consent
    description: "Agent confirms they are speaking with right person"
    eval_instruction: "Check if the agent confirmed the prospect's name."
    weight: 50.0
    fail_threshold: false
    required_evidence: true

script_checkpoints:
  - id: script_open
    description: "Opening statement"
    reference_text: "Hello, this is [name] from [company]"
    flexibility: moderate
    weight: 50.0

- id: script_close
    description: "Close and next steps"
    reference_text: "Ask for the appointment or next step"
    flexibility: loose
    sequence_after: script_open
    weight: 50.0

performance_metrics:
  - id: perf_tone
    name: "Tone and Professionalism"
    eval_instruction: "Was the agent professional and friendly?"
    weight: 50.0

- id: perf_engagement
    name: "Prospect Engagement"
    eval_instruction: "Did the agent engage the prospect?"
    weight: 50.0

Campaign

Quick Reference

Flexibility: strict | moderate | loose

Weights: Must sum to 100 per section

scoring_weights: compliance + script + performance = 100

fail_threshold: true = instant fail on violation

sequence_after: ID of checkpoint that must come first