Metrics Overview
Reliability
Status, failure type, retry count, latency, and timeout behavior.
Quality
Readability, grammar, AI tells, citations, SEO, and constraint validation.
Performance
Agent latency, total latency, token use, corpus hits, and search usage.
Usage
Template usage, style profile usage, generation volume, and success rate.
Current Instrumentation
WriterzRoom already stores several categories of reliability and quality metrics.Reliability Metrics
Generation status
Tracks whether a generation completes, fails, times out, or remains in progress.
Failure classification
Captures failure stage, failure type, exception class, and error snippets for test and diagnostic runs.
Retry behavior
Tracks retry count and circuit breaker state where applicable.
Latency tracking
Supports total latency and agent-stage latency, including planner, researcher, writer, and editor timing.
Quality Metrics
Pipeline Performance Metrics
1
Planner metrics
Tracks prompt size, planning behavior, and planner-stage latency where available.
2
Research metrics
Tracks research confidence, corpus hits, Tavily hits, and research-stage latency.
3
Writer metrics
Tracks generation time, token usage, word count, and writer-stage latency.
4
Editor metrics
Tracks readability, grammar, AI tells, constraint validation, and editor-stage latency.
5
Final content metrics
Stores SEO score, readability score, content intelligence metadata, and generation status with saved content.
Quality Gates
WriterzRoom quality tracking is not only post-generation reporting. Several checks influence whether content should proceed through the workflow.Template and Style Reliability
Template and style profile metrics help identify weak combinations.Service Level Objectives
WriterzRoom defines the following SLOs for production generation workflows. These targets apply to successful generations under normal operating conditions.
Measurement notes:
Generation success rate is calculated as completed generations divided by all non-cancelled generation attempts. Latency is measured from generation request acceptance to final content availability. API availability is measured at the
/health endpoint from Cloud Run.
Alert policies enforce the writer agent P95 and Standard tier P95 latency targets with a 5-minute evaluation window and notify via email and Slack.
SLOs reflect production targets, not contractual guarantees. Individual generation time varies by template complexity, tier, research depth, and vertical configuration.
Public Reporting Status
WriterzRoom currently tracks internal metrics across generation, content quality, usage, and test runs. Public benchmark reporting is being formalized.Until enough production usage exists, public metrics should be presented as instrumentation coverage rather than performance guarantees.
Planned Public Metrics
The following metrics are candidates for public or customer-facing reporting:Recommended Next Instrumentation
To make this page stronger over time, WriterzRoom should add or verify:Review Expectations
Related Pages
Trust Center
Review WriterzRoom security, reliability, data handling, and governance posture.
Reliability and Generation Failures
Learn how WriterzRoom handles generation failures and workflow status.
Multi-Agent Pipeline
See how generation moves through planning, research, writing, editing, formatting, SEO, and publishing.
Recommended Combinations
See how vertical, template, and style profile combinations affect generation quality.