TTFT by concurrency
Client time to first streamed token. p50 and p95, warmup excluded.
Configuration
| Field | Value |
|---|
Throughput vs concurrency
Successful requests and output tokens, divided by the measurement window.
End-to-end latency
Histogram
CDF
| Metric | N | Mean | p50 | p95 | p99 |
|---|
Errors
Measured requests only. Warmup failures are listed in the methodology panel.
| Request | Level | Prompt | Type | Message |
|---|