Frontier model A

Trial · metric-spotlight-restatement-dedupe

← metric-spotlight-restatement-dedupe
Outcome
FAIL10m
Reward
0.0%
Checks passed
18 / 22
Runtime
10m 5s
Harness
Cursor CLI
Task version
v3.0.5

Checks

CheckResultCreditWeight
baseline: the Metric Spotlight page serves its dashboard definitionPASS100%1%
baseline: a Metric Spotlight graph answers through the graph data routePASS100%1%
box scores: All Companies ARR counts each company's latest figure once, and MoM from the samePASS100%11%
box scores: YoY compares the latest month with the same month last year, both at their latest figuresPASS100%11%
box scores: each selected company's latest ARR, MoM and YoYPASS100%9%
trend: monthly ARR for All Companies and for a selected companyPASS100%9%
rate-of-change trend: monthly rates for All Companies and for a selected companyPASS100%8%
trend: the top-performer benchmark is drawn from latest figuresPASS100%8%
XmR: values, centre line, limits and moving ranges come from latest figuresPASS100%8%
rate XmR: rates, centre line, limits and moving ranges come from latest figuresPASS100%7%
company league: each company's latest ARR, month-over-month change and rankPASS100%11%
operating-unit league: each unit's latest ARR, month-over-month change and rankPASS100%11%
an averaged metric (gross margin) reads latest figures tooPASS100%7%
preserve: the Metric Spotlight trends and their benchmark (POST /api/dashboards/graph-data)FAIL0%0%
preserve: the Metric Spotlight box scores (POST /api/dashboards/graph-data)FAIL0%0%
preserve: the Metric Spotlight XmR charts (POST /api/dashboards/graph-data)FAIL0%0%
preserve: the Metric Spotlight league tables (POST /api/dashboards/graph-data)FAIL0%0%
preserve: the Metric Spotlight definition, its metric and company options, and the graph data route's refusalsPASS100%0%
preserve: the Growth & Retention graphs and company options (POST /api/dashboards/graph-data, param-options)PASS100%0%
preserve: the Profitable Sales graphs and company options (POST /api/dashboards/graph-data, param-options)PASS100%0%
preserve: the Compound Lift graphs and company options (POST /api/dashboards/graph-data, param-options)PASS100%0%
preserve: the metric catalog (GET /api/metrics/catalog)PASS100%0%