Frontier model A

Trial · geo-multi-tag-narratives

← geo-multi-tag-narratives
Outcome
PASS25m
Reward
100.0%
Checks passed
22 / 22
Runtime
25m 2s
Harness
Cursor CLI
Task version
v3.1.2

Checks

CheckResultCreditWeight
baseline: the app serves and a prompt set's responses are searchablePASS100%1%
baseline: the reports list answers for a workspacePASS100%1%
batch returns each analyzed tag's single-tag analysis and none for the other tagsPASS100%11%
batch selects each tag's answers exactly as a run's tag filter doesPASS100%4%
batch only looks analyses up and never starts onePASS100%4%
batch finds a tag's single-tag analysis when the tag has more responses than the sample capPASS100%11%
batch honours extra prompt sets in the scopePASS100%4%
batch honours the run windowPASS100%4%
batch honours the search queryPASS100%4%
a run's citation map lists each domain's cited URLs with the responses that cite themPASS100%11%
cited URLs are stored and come back when the analysis is read by id or from the cachePASS100%8%
batch items carry their analysis's cited URLsPASS100%4%
cited URLs list exactly the analyzed responses when a run is down-sampledPASS100%4%
the reports list counts narratives across every tagPASS100%8%
a published per-tag report's page shows each tag and its analysisPASS100%8%
the analysis page shows a selected tag's analysis from the batchPASS100%4%
the analysis page runs the analysis for a selected tagPASS100%4%
the analysis page publishes a report only once every tag has an analysisPASS100%8%
preserve: a narratives run, its cache and its cache-only lookupPASS100%0%
preserve: an analysis is read and deleted by idPASS100%0%
preserve: reports are published, listed, renamed and deletedPASS100%0%
preserve: the app's pagesPASS100%0%