gemini-3.1-pro-preview

Trial · n1x-openai-key-consolidation

← n1x-openai-key-consolidation
Outcome
48%29m
Reward
48.0%
Checks passed
21 / 33
Runtime
28m 35s
Harness
OpenCode
Task version
v0.2.0

Checks

CheckResultCreditWeight
core engine and unrelated capabilities are unchangedPASS100%2%
web-openai resolves its dependency setPASS100%2%
web-openai adds OpenAI SDK 7.xPASS100%2%
standalone web-openai declares one runtime keyPASS100%2%
standalone credentials remain server-onlyPASS100%2%
standalone guidance explains server-only useFAIL0%1%
infra declares the official provider constraintPASS100%2%
Terraform formats and validates when the registry is availablePASS100%2%
infra declares only the Terraform admin credentialFAIL0%2%
openai plus infra does not create web outputPASS100%1%
infra plans one app-named OpenAI projectPASS100%3%
infra plans one app-named runtime service accountPASS100%3%
runtime identity receives the API project-member rolePASS100%3%
Terraform outputs expose both managed IDsPASS100%2%
Terraform does not mint or expose runtime API keysPASS100%3%
combined secret map is correct in plugin order 1FAIL0%2%
runtime workflow works in plugin order 1PASS100%2%
combined secret map is correct in plugin order 2FAIL0%2%
runtime workflow works in plugin order 2PASS100%2%
openai does not own web-openai behaviorFAIL0%4%
plain web and infra remain isolated from OpenAIPASS100%4%
repeated apply is idempotentPASS100%3%
removing web-openai preserves infra provisioningFAIL0%2%
removing openai cleans all managed outputPASS100%2%
README documents the operator credential boundaryFAIL0%2%
downstream lint fixture covers OpenAIPASS100%1%
repository smoke regression passesPASS100%1%
repository smoke detects broken OpenAI contractsFAIL0%1%
each key consumer resolves one shared policy ownerFAIL0%8%
consolidated owners are order independentFAIL0%4%
legacy key-policy state is preservedFAIL0%20%
removing consumers preserves and cleans shared policyFAIL0%5%
projects without key consumers stay cleanPASS100%3%