1.7 KiB
1.7 KiB
| 1 | query | arm | ctx_tokens | grepai_or_graphify_calls | files_read | latency_s | score | notes |
|---|---|---|---|---|---|---|---|---|
| 2 | C1 | A | 8500 | 6 | 0 | 75 | 1 | described OLD timeout reaper (mig 014/043) + interrupt-on-reconnect; MISSED the comms-durability CommandAck/dedup + re-deliver + migrations 058/059 (the actual fix). query-phrasing steered to wrong mechanism |
| 3 | C2 | A | 6000 | 3 | 2 | 76 | 2 | nailed it: fail_timed_out_commands (db/commands.rs:337) w/ acked_at/delivery_attempts gating + re-deliver via get_pending_commands (ws/mod.rs); caller=main.rs tokio task. (1 stray grep for a line number) |
| 4 | C3 | A | 3100 | 2 | 1 | 63 | 2 | updater/mod.rs AgentUpdater full flow + rollback watchdog + guards. complete |
| 5 | C4 | A | 1800 | 1 | 1 | 37 | 2 | SPEC-018 SYSTEM service host + session broker, capture workers as SYSTEM. complete |
| 6 | D1 | A | 2750 | 1 | 0 | 23 | 2 | GPS Basic $19/Pro $26/Adv $39 + 4 support plans + equip pack. complete, 1 call |
| 7 | D2 | A | 2412 | 1 | 0 | 33 | 1 | retrieved the SUPERSEDED clients/kittle-design/ April breach-check (Alexis/Ken inbox rules); MISSED the canonical June BEC/ACH-fraud event ($130K to City of Tucson/Marana prevented, IC3 filed). stale-duplicate retrieval |
| 8 | D3 | A | 12250 | 4 | 0 | 74 | 2 | open-ended relationship query; comprehensive + well-sourced (Valley Wide confirmed; Cascades/Bardach/Barbara blocked; Kittle unconfirmed). NOTE: my rubric was inaccurate - weak gold query |
| 9 | D4 | A | 2185 | 1 | 0 | 39 | 2 | all 7 red flags correct from MSP-Buyers-Guide-Content.md. (1 stray grep for titles) |
| 10 | D5 | A | 2950 | 3 | 0 | 56 | 2 | wiki/clients/kittle.md canonical, superseded kittle-design.md 2026-06-09. correct. (1 stray grep) |
| 11 | M1 | A | 7625 | 3 | 0 | 54 | 2 | beta-first + POST /api/updates/rollouts/:version/promote + .channel sidecars + dashboard promote. complete |
| 12 | C1 | B | ||||||
| 13 | C2 | B | ||||||
| 14 | C3 | B | ||||||
| 15 | C4 | B | ||||||
| 16 | D1 | B | ||||||
| 17 | D2 | B | ||||||
| 18 | D3 | B | ||||||
| 19 | D4 | B | ||||||
| 20 | D5 | B | ||||||
| 21 | M1 | B |