azcomputerguru/claudetools
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

sync: auto-sync from GURU-5070 at 2026-06-15 09:41:53

Browse Source 
Author: Mike Swanson
Machine: GURU-5070
Timestamp: 2026-06-15 09:41:53
This commit is contained in:
Mike Swanson
2026-06-15 09:42:15 -07:00
parent 153be4abec
commit dc5c09b40b
26 changed files with 537 additions and 13 deletions
Download Patch File Download Diff File Expand all files Collapse all files

21
projects/graphifyy-eval/results.csv Normal file
View File

@@ -0,0 +1,21 @@
query,arm,ctx_tokens,grepai_or_graphify_calls,files_read,latency_s,score,notes
C1,A,8500,6,0,75,1,"described OLD timeout reaper (mig 014/043) + interrupt-on-reconnect; MISSED the comms-durability CommandAck/dedup + re-deliver + migrations 058/059 (the actual fix). query-phrasing steered to wrong mechanism"
C2,A,6000,3,2,76,2,"nailed it: fail_timed_out_commands (db/commands.rs:337) w/ acked_at/delivery_attempts gating + re-deliver via get_pending_commands (ws/mod.rs); caller=main.rs tokio task. (1 stray grep for a line number)"
C3,A,3100,2,1,63,2,"updater/mod.rs AgentUpdater full flow + rollback watchdog + guards. complete"
C4,A,1800,1,1,37,2,"SPEC-018 SYSTEM service host + session broker, capture workers as SYSTEM. complete"
D1,A,2750,1,0,23,2,"GPS Basic $19/Pro $26/Adv $39 + 4 support plans + equip pack. complete, 1 call"
D2,A,2412,1,0,33,1,"retrieved the SUPERSEDED clients/kittle-design/ April breach-check (Alexis/Ken inbox rules); MISSED the canonical June BEC/ACH-fraud event ($130K to City of Tucson/Marana prevented, IC3 filed). stale-duplicate retrieval"
D3,A,12250,4,0,74,2,"open-ended relationship query; comprehensive + well-sourced (Valley Wide confirmed; Cascades/Bardach/Barbara blocked; Kittle unconfirmed). NOTE: my rubric was inaccurate - weak gold query"
D4,A,2185,1,0,39,2,"all 7 red flags correct from MSP-Buyers-Guide-Content.md. (1 stray grep for titles)"
D5,A,2950,3,0,56,2,"wiki/clients/kittle.md canonical, superseded kittle-design.md 2026-06-09. correct. (1 stray grep)"
M1,A,7625,3,0,54,2,"beta-first + POST /api/updates/rollouts/:version/promote + .channel sidecars + dashboard promote. complete"
C1,B,,,,,,
C2,B,,,,,,
C3,B,,,,,,
C4,B,,,,,,
D1,B,,,,,,
D2,B,,,,,,
D3,B,,,,,,
D4,B,,,,,,
D5,B,,,,,,
M1,B,,,,,,
1 query arm ctx_tokens grepai_or_graphify_calls files_read latency_s score notes
2 C1 A 8500 6 0 75 1 described OLD timeout reaper (mig 014/043) + interrupt-on-reconnect; MISSED the comms-durability CommandAck/dedup + re-deliver + migrations 058/059 (the actual fix). query-phrasing steered to wrong mechanism
3 C2 A 6000 3 2 76 2 nailed it: fail_timed_out_commands (db/commands.rs:337) w/ acked_at/delivery_attempts gating + re-deliver via get_pending_commands (ws/mod.rs); caller=main.rs tokio task. (1 stray grep for a line number)
4 C3 A 3100 2 1 63 2 updater/mod.rs AgentUpdater full flow + rollback watchdog + guards. complete
5 C4 A 1800 1 1 37 2 SPEC-018 SYSTEM service host + session broker, capture workers as SYSTEM. complete
6 D1 A 2750 1 0 23 2 GPS Basic $19/Pro $26/Adv $39 + 4 support plans + equip pack. complete, 1 call
7 D2 A 2412 1 0 33 1 retrieved the SUPERSEDED clients/kittle-design/ April breach-check (Alexis/Ken inbox rules); MISSED the canonical June BEC/ACH-fraud event ($130K to City of Tucson/Marana prevented, IC3 filed). stale-duplicate retrieval
8 D3 A 12250 4 0 74 2 open-ended relationship query; comprehensive + well-sourced (Valley Wide confirmed; Cascades/Bardach/Barbara blocked; Kittle unconfirmed). NOTE: my rubric was inaccurate - weak gold query
9 D4 A 2185 1 0 39 2 all 7 red flags correct from MSP-Buyers-Guide-Content.md. (1 stray grep for titles)
10 D5 A 2950 3 0 56 2 wiki/clients/kittle.md canonical, superseded kittle-design.md 2026-06-09. correct. (1 stray grep)
11 M1 A 7625 3 0 54 2 beta-first + POST /api/updates/rollouts/:version/promote + .channel sidecars + dashboard promote. complete
12 C1 B
13 C2 B
14 C3 B
15 C4 B
16 D1 B
17 D2 B
18 D3 B
19 D4 B
20 D5 B
21 M1 B