azcomputerguru/claudetools
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

sync: auto-sync from DESKTOP-0O8A1RL at 2026-05-12 06:47:00

Browse Source 
Author: Mike Swanson
Machine: DESKTOP-0O8A1RL
Timestamp: 2026-05-12 06:47:00
This commit is contained in:
Mike Swanson
2026-05-12 06:47:00 -07:00
parent 0b4b602d46
commit b1a588d0db
6 changed files with 488 additions and 72 deletions
Download Patch File Download Diff File Expand all files Collapse all files

17
projects/dataforth-dos/PROJECT_STATE.md
View File

@@ -2,7 +2,7 @@
> READ THIS before starting work on this project.
> UPDATE THIS when you begin work (claim a lock) and when you finish (release lock + log changes).
> Last updated: 2026-04-20
> Last updated: 2026-05-12
---
@@ -19,11 +19,9 @@
## Current State
**Status:** ACTIVE / DEPLOYED
**Last Activity:** 2026-04-14
**Last Activity:** 2026-05-12
Legacy DOS hardware test pipeline for Dataforth Corporation. Node.js service (`testdatadb`) on AD2 (192.168.0.6) parses test log files from DOS-era test stations, stores 27k+ records in SQLite, and publishes datasheets to the web. As of 2026-04-12, pipeline was extended to support SCMVAS/SCMHVAS product families with a new VASLOG parser and accuracy-only datasheet template. 27,503 historical records backfilled; 434 Engineering-Tested .txt files imported. Service is production-deployed and running.
Remaining work: deploy session manager to SAGE-SQL, verify historical backfill accuracy for edge cases, continue any new product family extensions.
Pipeline is healthy and fully operational. testdatadb service running on AD2 (PostgreSQL backend, 469K records, 458K on website). Daily scheduled task (`DataforthTestDatasheetUploader`) runs at 02:30 AM and ran clean this morning (16 created, 9 updated, 0 errors). Email notification code deployed — blocked on M365 SMTP AUTH configuration (AJ must enable "Authenticated SMTP" for sysadmin@dataforth.com in Exchange Admin Center, or create an Entra app with Mail.Send). See CONTEXT.md for details.
---
@@ -54,10 +52,10 @@ bash D:/vault/scripts/vault.sh get-field clients/dataforth/ad1.sops.yaml credent
## Pending / Next Up
- [ ] Deploy session manager to SAGE-SQL
- [ ] SCMVAS/SCMHVAS pipeline further extension (if new families identified)
- [ ] Verify 27,503 historical records backfill accuracy (438 plain-decimal edge cases patched 2026-04-12)
- [ ] **BLOCKER (email):** AJ enable "Authenticated SMTP" for sysadmin@dataforth.com in Exchange Admin Center (https://admin.exchange.microsoft.com → Mailboxes → sysadmin → Manage mail flow settings → Authenticated SMTP). Once done, re-run test email to confirm, then add jlehman@dataforth.com to TO list in notify.js and run-pipeline.ps1.
- [ ] After email confirmed working: add John Lehman (jlehman@dataforth.com) to notify.js `TO` constant and run-pipeline.ps1 `SendEmail -To` list. Redeploy both.
- [ ] Clean vault entry: ad2.sops.yaml has stale backslash in password (remove `\` escape)
- [ ] Clean up diagnostic scripts from C:\Shares\testdatadb\database\ (all underscore-prefixed files from 2026-04-15 session)
---
@@ -65,6 +63,9 @@ bash D:/vault/scripts/vault.sh get-field clients/dataforth/ad1.sops.yaml credent
| Date | By | Change | Status |
|------|-----|--------|--------|
| 2026-05-12 | Mike | Email notifications: nodemailer deployed, credentials.json SMTP creds, run-pipeline.ps1 summary email, TEST-DATASHEET-PROCESS.md docs, CONTEXT.md updated | DEPLOYED (blocked on M365 SMTP AUTH) |
| 2026-04-22 | Mike | Modifications to import.js, notify.js, upload-to-api.js (undocumented session) | DEPLOYED |
| 2026-04-15 | Mike | DB dedup (2.89M→469K), FAIL→PASS rule, For_Web eliminated, 170,984 records pushed to Hoffman, dashboard UI | DEPLOYED |
| 2026-04-12 | Mike | SCMVAS/SCMHVAS pipeline: new VASLOG parser, accuracy-only template, 27,503 records backfilled, 434 ENG txt files imported | DEPLOYED |
| 2026-04-11 | Mike | Discovery session: explored VASLOG .DAT format, hvin.dat binary structure | RESEARCH |