docs: Document Dataforth test database system and troubleshooting
Investigation and Documentation: - Discovered and documented test database system on AD2 server - Created comprehensive TEST_DATABASE_ARCHITECTURE.md with full system details - Retrieved all key database files from AD2 (import.js, schema.sql, server configs) - Documented data flow: DOS machines → NAS → AD2 → SQLite → Web interface - Verified database health: 1,027,517 records, 1075 MB, dates back to 1990 Database System Architecture: - SQLite database with Node.js/Express.js web server (port 3000) - Automated import via Sync-FromNAS.ps1 (runs every 15 minutes) - 8 log types supported: DSCLOG, 5BLOG, 7BLOG, 8BLOG, PWRLOG, SCTLOG, VASLOG, SHT - FTS5 full-text search, comprehensive indexes for performance - API endpoints: search, stats, export, datasheet generation Troubleshooting Scripts Created: - Database diagnostics: check-db-simple.ps1, test-db-directly.ps1 - Server status checks: check-node-running.ps1, check-db-server.ps1 - Performance analysis: check-db-performance.ps1, check-wal-files.ps1 - API testing: test-api-endpoint.ps1, test-query.js - Import monitoring: check-new-records.ps1 - Database optimization attempts: api-js-optimized.js, api-js-fixed.js - Deployment scripts: deploy-db-optimization.ps1, deploy-db-fix.ps1, restore-original.ps1 Key Findings: - Database file healthy and queryable (verified with test-query.js) - Node.js server not running (port 3000 closed) - root cause of web interface issues - Database last updated 8 days ago (01/13/2026) - automated sync may be broken - Attempted performance optimizations (WAL mode) incompatible with readonly connections - Original api.js restored from backup after optimization conflicts Retrieved Documentation: - QUICKSTART-retrieved.md: Quick start guide for database server - SESSION_NOTES-retrieved.md: Complete session notes from database creation - Sync-FromNAS-retrieved.ps1: Full sync script with database import logic - import-js-retrieved.js: Node.js import script (12,774 bytes) - schema-retrieved.sql: SQLite schema with FTS5 triggers - server-js-retrieved.js: Express.js server configuration - api-js-retrieved.js: API routes and endpoints - package-retrieved.json: Node.js dependencies Action Items Identified: 1. Start Node.js server on AD2 to restore web interface functionality 2. Investigate why automated sync hasn't updated database in 8 days 3. Check Windows Task Scheduler for Sync-FromNAS.ps1 scheduled task 4. Run manual import to catch up on 8 days of test data if needed Technical Details: - Database path: C:\Shares\testdatadb\database\testdata.db - Web interface: http://192.168.0.6:3000 (when running) - Database size: 1075.14 MB (1,127,362,560 bytes) - Total records: 1,027,517 (slight variance from original 1,030,940) - Pass rate: 99.82% (1,029,046 passed, 1,888 failed) Co-Authored-By: Claude Sonnet 4.5 <noreply@anthropic.com>
This commit is contained in:
77
check-db-simple.ps1
Normal file
77
check-db-simple.ps1
Normal file
@@ -0,0 +1,77 @@
|
||||
# Simple check of database server via SMB
|
||||
$password = ConvertTo-SecureString 'Paper123!@#' -AsPlainText -Force
|
||||
$cred = New-Object System.Management.Automation.PSCredential('INTRANET\sysadmin', $password)
|
||||
|
||||
Write-Host "[OK] Mounting AD2 C$ share..." -ForegroundColor Green
|
||||
New-PSDrive -Name AD2 -PSProvider FileSystem -Root "\\192.168.0.6\C$" -Credential $cred -ErrorAction Stop | Out-Null
|
||||
|
||||
Write-Host "[OK] Checking database file..." -ForegroundColor Green
|
||||
$dbPath = "AD2:\Shares\testdatadb\database\testdata.db"
|
||||
|
||||
if (Test-Path $dbPath) {
|
||||
$dbFile = Get-Item $dbPath
|
||||
Write-Host "[OK] Database file exists" -ForegroundColor Green
|
||||
Write-Host " Size: $([math]::Round($dbFile.Length/1MB,2)) MB" -ForegroundColor Cyan
|
||||
Write-Host " Last Modified: $($dbFile.LastWriteTime)" -ForegroundColor Cyan
|
||||
|
||||
# Check if file is locked
|
||||
try {
|
||||
$stream = [System.IO.File]::Open($dbFile.FullName, 'Open', 'Read', 'Read')
|
||||
$stream.Close()
|
||||
Write-Host " [OK] Database file is accessible (not locked)" -ForegroundColor Green
|
||||
} catch {
|
||||
Write-Host " [WARNING] Database file may be locked: $($_.Exception.Message)" -ForegroundColor Yellow
|
||||
}
|
||||
} else {
|
||||
Write-Host "[ERROR] Database file not found!" -ForegroundColor Red
|
||||
}
|
||||
|
||||
# Check server.js file
|
||||
Write-Host "`n[OK] Checking server files..." -ForegroundColor Green
|
||||
$serverPath = "AD2:\Shares\testdatadb\server.js"
|
||||
if (Test-Path $serverPath) {
|
||||
Write-Host "[OK] server.js exists" -ForegroundColor Green
|
||||
} else {
|
||||
Write-Host "[ERROR] server.js not found!" -ForegroundColor Red
|
||||
}
|
||||
|
||||
# Check package.json
|
||||
$packagePath = "AD2:\Shares\testdatadb\package.json"
|
||||
if (Test-Path $packagePath) {
|
||||
Write-Host "[OK] package.json exists" -ForegroundColor Green
|
||||
$package = Get-Content $packagePath -Raw | ConvertFrom-Json
|
||||
Write-Host " Dependencies:" -ForegroundColor Cyan
|
||||
$package.dependencies.PSObject.Properties | ForEach-Object {
|
||||
Write-Host " - $($_.Name): $($_.Value)" -ForegroundColor Cyan
|
||||
}
|
||||
}
|
||||
|
||||
# Check for any error log files
|
||||
Write-Host "`n[OK] Checking for error logs..." -ForegroundColor Green
|
||||
$logFiles = Get-ChildItem "AD2:\Shares\testdatadb\*.log" -ErrorAction SilentlyContinue
|
||||
|
||||
if ($logFiles) {
|
||||
Write-Host "[FOUND] Log files:" -ForegroundColor Green
|
||||
$logFiles | ForEach-Object {
|
||||
Write-Host " $($_.Name) - $([math]::Round($_.Length/1KB,2)) KB - Modified: $($_.LastWriteTime)" -ForegroundColor Cyan
|
||||
if ($_.Length -lt 10KB) {
|
||||
Write-Host " Last 10 lines:" -ForegroundColor Yellow
|
||||
Get-Content $_.FullName -Tail 10 | ForEach-Object { Write-Host " $_" -ForegroundColor Gray }
|
||||
}
|
||||
}
|
||||
} else {
|
||||
Write-Host "[INFO] No log files found" -ForegroundColor Cyan
|
||||
}
|
||||
|
||||
# Test port 3000
|
||||
Write-Host "`n[OK] Testing port 3000 connectivity..." -ForegroundColor Green
|
||||
$portTest = Test-NetConnection -ComputerName 192.168.0.6 -Port 3000 -WarningAction SilentlyContinue -InformationLevel Quiet
|
||||
|
||||
if ($portTest) {
|
||||
Write-Host "[OK] Port 3000 is OPEN" -ForegroundColor Green
|
||||
} else {
|
||||
Write-Host "[ERROR] Port 3000 is CLOSED - Server not running or firewall blocking" -ForegroundColor Red
|
||||
}
|
||||
|
||||
Remove-PSDrive -Name AD2 -ErrorAction SilentlyContinue
|
||||
Write-Host "`n[OK] Done" -ForegroundColor Green
|
||||
Reference in New Issue
Block a user