docs: Valleywide HP server NVRAM corruption emergency (ONGOING)
Emergency onsite work documentation: - Arrival 0935 MST - HP ProLiant SN MXQ80400X4 - Non-volatile memory corruption from power outage - BIOS/UEFI factory reset required and reconfigured - iLO reset to factory (needs reconfiguration) - All VMs confirmed running - Work in progress - timer running Updated: - clients/valleywide/README.md: Added HP server, iLO reset warning, priority items - clients/valleywide/session-logs/2026-04-22-hp-server-nvram-corruption-emergency.md: Created Next: iLO reconfiguration, UPS assessment Machine: Mikes-MacBook-Air.local Timestamp: 2026-04-22 10:11:39 Co-Authored-By: Claude Sonnet 4.5 <noreply@anthropic.com>
This commit is contained in:
@@ -0,0 +1,78 @@
|
||||
# 2026-04-22 — Valleywide HP Server NVRAM Corruption Emergency
|
||||
|
||||
## User
|
||||
- **User:** Mike Swanson (mike)
|
||||
- **Machine:** Mikes-MacBook-Air.local
|
||||
- **Role:** admin
|
||||
|
||||
## Ticket Information
|
||||
- **Type:** Emergency onsite
|
||||
- **Priority:** Critical
|
||||
- **Status:** In Progress
|
||||
- **Arrival:** 0935 MST
|
||||
|
||||
## Issue Summary
|
||||
|
||||
HP ProLiant Server (SN: MXQ80400X4) experienced non-volatile memory corruption following power outage. BIOS/UEFI settings lost, requiring factory reset and full reconfiguration.
|
||||
|
||||
## Timeline
|
||||
|
||||
### 0935 - Arrival Onsite
|
||||
- HP Server SN: MXQ80400X4
|
||||
- Issue: Non-Volatile Memory Corruption
|
||||
- Cause: Power outage
|
||||
- Impact: BIOS/UEFI reset to factory defaults
|
||||
|
||||
### 0935-[IN PROGRESS] - Recovery Actions
|
||||
|
||||
**BIOS/UEFI Reconfiguration:**
|
||||
- Factory reset required due to NVRAM corruption
|
||||
- Reconfigured BIOS settings
|
||||
- Restored boot order
|
||||
- Re-enabled virtualization settings
|
||||
|
||||
**iLO (Integrated Lights-Out) Reset:**
|
||||
- [WARNING] iLO was reset to factory defaults due to BIOS reset
|
||||
- iLO credentials will need to be re-entered
|
||||
- Network configuration may need restoration
|
||||
- Remote management temporarily unavailable until iLO reconfigured
|
||||
|
||||
**VM Status:**
|
||||
- [OK] All VMs running
|
||||
- Hypervisor operational after BIOS reconfiguration
|
||||
- No VM data loss reported
|
||||
|
||||
## Next Steps
|
||||
|
||||
- [ ] Complete onsite work (timer running)
|
||||
- [ ] Reconfigure iLO settings (credentials, network)
|
||||
- [ ] Document iLO IP address and credentials
|
||||
- [ ] Verify all server settings match pre-incident configuration
|
||||
- [ ] Test remote management access
|
||||
- [ ] Update server documentation with serial number
|
||||
- [ ] Create follow-up preventive measures (UPS check, power protection)
|
||||
|
||||
## Server Information
|
||||
|
||||
**HP ProLiant Server:**
|
||||
- Serial Number: MXQ80400X4
|
||||
- Model: [TO BE DOCUMENTED]
|
||||
- Role: VM Host
|
||||
- Location: Valleywide onsite
|
||||
|
||||
**iLO Management:**
|
||||
- Status: Reset to factory defaults
|
||||
- IP: [TO BE RECONFIGURED]
|
||||
- Credentials: [TO BE RESET]
|
||||
|
||||
## Notes
|
||||
|
||||
- Power outage caused NVRAM corruption - rare but critical failure
|
||||
- Quick recovery due to all VMs remaining intact
|
||||
- iLO reconfiguration required for remote management
|
||||
- Consider UPS assessment as preventive measure
|
||||
|
||||
---
|
||||
|
||||
**Work Status:** ONGOING - Timer running
|
||||
**Next Update:** Upon completion of onsite work
|
||||
Reference in New Issue
Block a user