Tech:Maintenance/2025-06-26
Maintenance Report – June 26, 2025
Window: June 26, 2025 – 19:00 to 21:00 UTC
Affected Systems: cloud15, cloud20
Providers: FiberState LLC (upstream DC), WikiTide Foundation Technology Team
Summary
This maintenance addressed hardware and configuration issues on two compute nodes: cloud15 and cloud20.
FiberState replaced the fans in both servers after it was determined that they were originally fitted with incorrect standard-performance models. These fans were swapped for high-performance versions suitable for the thermal demands of our workloads.
Additionally, our Technology Team restored BIOS settings on cloud15 following a CMOS battery replacement performed during the June 23 maintenance. The BIOS had reset to factory defaults, and some critical settings (power profile, turbo boost) had not been reapplied at that time.
Purpose
- Replace incorrect fan models in cloud15 and cloud20 (FiberState)
- Restore BIOS settings on cloud15 after CMOS reset during June 23 maintenance (WikiTide Foundation)
Background
During the June 23 maintenance, the CMOS battery in cloud15 was replaced after failure. However, BIOS settings reverted to defaults and were not fully restored. This left the node in “Minimal Power” mode with turbo boost disabled, leading to degraded performance.
Separately, it was discovered that both cloud15 and cloud20 were using fans that did not meet our necessary requirements. These were physically replaced by FiberState with the correct high-performance models during the June 26 window.
Work Performed
By FiberState (hardware):
- Replaced standard fans in cloud15 and cloud20 with high-performance fan units
By WikiTide Foundation Technology Team (configuration):
- On cloud15:
- Restored BIOS power profile to Maximum Performance
- Re-enabled CPU Turbo Boost
- Verified settings post-reboot