FeM e.V. Infrastructure and System Status

All systems are operational.

Last updated 1 week ago

Affected components

2 weeks ago 2026-08-13 10:00 UTC
Fixed
Affected Components: VM-Hosts, Mastodon, Matrix and Storage systems

Fixed

2 weeks ago 2026-08-17 15:27 UTC

The storage server is back online too. This incident has been resolved.

Watching

2 weeks ago 2026-08-17 12:52 UTC

After replacing the HBA card in our VM host, the VMs are booting up. We are monitoring the situation.

The problem of the affected storage server is currently being investigated.

Identified

2 weeks ago 2026-08-14 00:00 UTC

After further investigation, we found two servers, which are malfunctioning since the UPS died (probably caused by voltage fluctuations).

The hardware RAID card in one of our VM hosts has died. This renders most vm boot images unaccessible. A replacement card was already ordered and will be installed in the next days.

In addition, one of our storage systems shows some strange behavoirs amd fails to boot. We are investigating this issue.

Investigating

2 weeks ago 2026-08-13 12:22 UTC

We have found that one of our VM storage pools is missing.

We are investigating the cause and if there has been any dataloss.

Reported

2 weeks ago 2026-08-13 10:00 UTC

We are seeing some issues with multiple servers after the power outage in house E. We are investigating.