FeM e.V. Infrastructure and System Status

All systems are operational.

Last updated 2 months ago

Affected components

2 months ago 2026-08-13 10:00 UTC
Fixed
Affected Components: VM-Hosts, Mastodon, Matrix and Storage systems

Fixed

2 months ago 2026-08-17 15:27 UTC

The storage server is back online too. This incident has been resolved.

Watching

2 months ago 2026-08-17 12:52 UTC

After replacing the HBA card in our VM host, the VMs are booting up. We are monitoring the situation.

The problem of the affected storage server is currently being investigated.

Identified

2 months ago 2026-08-14 00:00 UTC

After further investigation, we found two servers, which are malfunctioning since the UPS died (probably caused by voltage fluctuations).

The hardware RAID card in one of our VM hosts has died. This renders most vm boot images unaccessible. A replacement card was already ordered and will be installed in the next days.

In addition, one of our storage systems shows some strange behavoirs amd fails to boot. We are investigating this issue.

Investigating

2 months ago 2026-08-13 12:22 UTC

We have found that one of our VM storage pools is missing.

We are investigating the cause and if there has been any dataloss.

Reported

2 months ago 2026-08-13 10:00 UTC

We are seeing some issues with multiple servers after the power outage in house E. We are investigating.