FeM e.V. Infrastructure and System Status

FeM e.V. Infrastructure and System Status

This page shows an overview of the status of infrastructure, services and systems of FeM e.V.

Please keep in mind that all helpers do this voluntarily in their free time. Therefore, there are no guarantees for any given timelines or time estimations.

If you have any questions or specific problems, feel free to send us a ticket via our helpdesk: https://helpdesk.fem.tu-ilmenau.de.

Some systems are experiencing major issues.

Last updated 1 month ago
    • Internet Uplink

      Operational
      Last updated 2026-08-23 21:59:06
    • Wireless (Aruba system)

      House B, C, D, E, H, I, K, L, N, P, Q, CJD and FeM-Office

      Operational
      Last updated 2026-07-28 17:49:29
    • Wired

      Ethernet sockets

      Operational
      Last updated 2026-01-19 23:58:28
    • Network Management

      FeM AdminDB and network services (DHCP, DNS...)

      Last updated 2026-04-23 21:48:54
    • Helpdesk

      Last updated 2026-01-30 15:05:44
    • Storage systems

      Storage systems for servers (e.g. Ceph, ha-storage)

      Operational
      Last updated 2026-01-17 14:09:13
    • Monitoring

      All monitoring systems, e.g. Icinga, Grafana, ...

      Last updated 2025-11-04 14:15:17
    • Databases

      Operational
      Last updated 2026-08-23 19:28:39
    • VM-Hosts

      Last updated 2026-08-23 19:28:40
    • Mailserver

      Mail servers, inboxes & list systems

      Operational
      Last updated 2026-01-30 15:05:22
    • Webcluster

      Last updated 2026-08-23 19:28:38
    • Mastodon

      Federated social network

      Operational
      Last updated 2026-05-10 14:39:06
    • Mattermost

      Internal Messenger

      Operational
      Last updated 2026-08-23 19:28:41
    • Pretix

      A Service to Sell Tickets and Manage Events

      Last updated 2026-08-23 19:28:42
    • Dist-Mirror

      A Mirror for some selected Linux Distributions

      Operational
      Last updated 2025-10-31 12:35:48
    • XMPP

      XMPP / Jabber Instant Messaging

      Operational
      Last updated 2026-05-05 23:21:05
    • FeMCI

      FeM Content Infrastructure

      Last updated 2026-08-23 19:28:43
    • Homepage

      Our homepage

      Last updated 2026-05-22 15:00:39
    • Matrix

      Federated Instant Messaging

      Operational
      Last updated 2026-08-23 19:28:44

Past incidents

—
2 days ago 2026-10-21 07:00 UTC
Identified
Affected Components: Network Management, Webcluster, Pretix, FeMCI, Homepage, Monitoring and Helpdesk

Identified

13 hours ago 2026-10-22 17:47 UTC

Our membership management system is back online. Our Nextcloud infrastructure is still awaiting an update.

Identified

19 hours ago 2026-10-22 12:07 UTC

Our Helpdesk is back online, while the patch of the membership management is currently being tested.

Identified

19 hours ago 2026-10-22 11:44 UTC

The updates on our web cluster has been mostly deployed. The webcluster ist starting up again.

Note that all applications using a PHP version older than PHP 8.2 will not be enabled again. You are required to upgrade your PHP version.

We are still monitoring the situation and applying patches in our Nextcloud infrastructure.

Identified

21 hours ago 2026-10-22 09:57 UTC

The needed security updates are available. We are now in the process of deploying these updates to our infrastructure.

Reported

2 days ago 2026-10-21 07:00 UTC

A very critical security vulnerability has been found in PHP, a software that powers a large share of all websites worldwide, and the FeM infrastructure. To protect the systems and data, we have disconnected all potentially affected systems from the internet as a precaution. This is purely a preventive measure.

As a result, large parts of our systems are currently not available, until the security patches have been applied. We are working hard on updating these systems.

It is currently not possible to open any tickets in our helpdesk, register new devices for the FeM-Net, to modify any membership or to watch the iSTUFF stream. We are sorry for any inconveniences. Please be patient and note again, that all helpers do these operations voluntarily in their free time.

No incidents reported.

Wartung der FeM-Homepage

1 week ago 2026-10-15 18:40 UTC
Complete
Affected Components: Homepage
1 week ago 2026-10-15 18:41 UTC

Die Wartung der FeM-Homepage wurde ohne Probleme abgeschlossen.

1 week ago 2026-10-14 17:00 UTC
Fixed
Affected Components: Network Management

Fixed

1 week ago 2026-10-16 07:10 UTC

All issues have been resolved.

Watching

1 week ago 2026-10-15 06:47 UTC

We are currently monitoring the situation. After some repair work on our DHCP servers, the network seems to be stable again.

Reported

1 week ago 2026-10-14 17:00 UTC

We are currently experiencing limitations with IPv4 connections across the FeM-Net.

While this is not a complete outage, you may experience unreachability when accessing services and websites via IPv4. IPv6 connections should be unaffected by this issue.

Our administrators are already investigating the problem and working to restore full performance as quickly as possible. We will keep you updated here.

1 week ago 2026-10-14 10:00 UTC
Fixed
Affected Components: Internet Uplink and Wireless (Aruba system)

Fixed

1 week ago 2026-10-14 15:14 UTC

There was a configuration error while preparing for the given maintenance. This error has been fixed.

Reported

1 week ago 2026-10-14 10:00 UTC

We are seeing some DNS problems, which are caused by redundancy failures when preparing for the core maintenance. We are currently investigating the issue, maintenance has been suspended.

regular maintenance on VM host infrastructure

1 week ago 2026-10-14 17:00 UTC
Complete
Affected Components: Wireless (Aruba system), Network Management, Mailserver and VM-Hosts
1 week ago 2026-10-14 15:15 UTC

The maintenance will continue, as the issue was found. We will end a bit delayed.

1 week ago 2026-10-14 13:19 UTC

The maintenance works have been suspended, as we are currently suffering some minor DNS outages.

Routinely maintenance on video infrastructure

1 week ago 2026-10-13 16:00 UTC
Complete
Affected Components: FeMCI and Storage systems

In this timeframe, regular maintenance will be conducted on the media processing and video storage infrastructure.

Wartung an der iSTUFF Sendeinfrastruktur

1 week ago 2026-10-12 19:00 UTC
Complete
Affected Components: FeMCI

Ein wichtiger Server in der Sendeinfrastruktur von iSTUFF muss zum einspielen einiger Updates neugestartet werden. Dabei kommt es zu einer kurzen Unterbrechung des Fernsehprogramms sowie zu eingeschränkter Verfügbarkeit der Steuerung unserer Infrastruktur.

No incidents reported.

No incidents reported.