mastodon.online - Notice history

All systems operational

Website & API - Operational

99.81% uptime
Feb 2025 · 99.41%Mar · 100.0%Apr · 100.0%

Previous page

Next page

Feb 2025
Mar 2025
Apr 2025

Background queues - Operational

99.81% uptime
Feb 2025 · 99.41%Mar · 100.0%Apr · 100.0%

Previous page

Next page

Feb 2025
Mar 2025
Apr 2025

Media storage - Operational

99.98% uptime
Feb 2025 · 99.95%Mar · 100.0%Apr · 100.0%

Previous page

Next page

Feb 2025
Mar 2025
Apr 2025

Streaming API - Operational

99.98% uptime
Feb 2025 · 99.95%Mar · 100.0%Apr · 100.0%

Previous page

Next page

Feb 2025
Mar 2025
Apr 2025

Notice history

View current status

Apr 2025

No notices reported this month

Mar 2025

No notices reported this month

Feb 2025

DB connection issues
ResolvedMajor outage20 hours 38 minutes
  • Resolved
    UTC
    Resolved

    We have switched back to our original networking, and all functionality and performance is restored. Hetzner has confirmed that is was indeed a vSwitch issue that caused the network outage.

  • Monitoring
    UTC
    Monitoring

    We have implemented a fix involving tailscale to route around the networking issue, and functionality appears to be restored. We will continue monitoring the situation.

  • Update
    UTC
    Update

    We have learned that the backbone connection between our cloud servers and the baremetals that host our database is nonfunctional for any new cloud servers. We are currently working with Hetzner to resolve this issue.

  • Investigating
    UTC
    Investigating

    We are currently experiencing an issue with our DB connection pooler connecting to the database. We are currently investigating.

Kubernetes node outage
ResolvedMajor outage38 minutes
  • Resolved
    UTC
    Resolved

    Performance issues have been resolved.

  • Investigating
    UTC
    Investigating

    Node have all been restored, but the underlying cause of the issue seems to still be present (i.e. massive resource utilization across all nodes). Still investigating.

  • Identified
    UTC
    Identified

    The nodes hosting mastodon.online for kubernetes seem to be offline. We are currently working to replace them with new nodes as quickly as possible.

Previous

Feb 2025 to Apr 2025

Next