mastodon.online - Notice history

All systems operational

Website & API - Operational

98.76% uptime
May 2023 · 100.0%Jun · 99.80%Jul · 96.56%

Previous page

Next page

May 2023
Jun 2023
Jul 2023

Background queues - Operational

98.76% uptime
May 2023 · 100.0%Jun · 99.80%Jul · 96.56%

Previous page

Next page

May 2023
Jun 2023
Jul 2023

Media storage - Operational

100.0% uptime
May 2023 · 100.0%Jun · 100.0%Jul · 100.0%

Previous page

Next page

May 2023
Jun 2023
Jul 2023

Streaming API - Operational

99.93% uptime
May 2023 · 100.0%Jun · 99.80%Jul · 100.0%

Previous page

Next page

May 2023
Jun 2023
Jul 2023

Notice history

View current status

Jul 2023

Email delivery issues
ResolvedDegraded performance1 hour 2 minutes
  • Resolved
    UTC
    Resolved

    This incident has been resolved.

    E-mails are not correctly delivered. If you created an account in the last two days and did not receive an email, it should be delivered in the coming hours.

  • Identified
    UTC
    Identified

    We noticed a problem with our email deliveries (new signups, lost password…).

    We are working on it, it should be fixed in the next hours.

Hetzner Network Issues
ResolvedMajor outage25 hours 32 minutes
  • Resolved
    UTC
    Resolved

    This incident has been resolved.

  • Monitoring
    UTC
    Monitoring

    We have moved our Redis server into Hetzner Cloud, where there are no network connectivity issues, and functionality has been restored. We will continue monitoring for any issues.

  • Investigating
    UTC
    Investigating

    There is currently an issue with Hetzner's network connection between Hetzner Cloud and Bare Metal, which is affecting our backend services. We are looking into the cause.

Jun 2023

Website is down
ResolvedMajor outage1 hour 25 minutes
  • Resolved
    UTC
    Resolved

    This incident has been resolved and our provider confirmed the issue has been fixed on their side.

    Everything is back online and all messages in the backlog have been processed.

  • Identified
    UTC
    Identified

    Network to the Redis server is down again, we are waiting for an update from our hosting provider.

  • Monitoring
    UTC
    Monitoring

    Our provider seems to have fixed the network issue and the services are back online.

    Your feeds might be a few minutes late while we are processing the messages posted during the downtime.

    We are closely monitoring the situation until our provider confirms everything is operational on their side.

  • Identified
    UTC
    Identified

    There is currently a network incident with our hosting provider, preventing our Redis server to be unreachable.

    We are waiting for an ETA from our provider, and are preparing setting up a new Redis server if the issue is not resolved quick enough.

DB migration error
Resolved
  • Resolved
    UTC
    Resolved

    There was a small error in the DB migration steps when upgrading to the latest nightly. This was due to an older DB version being used in production.

    We have rolled back to a previous version and are continuing to monitor.

May 2023

Service is unavailable
Resolved1 hour 36 minutes
  • Resolved
    UTC
    Resolved

    This incident has been resolved.

    An internal TLS certificate was renewed automatically, but did not get properly reloaded into our load balancer after renewal.

    It took us a long time to identify this, as no errors were visible to point us to the source of the issue.

    We identified the root cause and will take steps to prevent this from happening in the future.

  • Identified
    UTC
    Identified

    We identified the issue and are working on it.

  • Investigating
    UTC
    Investigating

    We are currently investigating this incident.

Previous

May 2023 to Jul 2023

Next