The issue with our providers has been fully resolved.

A longer postmortem is coming in the next few days.

Due to some errors with our providers, we are seeing delays in cron jobs and connectivity issues with the dashboard.

We've noticed an issue where our uptime checker cron job has significantly failed between 16:01 CET and 23:27 CET. During that period, no monitor has been pinged.

The changes that have caused the issue have been rolled back.

All systems are now back online. We are continuously monitoring the situation.

We experienced an issue with our cloud infrastructure provider, which caused our database hosting provider to go down, affecting our APIs, status pages, and internal speed checker probes.

The database provider has since recovered, and our APIs and status pages are back online. However, we're still monitoring the ongoing outage with our cloud provider to restore our checker probes.

We have encountered a bug in out API that has updated all the monitors with a specific configuration. It occured yesterday, 22. July at 23h30 UTC. Until this morning, 23. July at 8h30 UTC, most monitors have experienced downtime. All monitors created past 23h30 UTC are not affected.

We have reverted the changes from a DB backup from the incident time and have fixed the bug.

We apologize for any inconvenience. To encounter such issue, we will increase the test coverage of our API to mitigate future issues.

A push has been fixed

We are experiencing an issue with data display on the dashboard. The root cause has been identified, and we are currently working on a solution.