We’ve finished monitoring activities, system is stable and fully operational.
Posted Feb 01, 2023 - 22:58 UTC
Monitoring
Issue is resolved, clusters are back online, autoscaling is working. We are monitoring the situation.
Posted Feb 01, 2023 - 22:17 UTC
Update
Database restore is in progress
Posted Feb 01, 2023 - 21:03 UTC
Update
Update: Autoscaler performance is also degraded. Team is working on a fix
Posted Feb 01, 2023 - 20:38 UTC
Identified
During a database upgrade the organization link for clusters got corrupted, we are currently rolling back the change. All clusters are still connected and running as expected but will not be visible in the UI. We will update here shortly with a status update.
Posted Feb 01, 2023 - 20:27 UTC
This incident affected: Uptime of https://console.cast.ai and Autoscaler.