3/9/2023 · Edo Liberty
What this post added
This post details a partial database outage that affected a portion of indexes on the Starter (free) plan due to a bug in an inactivity script. 515 indexes were inadvertently deleted and then fully restored two days later. No indexes on paid plans were affected. The root cause was a bug in a SQL query and an incorrect deployment process for the script. Actions taken include enhanced approval processes for data modification, auditing of access and permissions, enabling bucket versioning, and prioritizing the development of a new free plan architecture, more educational materials, integration tests for cron jobs, mirroring staging environments to production, enabling soft deletes, and designing a data export feature.