Issue with Saving Data

POST MORTEM: DISRUPTION 21st of March, Issues with Saving data

On March 21st, 2025, between 12:10 – 12:49 EET, an increase in system errors caused disruptions for some customers. During this time, users experienced issues saving data and delays in contracts being sent.

The issue was identified at 12:30 EET, triggered by an alert following increased error rates. It was traced back to an operation performed in one of our databases, which unintentionally blocked changes to it.

The blockage was resolved at 12:49 EET.

Timeline

• 12:10 EET – The issue began, leading to increased errors and disruptions in saving data and sending contracts.
• 12:30 EET – The issue was detected by our monitoring.
• 12:49 EET – The underlying cause was addressed and error rates dropped

Preventative Measures

To reduce the risk of similar issues in the future, we are implementing the following improvements:

• Introducing more specific alerts to quickly detect database operations that may cause system disruptions, allowing faster investigation and resolution.
• Further limiting certain internal operations during working hours to reduce the risk of impact on active users.

We sincerely apologize for the inconvenience and appreciate your understanding as we work to continuously improve our systems.