On 03-11-2022 around 13:50 HelloRetail’s core services started experiencing problems, which eventually led to the entire system being close to fully down. Requests were either slow or eventually timing out returning 500-errors. The issue was resolved again at 14:18, having lasted for about 30 minutes.

In our preparations for Black Friday, we upgraded how our auto-scaling works, but there was one dimension we, unfortunately, had forgotten to measure. The issue has been resolved now, and proper monitoring and scaling policies has been put in place. Therefore, we do not expect this problem to occur again.

We apologize for the inconvenience this service disruption has caused our customers, and if you have any questions or comments, do not hesitate to reach out.