31st August 2019

Partial outage

02:55 - Additional dedicated database resource has been provisioned for our most active clients. This is having a positive effect. Other components in our platform remain shared and have been assessed. Our gateway, which routes all traffic and takes care of SSL certificates, has had it's compute resource boosted as it was a factor during the spike in traffic yesterday afternoon. All front-end services are now online. We'll be bringing background services online through the morning.

09:30 - In response to performance issues this morning we've identified the cause to be background task build-up, due to reduced services, causing new issues during registration (pushing new tasks into the queue). We've rebuilt the tasks table and seeing improved performance through the registration forms now. All background tasks are now online. We’re continuing to look into the performance and any issues resulting from yesterday and after-effects of the reduced level of service.

13:20 - Unfortunately whilst carrying out additional maintenance today (regular tasks we usually complete in our maintenance window), to improve performance, a mistake was made which effected Speciality Fine Food Fair 2019. This has been rectified and all services are back online. Further work has been put on-hold during this key period and we will be reviewing the incident internally.

15:45 - We're continuing to see and receive reports of poor performance throughout registration forms and background import/export tasks. We're focusing on determining the root cause of the issue and will continue to provide updates as this progresses.