System Issue 5/31/2021

On May 31, Agile Ticketing experienced an issue with an update of a security component installed on our server cluster.  This update normally happens in the off hours before 5am, but it failed and rolled back that morning.  Later that day we found that the installation rollback essentially caused several of our backend services to become unresponsive.  When we saw the issue crop up with our uptime monitoring we made sure the component was correctly rolled back and restarted the services.  This affected both reporting and web sales intermittently during about an hour period. 

This is something we don't like to see happen and are working to adjust this update schedule to make sure that our redundant components are updated at different times.