Disruption to Dashboard

» View Event Details | Created Mon, 10 Jun 2019 20:56:00 +0000

Resolved

Dashboard logins are now operating correctly. We are sorry for the short disruption.

Major Service Disruption: All Services

» View Event Details | Created Fri, 07 Jun 2019 14:47:00 +0000

Post-Mortem

Reason For Outage Report (Post Mortem)

On Jun 7 at 9:49 AM Central, MODX Cloud experienced a systemwide outage.

The cause was determined to be the result of an error at our infrastructure vendor, which resulted in the public network ports being blocked.

Service began restoring at 10:19 AM. However, some servers and services required manual intervention to clear stuck processes and to restart NGINX and MySQL. By 11:16 AM, we had completed all manual checks and verifications for all public-facing infrastructure. The Dashboard control panel for viewing all platforms and instances was returned to service at 11:31 AM and the back end Agent platform for new instance provisioning and other automation was confirmed fully functional across all platforms at 12:30 PM.

While no data was lost, this service outage is tremendously frustrating and disappointing. We failed in our promise for service uptime. We sincerely apologize for this.

We are currently working with IBM to ensure that this can never occur again. If you have any further questions, please do not hesitate to contact us via the support tab in the MODX Cloud Dashboard.

Again, we sincerely apologize for this event and thank you for being MODX Cloud customers.

Texas 1 and 2 Network Issues

» View Event Details | Created Fri, 07 Jun 2019 01:11:00 +0000

Resolved

Network issues seem to have resolved and websites are now working as they should be. We will coordinate with our upstream provider on the cause of the issue and report the update once we have it.