Resolved -
CircleCI 2.1 builds are being processed normally again.
Jan 11, 23:44 UTC
Update -
We are continuing to monitor system stability.
Jan 11, 23:21 UTC
Monitoring -
We've finished rolling out the fix and are not seeing any further errors with 2.1 builds. We will continue to monitor the build system to confirm stability.
Jan 11, 22:51 UTC
Identified -
We've identified the cause of this issue and are rolling out a fix.
Jan 11, 22:42 UTC
Investigating -
We are currently investigating why CircleCI Builds using 2.1 are failing with the message "# Unexpected exception processing config". We will provide an update in 20 minutes or when we have further information.
Jan 11, 22:39 UTC
Resolved -
We have put in measures to address underlying resource constraints that we believe caused the issue. All our services are now operational, and we will continue to monitor for any degradation. This incident has been resolved, thank you for your patience.
Jan 10, 17:28 UTC
Update -
We are continuing to monitor our services, and understand the underlying source of the issue. We will update again in 20 minutes.
Jan 10, 17:06 UTC
Monitoring -
We have recovered from the degraded workflow UI and run times, but are still investigating the cause of the problem.
Jan 10, 16:39 UTC
Investigating -
We are investigating degraded workflow UI response times and degraded workflow run times.
Jan 10, 16:15 UTC
Resolved -
This incident has been resolved.
Jan 8, 22:09 UTC
Update -
We are still processing a backlog of remote-docker jobs. We will provide an update within 20 minutes.
Jan 8, 21:44 UTC
Update -
We are still processing a backlog of remote-docker jobs. We will provide an update within 20 minutes.
Jan 8, 21:23 UTC
Monitoring -
The provider has recovered and we are now processing the backlog of jobs.
Jan 8, 21:03 UTC
Identified -
One of our cloud providers is having difficulty fulfilling VM requests. Users may experience degraded performance and timeouts for machine executor and remote docker jobs.
Jan 8, 20:39 UTC