Build failures and delays due to upstream service disruption

Incident Report for CircleCI

Update

We continue to experience issues running Linux machine and Remote Docker jobs due to capacity issues at AWS following their recent incident (https://health.aws.amazon.com/health/status).

Docker and Mac job performance has recovered to normal levels, and Windows and Android jobs are still unaffected.
Posted Oct 20, 2025 - 18:31 UTC

Update

We are continuing to experience high levels of errors attempting to run instances in AWS (https://health.aws.amazon.com/health/status).
Due to this, we are currently unable to run Linux Machine and Remote Docker jobs, and Docker is experiencing slow scaling.
Additionally, AWS network instability prevents us from booting our MacOS M4 fleet.

Customers attempting to trigger Docker jobs will see queueing with slow progress.
Windows and Android jobs are unaffected.
Posted Oct 20, 2025 - 17:01 UTC

Update

We continue to experience delays in acquiring new instances from AWS (https://health.aws.amazon.com/health/status) and are actively monitoring recovery. In addition, we’re investigating issues affecting macOS M4Pro jobs where a critical network service is intermittently failing, causing an increased queue time. Our teams are working to mitigate impact and will provide updates as we learn more.
Posted Oct 20, 2025 - 15:45 UTC

Update

We continue to see delays in getting instances from AWS (https://health.aws.amazon.com/health/status) and are actively monitoring the situation.
Posted Oct 20, 2025 - 14:40 UTC

Identified

We continue to see delays in getting instances to run jobs from AWS due to their continued incident https://health.aws.amazon.com/health/status. This is causing delays in jobs starting across Docker and Linux.
Posted Oct 20, 2025 - 12:06 UTC

Update

Our upstream service provider has identified the root cause and is actively working on mitigation. We'll continue monitoring and provide updates as more information becomes available.
Posted Oct 20, 2025 - 09:10 UTC

Investigating

We are currently experiencing an issue with an upstream service provider that is causing builds to fail or experience delays in the queue. We will provide updates as more information becomes available.
Posted Oct 20, 2025 - 07:49 UTC
This incident affects: CircleCI Dependencies (AWS) and Docker Jobs, Machine Jobs, macOS Jobs, Windows Jobs, Pipelines & Workflows, Artifacts, Notifications & Status Updates.