Delay in starting Workflows

Incident Report for CircleCI

Resolved

We are no longer seeing any delay in Job starts
Posted Apr 05, 2019 - 00:54 UTC

Update

We are no longer seeing any delay in starting Jobs and our latency is below 10 seconds
Posted Apr 05, 2019 - 00:25 UTC

Update

Job start delay is currently at one minute and we are continuing to monitor
Posted Apr 05, 2019 - 00:15 UTC

Monitoring

Job start delay is currently at 1.25 minutes and is continuing to improve
Posted Apr 04, 2019 - 23:56 UTC

Update

Job start delay is currently at 3 minutes and improving
Posted Apr 04, 2019 - 23:34 UTC

Update

There is currently a 6 minute delay in starting Jobs and it is improving
Posted Apr 04, 2019 - 23:28 UTC

Update

We are continuing to process our backlog of Workflows
Posted Apr 04, 2019 - 23:22 UTC

Identified

We have found a datastore with high latency that was causing Workflows to be delayed and are monitoring it's restart
Posted Apr 04, 2019 - 23:06 UTC

Update

We are continuing to look into why Workflows are slow to start
Posted Apr 04, 2019 - 22:47 UTC

Investigating

We are looking into why Workflows are slow to start
Posted Apr 04, 2019 - 22:30 UTC
This incident affected: Docker Jobs and Pipelines & Workflows.