Is Coveralls Coveralls.io Web down?
Current Coveralls Coveralls.io Web status is UP

Identified - We have identified the root cause of of delayed status updates for some repos as backups in several queues that process background jobs related to aggregate coverage calculation on new builds, which precede the sending of notifications and are therefore delaying those. However, we have not yet identified a pattern behind these spikes or the delays in processing these queues since none of our usual performance metrics had been triggered (until recently when a queue that affects all users triggered an alarm). We are scaling up server processes to clear that backup, but since we are not seeing degraded performance metrics from servers, we are continuing to investigate other causes for delayed processing. Apr 04, 2024 - 19:39 PDT

Identified - We have new reports of users receiving `502` (Bad Gateway) errors from our edge service provider (Cloudflare). We are aware of rolling maintenance at Cloudflare across it's global centers that is leading to temporarily re-routing which may be adding latency to otherwise normal requests and resulting in `502` errors via our API or `504` errors via our Web UI.We are watching and have reached out to Cloudflare. Jan 12, 2024 - 14:41 PST

Investigating - We've received reports of slow build times from some users. We have identified one server in OOM hang that is servicing one queue, so customers in this queue are most likely the ones affected.We will be clearing that queue as quickly as possible.If you are experiencing slow builds, feel free to reach out to support@coveralls.io and we can find out if any of your recent builds are involved. Oct 18, 2023 - 15:52 PDT

Monitoring - We've seen a spike in build times for large repos (5K+ source files). Right now, only nine (9) repos seem to be affected. We have implemented a fix and are monitoring as build times return to normal for these repos.The root cause of this spike is elevated jobs (and therefore dequeue times) in queues dedicated to large repos which appears to have been triggered by two (2) repos sending an unusually high number of uploads over the past 1-3 hr period. We have increased resources to these queues to accelerate processing but may need to pause the above repos if uploads continue at the same level.If you think your repo was affected you can reach out to us at support@coveralls.io. We will reach out to the owners of the repos with elevated jobs. Aug 24, 2023 - 09:56 PDT

Investigating - We're receiving reports of slow builds due to slow dequeue times for background jobs. We are investigating and will update status here. Aug 17, 2023 - 14:37 PDT