Looking for an update now? Check the current status, or follow Buildkite for future changes.
77.2%of 57 verified observed days had no reported provider issue
90-Day Trend
Dashed calendar markers below identify legacy observations whose source-at-observation was not recorded.
Monthly Status Summary
Month
Issue-free days
Days Tracked
Days with issues
September 2026
73.3%
30
8
This percentage summarizes normalized provider-status observations by calendar day. It is not duration-based, component-weighted, or contractual uptime. See the methodology and limitations.
Recorded Daily Status (Last 91 Days)
Jul 22Today
Legacy observation Operational Degraded Partial Outage Major Outage Maintenance No Data
Catch-up processing continues, most of the backlog is processed, ingestion latency is decreasing.
monitoring
Internal processing of uploaded test execution data has been delayed, and is currently catching up. No data has been dropped, and all data should be processed over the next hour.
Issues identified with buildkite-agent registration
Recovery is underway; we'll keep monitoring until recovery is complete.
investigating
We have rolled out a few changes to fix the underlying issues and are seeing signs of recovery.
We'll keep monitoring until all systems are fully recovered and communicate once we are confident everything is stable again.
investigating
We identified issues affecting certain customers when the buildkite-agent attempts to register with Buildkite. When agents are not able to register, builds may start to back up.
We've identified a potential root case and are attempting changes to fix it.
investigating
We're seeing increased latency and error rates for a subset of our customers. We're currently investigating and will provide status updates as they become available.
Systems have recovered and we are seeing new builds created. For a period of about 20min new builds could not be created due to a failure of our internal DNS services. No build requests were lost during this time and we are continuing to process the backlog
investigating
We have identified a fix and applied mitigations, and we are seeing signs of recovery.
investigating
We are currently investigating a sitewide outage.
investigating
We've spotted that something has gone wrong. We're currently investigating the issue, and will provide an update soon.
Legacy Incident Archive
32 archived records restored. These records predate source-at-observation attestation. They are shown as historical ServiceAlert records only and do not establish a provider-reported incident, resolution, duration, or current active state.
May 2026
Jobs not starting on hosted agents and agent-stack-k8s
majorSource not attested
Last archived state: resolved
View archived record details
identified
We're currently seeing recovery at 50% rate. We'll provide next update soon.
investigating
We've identified issue with job acquiring endpoint. We're rolling back now. We'll provide next update in ~20 minutes.
investigating
We've spotted that something has gone wrong. We're currently investigating the issue with new builds not starting.
Test Engine: Delayed processing of test result ingestion
minorSource not attested
Last archived state: resolved
View archived record details
monitoring
We've identified the issue and the system is currently processing the backlog of test executions
investigating
A process writing test results to our Test Engine data store stalled, we've restarted the process and are seeing it catching up. We expect to be fully caught up on the backlog within the next couple of hours.
Delayed notifications
minorSource not attested
Last archived state: resolved
View archived record details
monitoring
Applied remediations have resolved the previous notification delays affecting a subset of our customers. We're continuing to monitor the affected services for stability.
identified
We've identified the source of the notification delays affecting a subset of our customers. Our engineers are applying remediations to reduce these delays.
investigating
We are investigating delays with build and job notifications for a subset of customers.
Increased latency and error rates
Source not attested
Last archived state: resolved
View archived record details
investigating
We're observing increased latency and error rates in the Agent API for a subset of our customers. We're currently investigating and will provide status updates as they become available.
April 2026
Increased latency and error rates
minorSource not attested
Last archived state: resolved
View archived record details
monitoring
We have identified and fixed the issue with the underlying database for a subset of customers. We are now monitoring the issue.
investigating
We're observing increased latency and error rates for a subset of our customers. We're currently investigating and will provide status updates as they become available.
Increased dispatch latency and error rates
minorSource not attested
Last archived state: resolved
View archived record details
monitoring
We have mitigated the issue causing increased Hosted Agents dispatch latency and intermittent timeout errors for a subset of customers. We identified abnormal workload activity that was placing elevated load on a supporting service, and have now blocked that activity and applied additional protections. Service metrics have returned to normal, and we are continuing to monitor closely.
identified
The issue has been identified and a fix is being implemented.
investigating
We're observing increased error rates and dispatch latency for a subset of our customers. We're currently investigating and will provide status updates as they become available.
Auth failures with remote MCP server
minorSource not attested
Last archived state: resolved
View archived record details
monitoring
We have rolled back a change on the remote MCP server that was contributing to authentication failures.
investigating
We are continuing to investigate errors when authenticating to the remote MCP server.
investigating
We are currently investigating reports of authentication failures with the remote MCP server.
Delayed processing of test execution
minorSource not attested
Last archived state: resolved
View archived record details
monitoring
We noticed a lag in data processing, but our systems are operational and currently working through the backlog. We expect to be fully caught up within the next couple of hours.
Degraded performance and increased error rates
majorSource not attested
Last archived state: resolved
View archived record details
monitoring
We have identified and fixed the issue. We are monitoring and seeing signs of improvement.
investigating
We've spotted that something has gone wrong. We're currently investigating the issue, and will provide an update soon.
March 2026
Hosted Agents jobs immediately cancelled
minorSource not attested
Last archived state: resolved
View archived record details
identified
We have identified the issue and are rolling out a fix.
investigating
We have received reports from customers that they are unable to start builds on Hosted Agents. Their builds are immediately cancelled. We are investigating.
