Grafana.comSupport TicketsIntegrationsCost Management and BillingFleet ManagementIncident Management and Response (IRM)GCP UK - prod-gb-south-0Public SnapshotsGCP UK - prod-gb-south-0GCP UK - prod-gb-south-0GCP UK - prod-gb-south-0GCP UK - prod-gb-south-0GCP UK - prod-gb-south-0GCP UK - prod-gb-south-0GCP UK - prod-gb-south-0GCP UK - prod-gb-south-0GCP UK - prod-gb-south-0: APIGCP UK - prod-gb-south-0: QueryingGCP UK - prod-gb-south-0: Public ProbesGCP UK - prod-gb-south-0: IngestionGCP UK - prod-gb-south-0: Rule EvaluationGCP UK - prod-gb-south-0: Alertmanager and Rules Configuration APIGCP UK - prod-gb-south-0: QueryingGCP UK - prod-gb-south-0: AlertmanagerGCP UK - prod-gb-south-0: IngestionGCP UK - prod-gb-south-0: Metrics Generator
identified
Between 06:15 and 12:15 UTC, Grafana Cloud Frontend Observability in GCP UK (prod-gb-south-0) experienced errors accepting incoming telemetry data. This has been resolved and Frontend Observability is operating normally in this region. We are continuing to investigate and monitor the remaining impacted services.
investigating
We are continuing to investigate this issue.
investigating
We are continuing to investigate this issue.
investigating
As of 06:30 UTC, we became aware of to an issue with Grafana Cloud unavailibity in the prod-gb-south-0 region.
Engineering is actively engaged and assessing the issue. We will provide updates accordingly.
We are continuing to monitor for any further issues.
monitoring
A fix has been implemented and we are monitoring the results.
investigating
We are continuing to investigate this issue.
investigating
We’re currently investigating an issue affecting metrics reads and rule evaluations in mimir-prod-66. Our team is actively working to identify the cause. Thank you for your patience.
The fix has been implemented, and we are monitoring the results.
identified
We have noticed improvements across services. We will now be applying a more permanent fix. Impacted users may experience a disruption in the auth-api service of up to 15min while we apply a DB patch that will improve performance.
identified
The issue has been identified, and we have applied mitigations on our end. We are currently observing the progress.
investigating
We are investigating increased authentication errors affecting Grafana Cloud in the prod-us-west-0 region.
Customers may experience intermittent failures for requests that require authentication.
Our engineering team has identified database performance degradation affecting the authentication service and is investigating the underlying cause.
We will provide another update as more information becomes available.
We have put some mitigations in place which seem to have helped with the errors.
We continue to monitor the results.
investigating
We are continuing to investigate this issue.
investigating
A small number of customers with stacks in prod-us-central-4 are receiving "forbidden" errors when querying Prometheus data sources.
We are investigating and will provide an update soon.
Phone call notifications to numbers in Russia and Kazakhstan are blocked
Phone call notifications to numbers in Russia and Kazakhstan are still blocked. We are working to resolve the issue.
As SMS support is limited in these countries, we recommend using mobile push notifications as an alternative.
We do not currently have an estimated resolution time. We will provide further updates as more information becomes available.
investigating
Phone call notifications to numbers in Russia and Kazakhstan are currently blocked. We are working to resolve the issue.
As SMS support is limited in these countries, we recommend using mobile push notifications as an alternative.
We do not currently have an estimated resolution time. We will provide further updates as more information becomes available.
investigating
Phone call notifications to numbers in Russia and Kazakhstan are currently blocked. We are working to resolve the issue.
As SMS support is limited in these countries, we recommend using mobile push notifications as an alternative.
We do not currently have an estimated resolution time. We will provide further updates as more information becomes available.
Elevated Errors Ingesting Metrics in AWS US East (VA)
We have isolated infrastructure suspected of contributing to the metrics ingestion issue in AWS US East (VA) - prod-us-east-3. We are validating recovery and completing mitigation steps. Customers may continue to experience failed or delayed metric writes while this work continues.
identified
We have isolated infrastructure suspected of contributing to the metrics ingestion issue in AWS US East (VA) - prod-us-east-3. We are validating recovery and completing mitigation steps. Customers may continue to experience failed or delayed metric writes while this work continues.
identified
We have identified the cause of an issue affecting metrics ingestion for Grafana Cloud Metrics customers in AWS US East (VA) - prod-us-east-3. Customers may see failed or delayed writes to Grafana Cloud Metrics, this may also impact Metrics written by Frontend Observability and/or Synthetic Monitoring. We are continuing to work on mitigations and are monitoring the impact to Grafana Cloud Metrics. Next update by 14:00 UTC.
identified
We have identified the cause of an issue affecting metrics ingestion for Grafana Cloud Metrics customers in AWS US East (VA) - prod-us-east-3. Customers may see failed or delayed writes to Grafana Cloud Metrics, this may also impact Metrics written by Frontend Observability and/or Synthetic Monitoring. We are continuing to work on mitigations and are monitoring the impact to Grafana Cloud Metrics. Next update by 13:00 UTC.
investigating
We are continuing to investigate an issue affecting metrics ingestion for Grafana Cloud Metrics customers in AWS US East (VA). Customers may see failed or delayed writes to Grafana Cloud Metrics, this may also impact Metrics written by Frontend Observability and/or Synthetic Monitoring. Next update by 12:00 UTC.
investigating
We are continuing to investigate an issue affecting metrics ingestion for Grafana Cloud Metrics customers in AWS US East (VA). Customers may see failed or delayed writes. Next update by 11:00 UTC.
investigating
We are investigating an issue affecting metrics ingestion for Grafana Cloud Metrics customers in AWS US East (VA). Customers may see failed or delayed writes. Next update by 10:15 UTC.
Degraded Performance with Increased Latency for Grafana Cloud Metrics and Traces in GCP US Central
GCP US Central - prod-us-central-0GCP US Central - prod-us-central-5GCP US Central - prod-us-central-0: IngestionGCP US Central - prod-us-central-5: IngestionGCP US Central - prod-us-central-0: Ingestion
investigating
We are investigating degraded performance and increased latency in the ingestion path for Grafana Cloud Metrics in GCP US Central (prod-us-central-0 and prod-us-central-5) and Grafana Cloud Traces in prod-us-central-0.
Customers may experience intermittent errors or delays when sending metrics and traces.
We continue to investigate the issue with our cloud provider. We do not have an estimated time to resolution at this time.
investigating
We are investigating degraded performance and increased latency in the ingestion path for Grafana Cloud Metrics in GCP US Central (prod-us-central-0 and prod-us-central-5) and Grafana Cloud Traces in prod-us-central-0.
Customers may experience intermittent errors or delays when sending metrics and traces.
We continue to investigate the issue with our cloud provider. We do not have an estimated time to resolution at this time.
investigating
We are investigating degraded performance and increased latency in the ingestion path for Grafana Cloud Metrics in GCP US Central (prod-us-central-0 and prod-us-central-5) and Grafana Cloud Traces in prod-us-central-0.
Customers may experience intermittent errors or delays when sending metrics and traces. We have also received reports that some customers using Google Managed Prometheus in this region are experiencing issues when querying their GMP instances.
We continue to investigate the issue with our cloud provider. We do not have an estimated time to resolution at this time.
investigating
We are investigating degraded performance and increased latency in the ingestion path for Grafana Cloud Metrics in GCP US Central (prod-us-central-0 and prod-us-central-5) and Grafana Cloud Traces in prod-us-central-0.
Customers may experience intermittent errors or delays when sending metrics and traces. We have also received reports that some customers using Google Managed Prometheus in this region are experiencing issues when querying their GMP instances.
We continue to investigate the issue with our cloud provider. We do not have an estimated time to resolution at this time.
investigating
We are investigating degraded performance with increased latency in the ingestion path for Grafana Cloud Metrics in GCP US Central (prod-us-central-0 and prod-us-central-5) and for Grafana Cloud Traces in prod-us-central-0. Customers may experience intermittent errors or delays when sending metrics and traces. We continue to investigate this with our cloud provider. We do not have an estimated time of resolution at this time. Next update by 18:30 UTC
investigating
We continue seeing elevated error rates and latency, and keep working with our cloud provider on this issue.
Next update by 17:30 UTC.
investigating
We are investigating degraded performance with increased latency in the ingestion path for Grafana Cloud Metrics in GCP US Central (prod-us-central-0 and prod-us-central-5) and for Grafana Cloud Traces in prod-us-central-0. Customers may experience intermittent errors or delays when sending metrics and traces. We are investigating this with our cloud provider. We do not have an estimated time of resolution at this time. Next update by 16:30 UTC.
investigating
We are investigating degraded performance with increased latency in the ingestion path for Grafana Cloud Metrics in GCP US Central (prod-us-central-0 and prod-us-central-5) and for Grafana Cloud Traces in prod-us-central-0. Customers may experience intermittent errors or delays when sending metrics and traces. We are investigating this with our cloud provider. We do not have an estimated time of resolution at this time. Next update by 15:30 UTC.
investigating
We continue to investigate intermittent elevated error rates and latency affecting Grafana Cloud Metrics in GCP US Central (prod-us-central-0 and prod-us-central-5), and periodic increased latency affecting Grafana Cloud Traces in prod-us-central-0. Intermittent errors and latency may still occur. We are working with our cloud provider as part of the investigation. We do not have an estimated time of resolution at this time. Next update by 14:30 UTC.
investigating
Update to scope: we have not confirmed any impact to Grafana Cloud Logs, and Logs has been removed from the affected components. We continue to investigate intermittent elevated error rates and latency affecting Grafana Cloud Metrics in GCP US Central (prod-us-central-0 and prod-us-central-5), and periodic increased latency affecting Grafana Cloud Traces in prod-us-central-0. Error rates have decreased, but intermittent errors and latency may still occur. We are working with our cloud provider as part of the investigation. We do not have an estimated time of resolution at this time. Next update by 14:30 UTC.
investigating
We continue to investigate intermittent elevated error rates and latency affecting Grafana Cloud Metrics and Logs in GCP US Central (prod-us-central-0 and prod-us-central-5), and periodic increased latency affecting Grafana Cloud Traces in prod-us-central-0. Error rates have decreased, but intermittent errors and latency may still occur. We are working with our cloud provider as part of the investigation. We do not have an estimated time of resolution at this time. Next update by 14:30 UTC.
investigating
Beginning around 10:20 UTC, we have been seeing intermittent elevated error rates and latency affecting Grafana Cloud Metrics and Logs in GCP US Central (prod-us-central-0 and prod-us-central-5), and periodic increased latency and occasional errors affecting Grafana Cloud Traces in prod-us-central-0. Customers may see errors or delays when sending metrics, logs and traces. We are actively investigating. Next update by 13:40 UTC.
Legacy Incident Archive
101 archived records restored. These records predate source-at-observation attestation. They are shown as historical ServiceAlert records only and do not establish a provider-reported incident, resolution, duration, or current active state.
July 2026
Partial Outage in prod-eu-west-2
majorSource not attested
Last archived state: resolved
View archived record details
monitoring
We’ve implemented a fix and are monitoring the results to confirm the issue is fully resolved. Services may start to recover during this time.
investigating
We are continuing to investigate this issue.
investigating
We are investigating a broader issue affecting multiple Grafana Cloud products in prod-eu-west-2. This appears to be caused by a third-party provider issue rather than a Loki-specific problem.
Impact is currently inconsistent: some components are affected while others continue to function normally. We have also seen some impact to Tempo write paths.
We are continuing to investigate and will share another update as soon as we have more information.
investigating
We are investigating an issue affecting Loki queries in prod-eu-west-2.
We first observed this behavior at approximately 21:57 UTC. Affected users may see elevated query errors, timeouts, or intermittent failures when running Loki queries in this region.
The issue appears to be improving, but it is not fully resolved yet. We are continuing to investigate and will share another update as soon as we have more information.
Delayed Aggregated Metrics (prod-us-central-0)
minorSource not attested
Last archived state: resolved
View archived record details
monitoring
We have applied the mitigation and are monitoring as the backlog catches up. We will post another update once that is complete.
Thank you for your patience.
identified
We are currently investigating a delay in aggregated metric results for tenants using Adaptive Metrics in the prod-us-central-0 region.
Our engineering team has identified the issue and is actively working on a mitigation. We will provide further updates as the investigation progresses.
Some Reports of Grafana Not Loading.
majorSource not attested
Last archived state: resolved
View archived record details
identified
The fix is in the process of being rolled out.
identified
We believe we have found the cause and are working on remediation. It is also worth mentioning that only stacks on the "slow" release channel are impacted.
investigating
We are currently investigating an issue impacting a small subset of stacks in the impacted regions. We will provide more details as they become available.
Mimir Write Performance Degradation
minorSource not attested
Last archived state: resolved
View archived record details
monitoring
From 19:24 until 19:40 UTC, backend performance degradation impacted ingestion. We are currently monitoring.
Mimir Partial Write Outage
majorSource not attested
Last archived state: resolved
View archived record details
monitoring
The outage is recovered as of 16:56 UTC, and we're continuing to monitor.
identified
We're investigating backend degradation which has resulted in a partial write outage beginning around 16:40 UTC. This degradation has also impacted reads and rule evaluation. Issue has been identified and we are working on mitigation.
Issue with Dashboard Views Being Registered
minorSource not attested
Last archived state: resolved
View archived record details
identified
We are currently working on a fix related to this incident. There are no new updates to share at this time.
identified
We continue to work on resolving the issue impacting dashboard view and error counts. There are no new updates to share at this time. Our next update will be provided within 24 hours.
identified
We continue to work on resolving the issue impacting dashboard view and error counts. There are no new updates to share at this time. Our next update will be provided within 24 hours.
identified
We continue to work on resolving this issue. We'll provide another update within the next 24 hours, or sooner if additional information becomes available.
identified
We continue to work on resolving this issue. We'll provide another update within the next 24 hours, or sooner if additional information becomes available.
identified
We've identified the cause of the issue impacting dashboard view and error counts in the Dashboards and Folder list. Our team is currently working on implementing a fix and validating the solution. We will provide another update within the next 24 hours, or sooner if we have additional information to share.
investigating
This is related to https://status.grafana.com/incidents/rhrk2ck6ly0y which was resolved by mistake.
For some dashboards, the Views/Error counts in the Dashboards/Folder list renders as `-` and never updates, even after dashboards are viewed repeatedly. This is ultimately causing inaccurate or missing view counts.
We are continuing to investigate the underlying cause of this issue. At this time, the scope and impact remain unchanged, and we have no new information to share. We will provide ...
IRM Mobile App forcing some users to logout
minorSource not attested
Last archived state: resolved
View archived record details
monitoring
A new iOS mobile app version (v2.39.5) has been released, which includes a fix for this issue. We are monitoring the rollout and its impact to ensure the issue has been fully resolved. If you continue to experience any problems after updating to the latest version, please let us know.
identified
A fix has been submitted for review and will be released as Grafana Mobile v2.39.5 once it is approved.
If your app is currently on v2.39.3, we recommend not upgrading to v2.39.4 and instead waiting for v2.39.5 to become available.
Users who have already been signed out by this issue can log back into the app and continue using it.
We will provide another update once v2.39.5 is available.
investigating
Our investigation has narrowed the impact to version 2.39.4 of the Grafana mobile app on iOS. Users should avoid upgrading to this version until an updated release is available.
As a precaution, we also recommend ensuring you have alternative notification methods configured (such as SMS, email, or phone calls) if you rely on mobile push notifications for alerting.
We are actively working on a resolution and will provide another update as soon as more information is available.
investigating
We are aware of an issue in the latest mobile app release that is causing some users to be signed out and asked to log in again.
We have reproduced the behavior and are investigating and working on a fix. We will share another update as soon as we have more information.
Issue with Dashboard Views Being Registered
minorSource not attested
Last archived state: resolved
View archived record details
investigating
We are continuing to investigate the underlying cause of this issue. At this time, the scope and impact remain unchanged, and we have no new information to share. We will provide another update as soon as more information becomes available.
investigating
For some dashboards, the Views/Error counts in the Dashboards/Folder list renders as `-` and never updates, even after dashboards are viewed repeatedly
This is ultimately causing inaccurate or missing view counts.
PDC Degraded performance
criticalSource not attested
Last archived state: resolved
View archived record details
monitoring
We are now seeing recovery of PDC traffic to the affected customers. Our team will continue to monitor across shifts.
identified
We are continuing to see disruptions across multiple deployments, ranging from degraded performance to full outages for some customers.
Additional resources have been engaged to mitigate this issue. We will post updates as they become available.
monitoring
We are continuing to monitor for any further issues.
monitoring
We are seeing recovery in some deployments, while others not just yet. We are continuing to monitor this incident.
monitoring
A fix has been applied and we are seeing recovery. We will continue to monitor this.
investigating
We are still currently investigating the issue.
investigating
We are currently facing performance degradation on PDC service hosted on Multiple clusters. Our Engineering Team is currently working on fixing the issue, we do apologize for any inconvenience.
Delayed ingestion and recording rule evaluation failures for Mimir in prod-ap-south-1
minorSource not attested
Last archived state: resolved
View archived record details
monitoring
A fix has been implemented. We are currently monitoring the results.
investigating
We are observing delayed ingestion and recording rule evaluation failures for Mimir in prod-ap-south-1. As of yet we have not noticed any customer impact however we are currently observing the cell.
