Is Google Cloud Hybrid Connectivity down?
Current Google Cloud Hybrid Connectivity status is UP

Summary: Multiple Google Cloud Products are experiencing issues in us-west1
Description: We are experiencing an issue with multiple Google Cloud Products beginning on Wednesday, 2024-02-14 9:40 US/Pacific.
Our engineers have identified a common infrastructure component as the root cause and we are attempting a mitigation. As the mitigation progresses, some products may see partial recovery.
We do not have an ETA for mitigation at this point.
We will provide an update by Wednesday, 2024-02-14 12:20 US/Pacific with current details.
Diagnosis: Existing customer load balancers will continue to function. New load balancers or changes to existing load balancers will not propagate configs and changes to the configurations of load balancers may result in an error.
Configuration changes can not be made to the Regional Internal, Regional External, and Global External Application Load Balancers in the affected region.
Customers may see errors when making configuration changes.
Workaround: None at this time.

Summary: Multiple Google Cloud Products are experiencing issues in us-west1
Description: We are experiencing an issue with multiple Google Cloud Products beginning on Wednesday, 2024-02-14 9:40 US/Pacific.
Our engineers have identified a common infrastructure component as the root cause and we are attempting a mitigation. As the mitigation progresses, some products may see partial recovery.
We do not have an ETA for mitigation at this point.
We will provide an update by Wednesday, 2024-02-14 12:20 US/Pacific with current details.
Diagnosis: Existing customer load balancers will continue to function. New load balancers or changes to existing load balancers will not propagate configs and changes to the configurations of load balancers may result in an error.
Configuration changes can not be made to the Regional Internal, Regional External, and Global External Application Load Balancers in the affected region.
Customers may see errors when making configuration changes.
Workaround: None at this time.

Summary: Cloud Interconnect users may be impacted in us-east4
Description: We are experiencing an issue with Hybrid Connectivity beginning on Thursday, 2023-12-07 03:10 US/Pacific.
Our engineering team continues to investigate the issue. We will provide an update by Thursday, 2023-12-07 05:30 US/Pacific with current details.
Diagnosis: Customers may experience problems creating, updating or deleting Cloud Interconnect attachments in us-east4 HA0.
Workaround: There is no workaround for the management plane issue at this time. In regard to existing attachments, customers not experiencing connectivity problems are advised to take no action. Customers experiencing problems reaching GCP destinations outside us-east4 via HA0 attachments in us-east4 should consider manually failing over to HA1 attachments.

Summary: Cloud Interconnect users may be impacted in us-east4
Description: We are experiencing an issue with Hybrid Connectivity beginning on Thursday, 2023-12-07 03:10 US/Pacific.
Our engineering team continues to investigate the issue. We will provide an update by Thursday, 2023-12-07 05:30 US/Pacific with current details.
Diagnosis: Customers may experience problems creating, updating or deleting Cloud Interconnect attachments in us-east4 HA0.
Workaround: There is no workaround for the management plane issue at this time. In regard to existing attachments, customers not experiencing connectivity problems are advised to take no action. Customers experiencing problems reaching GCP destinations outside us-east4 via HA0 attachments in us-east4 should consider manually failing over to HA1 attachments.

Summary: We've received a report of an issue with Document AI in us multiregion
Description: **We are experiencing an issue with Document AI beginning on Monday, 2023-12-04 13:00 US/Pacific.**
Our engineering team continues to investigate and work towards mitigating the issue. At this time, we do not have a specific ETA for the mitigation work to be completed.
Please rest assured that our engineering teams are working diligently to mitigate all known impacts.
We understand that this issue has impacted your ability to access and use our services, we deeply appreciate your patience and cooperation while we worked to mitigate the issue
**We will provide an update by Monday, 2023-12-04 18:30 US/Pacific with current details.**
Diagnosis: Customers using Document AI to process documents with 'DocumentProcessorService-ProcessDocument' API using v1, v1beta3 or uiv1beta3 versions may observe the following errors.
Error1: HTTP Mapping: 499 Client Closed Request (CANCELLED);
Error2: HTTP Mapping: 504 Gateway Timeout (DEADLINE_EXCEEDED)
Workaround: There is no known workaround at this time.
Summary: We are experiencing an issue with Cloud Interconnect in Chicago, USA
Description: We are experiencing an issue with Cloud Interconnect in Google Cloud Interconnect locations [“ord-zone1-7”] (https://cloud.google.com/network-connectivity/docs/interconnect/concepts/choosing-colocation-facilities#locations-table) in Chicago, USA. Mitigation work is currently underway by our engineering team.
**Our engineers have ascertained a mitigation to fix the issue in hand.**
At this time, we do not have an ETA for the completion of all the steps and processes involved.
**We will provide more information by Monday, 2023-12-04 21:00 US/Pacific.**
Please rest assured that our engineering teams are working diligently to mitigate all known impacts.
We sincerely appreciate your patience and understanding as we work to resolve it as quickly as possible.
Diagnosis: Affected customers will have non operating interconnects or interconnect attachments due to ongoing device repairs in the metro.
Workaround: Affected customers can reroute traffic using their redundant interconnect if available.
Summary: Inbound Forwarding zones may be unreachable
Description: Mitigation work is currently underway by our engineering team.
We do not have an ETA for mitigation at this point.
We will provide more information by Monday, 2023-12-04 19:00 US/Pacific.
Diagnosis: DNS resolution from on-prem clients to GCP seems to be interrupted when Cloud DNS inbound server policies are applied.
Workaround: * Customer can try moving "Cloud DNS Inbound forwarding" to the non-peered project. However, some customers can't edit their projects.
* Customers may also be able drain one of their VPN/Interconnect HA shards.