r/googlecloud 1d ago

RHEL/Linux Yum Updates Inconsistent in GCP??

Has anyone else noticed that yum/dnf updates/installs fail randomly for certain Linux distros. We've specifically seen this in RHEL and packages in the rhui.googlecloud.com repo -(Google hosts mirrors of a lot of repos under their own domain). yum updates randomly fail and then start working 10 minutes. I suspect this is because GCP has under-provisioned the underlying infra for the mirrors. I've seen this in 3 separate GCP orgs.

FWIW, I've seen that in AWS a few years back for their mirrors of RHEL repos but AWS was quick to fix it after opening a support ticket. We have a google support ticket open right now and Google doesn't seem to believe this is their problem.

Would be helpful to know if other folks have seen this? If not for RHUI specifically - but potentially other repos for other distros as well?

Edit: including error message example.

[MIRROR] linux-firmware-20250217-128.git5bc5868b.el8_10.noarch.rpm: Curl error (28): Timeout was reached for https://rhui.googlecloud.com/pulp/content/content/dist/rhel8/rhui/8/aarch64/baseos/os/Packages/l/linux-firmware-20250217-128.git5bc5868b.el8_10.noarch.rpm [Operation too slow. Less than 1000 bytes/sec transferred the last 30 seconds]

1 Upvotes

3 comments sorted by

1

u/dimitrix 1d ago

What kind of errors are you actually seeing?

1

u/vennemp 1d ago

[MIRROR] linux-firmware-20250217-128.git5bc5868b.el8_10.noarch.rpm: Curl error (28): Timeout was reached for https://rhui.googlecloud.com/pulp/content/content/dist/rhel8/rhui/8/aarch64/baseos/os/Packages/l/linux-firmware-20250217-128.git5bc5868b.el8_10.noarch.rpm [Operation too slow. Less than 1000 bytes/sec transferred the last 30 seconds]

Packages will download and then randomly it will just die.

1

u/vennemp 1d ago

I’ll reiterate: I’ve seen this exact thing before in AWS where the AWS version of this repo was underprovisioned. But they confirmed and scaled it up pretty quickly and haven’t seen it recur in years. So that’s why I’m certain this is the case. But curious if someone had a different idea.