FS#76134 - br.mirror.archlinux-br.org rate limiting too aggressive for normal system updates

Attached to Project: Arch Linux
Opened by Jonas Malaco Filho (jonasmalaco) - Friday, 07 October 2022, 14:23 GMT
Last edited by Arun Bahl (pitastrudl) - Thursday, 31 August 2023, 20:35 GMT
Task Type Bug Report
Category Mirrors
Status Closed
Assigned To Anton Hvornum (Torxed)
Architecture x86_64
Severity Low
Priority Low
Reported Version
Due in Version Undecided
Due Date 2023-03-10
Percent Complete 100%
Votes 0
Private No

Details

Description: br.mirror.archlinux-br.org rate limiting results in normal system updates failing to complete.

The example bellow shows a rather large set of packages to be updated (as I've been away for a few days), but even day-to-day updates, when they are a bit larger, can show these errors.

# pacman -Syu
[ ... ]
Total ( 45/211) 9.9 MiB 9.02 MiB/s 00:01 [-----------------------------------] 100%
error: failed retrieving file 'jupyter-nbclient-0.7.0-1-any.pkg.tar.zst.sig' from br.mirror.archlinux-br.org : The requested URL returned error: 403
error: failed retrieving file 'haskell-syb-0.7.2.2-4-x86_64.pkg.tar.zst.sig' from br.mirror.archlinux-br.org : The requested URL returned error: 403
error: failed retrieving file 'haskell-blaze-markup-0.8.2.8-93-x86_64.pkg.tar.zst' from br.mirror.archlinux-br.org : The requested URL returned error: 403
warning: too many errors from br.mirror.archlinux-br.org, skipping for the remainder of this transaction
error: failed retrieving file 'ruby-json-2.6.2-2-x86_64.pkg.tar.zst.sig' from br.mirror.archlinux-br.org : The requested URL returned error: 403
warning: failed to retrieve some files
error: failed to commit transaction (unexpected error)
Errors occurred, no packages were upgraded.

While the output from pacman suggests some attempt to workaround the sudden failure of the mirror, the entire operation ends being cancelled. If the mirror is not removed from the mirrorlist, many attempts are necessary to complete the system update.

On the other hand, manually removing mirrors is not ergonomic, especially in regions where there's significant benefit in regularly (and automatically) using mirror statuses and rankmirrors to improve update times.

Additional info:
* package version(s): pacman 6.0.1-8
* mirrorlist: generated for my location, then ranked and capped at 4 (this almost always places br.mirror.archlinux-br.org at the top)
* ParallelDownloads: 4 (I normally use more, but I went as low as 4, still with no effect)

Steps to reproduce:
* set up a mirrorlist with br.mirror.archlinux-br.org at the top;
* run pacman -Syu when there are more than a handful of packages to update.
This task depends upon

Closed by  Arun Bahl (pitastrudl)
Thursday, 31 August 2023, 20:35 GMT
Reason for closing:  No response
Additional comments about closing:  Contacted admins again and disabled the mirror.
Comment by Anton Hvornum (Torxed) - Sunday, 19 February 2023, 16:37 GMT
I've contacted the mirror maintainer requesting a less restrictive rate limiting.
Comment by Anton Hvornum (Torxed) - Saturday, 04 March 2023, 16:33 GMT
Ping:ed the admin contacts again.
This time with a friendly reminder that I will mark the mirror as inactive if we don't hear from them.

I'm giving them another week.

Loading...