Arch Linux

Please read this before reporting a bug:
https://wiki.archlinux.org/title/Bug_reporting_guidelines

Do NOT report bugs when a package is just outdated, or it is in the AUR. Use the 'flag out of date' link on the package page, or the Mailing List.

REPEAT: Do NOT report bugs for outdated packages!
Tasklist

FS#60784 - HTTPS mirror "mirror.fra10.de.leaseweb.net" intermitten outages

Attached to Project: Arch Linux
Opened by Gima (gima) - Monday, 12 November 2018, 21:48 GMT
Last edited by Florian Pritz (bluewind) - Saturday, 22 December 2018, 09:54 GMT
Task Type Bug Report
Category Mirrors
Status Closed
Assigned To Florian Pritz (bluewind)
Architecture x86_64
Severity Medium
Priority Normal
Reported Version
Due in Version Undecided
Due Date Undecided
Percent Complete 100%
Votes 2
Private No

Details

# Description

Mirror: https://mirror.fra10.de.leaseweb.net/archlinux/$repo/os/$arch

The mirror in question is unresponsive randomly. It's happened many times during the last ~three days, and still does. Re-running `pacman -Syu` a few times usually causes the mirror to respond.

Corroborative evidence: Another user reported the same, so I'm not the only one seeing this (https://bbs.archlinux.org/viewtopic.php?pid=1816365).


# Encountered error / Steps to reproduce

$ pacman -Syu

Error during pacman operations:
[code]
error: failed retrieving file 'extra.db' from mirror.fra10.de.leaseweb.net : Operation too slow. Less than 1 bytes/sec transferred the last 10 seconds
[/code]


# Files

mirrorlist:
Server = https://mirror.fra10.de.leaseweb.net/archlinux/$repo/os/$arch
This task depends upon

Closed by  Florian Pritz (bluewind)
Saturday, 22 December 2018, 09:54 GMT
Reason for closing:  Fixed
Additional comments about closing:  curl 7.63.0-2
Comment by Florian Pritz (bluewind) - Tuesday, 13 November 2018, 09:01 GMT
Our checks[1] don't seem to have any issues, but they only fetch the 'lastsync' file which is quite small. If the problem happens again, can you run `mtr --report --report-wide --show-ips --report-cycles 100 mirror.fra10.de.leaseweb.net` and then try downloading again?

I'll try to reproduce it myself, but I can't promise anything and without more information there is no point in telling leaseweb.

[1] https://www.archlinux.org/mirrors/leaseweb.net/1039/
Comment by Florian Pritz (bluewind) - Thursday, 15 November 2018, 09:43 GMT
I'm afraid I haven't been able to reproduce this problem yet. Do you still have issues with that mirror and if so, can you try to fetch the file from a different network/server/cloud vm at the time you are experiencing problems? I'm guessing that this may be an issue with your internet provider.
Comment by Gima (gima) - Thursday, 15 November 2018, 22:29 GMT
The problem still persist. I've updated my system around four times since reporting this, and I've encountered this problem twice. Trying to reach the same URL with curl on another network connection, works, but so does the pacman operation after Ctrl+C and re-running it. As said, it is intermitten.

I assume other mirrors work fine, because: The first time that this problem reared it's head, I changed to another mirror, and there were no problems. After changing back to using the fastest mirror (which happened to be this problematic mirror), the problem reared it's head again (hence, this bug report).

Regarding "it could be a problem with my ISP": Could be. Though I doubt it, since another person experienced the same error message with the same mirror (in the forum post that I linked to). Unless that person is in the same country as me (Finland) and has the same operator as me (Telia) and happens to be in the same network infrastructure segment or something similar. Too many conditions that should be true if you ask me.

As to what this problem could be?
My guess: The said mirror has front cache and backend servers(s). Uncached files are server from a backend server and then cached. Thus when someone has requested a file, it is cached, and everyone receives the file from the cache (the cache works correctly). I'd guess the backend server / one of the backend servers doesn't work 100% correctly (full memory? disk failing? who-knows-what).


Comment by Marcin Woźniak (jaqu3PL) - Friday, 16 November 2018, 08:20 GMT
You should use "sudo reflector --verbose -l 5 -p http --sort rate --save /etc/pacman.d/mirrorlist".
This command will update your mirrorlist with the best answer from the server.
If You want to have country "sudo reflector --country XXXX --verbose -l 5 -p http --sort rate --save /etc/pacman.d/mirrorlist".
Comment by Florian Pritz (bluewind) - Thursday, 06 December 2018, 16:40 GMT
Finally I'm also seeing this on one of our servers. I'll ask leaseweb about it.
Comment by Florian Pritz (bluewind) - Monday, 17 December 2018, 14:14 GMT
Qucik status update: Leaseweb replied that they do not use a cache on their server, but they can reproduce the issue with HTTPS. HTTP works fine and they'll investigate further.
Comment by Bert Peters (bertptrs) - Monday, 17 December 2018, 14:47 GMT
The same issue also plagues the Dutch leaseweb mirror: https://mirror.ams1.nl.leaseweb.net/archlinux/$repo/os/$arch

All symptoms are the same as described for the German mirror.
Comment by Florian Pritz (bluewind) - Wednesday, 19 December 2018, 10:46 GMT
This appears to be an issue with HTTP/2 and libcurl/pacman. I've filed a bug with curl for starters: https://github.com/curl/curl/issues/3392
Comment by Florian Pritz (bluewind) - Wednesday, 19 December 2018, 14:28 GMT
Leaseweb has disabled http/2 support on the fra10 mirror so you should no longer see issues there. I've asked them to keep it enabled on ams1 for now so that we have a server to test the fix with.
Comment by Florian Pritz (bluewind) - Thursday, 20 December 2018, 11:50 GMT
Fixed in curl 7.63.0-2 in [testing]

Loading...