Arch Linux

Please read this before reporting a bug:
https://wiki.archlinux.org/title/Bug_reporting_guidelines

Do NOT report bugs when a package is just outdated, or it is in the AUR. Use the 'flag out of date' link on the package page, or the Mailing List.

REPEAT: Do NOT report bugs for outdated packages!
Tasklist

FS#56068 - {mirror} new tier2-mirror: arch.eckner.net

Attached to Project: Arch Linux
Opened by Erich Eckner (deepthought) - Saturday, 21 October 2017, 12:33 GMT
Last edited by Eli Schwartz (eschwartz) - Thursday, 04 January 2018, 04:40 GMT
Task Type Feature Request
Category Mirrors
Status Closed
Assigned To Florian Pritz (bluewind)
Architecture All
Severity Low
Priority Normal
Reported Version
Due in Version Undecided
Due Date Undecided
Percent Complete 100%
Votes 0
Private No

Details

Hi,

I'm running an archlinux mirror for some time now and I think, it should become public :-)

domain:
arch.eckner.net

location:
germany

urls:
http://arch.eckner.net
https://arch.eckner.net
rsync://arch.eckner.net/archlinux

bandwith:
100MBit (tested) upto 1GBit (claimed)

email:
arch-mirror@eckner.net

upstream tier1-mirror:
rsync://ftp.gwdg.de/pub/linux/archlinux/

question:
I added a few repositories to the mirror (quarry, archlinuxfr, archlinux32 for i686 packages, my own repository) - is this any problem? (I don't sync i686 packages anymore, but replace them with archlinux32's packages)

cheers, deep42thought
This task depends upon

Closed by  Eli Schwartz (eschwartz)
Thursday, 04 January 2018, 04:40 GMT
Reason for closing:  Implemented
Comment by Erich Eckner (deepthought) - Saturday, 21 October 2017, 12:34 GMT
ah, I forgot to mention archlinuxarm, which is also symlinked into the repositories.
Comment by Florian Pritz (bluewind) - Saturday, 21 October 2017, 17:50 GMT
Please put the additional repositories outside of our tree. I also don't mind if you put our tree into a subdirectory and we list the direct URL to that subdir.

Mixing multiple things could cause problems in the future and it also makes it much more difficult for others to sync from your mirror. I also assume that your mirror script needs a list of directories it syncs which may cause problems when we add additional repositories in the future. If you use multiple rsync calls you mirror will also not update atomically (well, what rsync calls atomic anyways) which may cause further issues.
Comment by Erich Eckner (deepthought) - Saturday, 21 October 2017, 18:18 GMT
The script has a list of repositroies it does not sync, but I see my approach may cause problems in the future (e.g. when you decide to open up a repository called "archlinuxfr"). I can/will move the arch mirror into a subdirectory (or a different url) and add symlinks on the current url/location to not break my setups.

What about i686 packages? Do I need to sync them, too? If "yes", do I still need to sync them after the deprecation in November? If still "yes", I would not like to publish a mirror - if "no", I'd like to wait until then.

Cheers, deep42thought
Comment by Florian Pritz (bluewind) - Saturday, 21 October 2017, 18:34 GMT
I expect that we will remove the i686 files, but I'm not sure if we discussed that anywhere yet. Keeping them around without maintaining them doesn't make sense though so we most likely will remove them soon.

If you are an official mirror, you should sync everything in our rsync tree (with the exceptions mentioned on the wiki page). So as long as i686 files are part of our tree, you should sync them. The total mirror size is something around 40-60GiB. Is that too big for you? In that case you might not want to host a mirror because large rebuilds can cause the repositories to roughly double in size so some additional disk space (maybe like 30-40GiB) should always be available.
Comment by Eli Schwartz (eschwartz) - Sunday, 22 October 2017, 02:46 GMT
Well, also the archlinuxfr repo is poison. :(

[eschwartz@arch ~]$ curl -I https://arch.eckner.net/quarry/os/quarry
[...]
Content-Type: application/octet-stream
Comment by Erich Eckner (deepthought) - Sunday, 22 October 2017, 11:06 GMT
Size is not really an issue, I just tried to exclude staff which is unnecessary, but I see your point - I'll change the mirror to sync everything, then. Give me a few days, I will restructure the directory tree on that server - as you might have noticed, it's a mess :-/

@eschwartz:
I already asked anatolik for an rsync endpoint for quarry. Once he provides that, I can remove the ugly wget-magic I implemented and skip all the index files.
What exactly don't you like about archlinuxfr?
Comment by Erich Eckner (deepthought) - Sunday, 22 October 2017, 13:26 GMT
@bluewind:
The vanilla arch mirror is now reachable under:
http://arch.eckner.net/archlinux/
https://arch.eckner.net/archlinux/
rsync://arch.eckner.net/archlinux/

In case, anyone is interested: I put the merged stuff in https://arch.eckner.net/merged/
Comment by Eli Schwartz (eschwartz) - Sunday, 22 October 2017, 14:34 GMT
archlinuxfr has a bad reputation due to providing binary packages for AUR helpers that circumvent the usual learning process for the AUR, and then compounds the issue by not being responsible about doing soname rebuilds in a timely manner. :D
One might question how useful it is in that case, even if you didn't have an automatic hatred just for the name...

As for quarry, I was just interested in the fact that I couldn't actually get to a listing for it, since the index that was loudly linked here: https://arch.eckner.net/quarry/os/ was being downloaded by my browser rather than being viewed... and also didn't seem to link anything properly anyway (but that's because the proper directory, x86_64 instead of quarry, isn't listed at all), so you should probably not keep that index file. But it seems to work under the merged directory. :)
Comment by Florian Pritz (bluewind) - Monday, 23 October 2017, 15:00 GMT
I've added the mirror, thank you!

I'll keep this open for a little longer in case you want to discuss the additional repos some more.

Loading...