Arch Linux

Please read this before reporting a bug:
https://wiki.archlinux.org/title/Bug_reporting_guidelines

Do NOT report bugs when a package is just outdated, or it is in the AUR. Use the 'flag out of date' link on the package page, or the Mailing List.

REPEAT: Do NOT report bugs for outdated packages!
Tasklist

FS#14619 - update mirrors before package list

Attached to Project: Arch Linux
Opened by Caleb Cushing (xenoterracide) - Thursday, 07 May 2009, 15:00 GMT
Last edited by Andrea Scarpino (BaSh) - Sunday, 21 June 2009, 10:21 GMT
Task Type Feature Request
Category Packages: Core
Status Closed
Assigned To Dan McGee (toofishes)
Architecture All
Severity Very Low
Priority Normal
Reported Version
Due in Version Undecided
Due Date Undecided
Percent Complete 100%
Votes 0
Private No

Details

Description:

I frequently can't complete -Syu on first try (I've seen this twice in a week) because the packages haven't propagated to the mirrors yet. It would be nice if the packages would propagate before the file that tells which are available. even if it was more like 99% effective to hit all mirrors by guessing a best amount of time before pushing the updated list. below is the full output of my -Syu like an hour after first try. It's annoying that kde couldn't have moved around all these mirrors so long before qt.

:: Synchronizing package databases...
core is up to date
extra is up to date
community is up to date
:: Starting full system upgrade...
resolving dependencies...
looking for inter-conflicts...

Targets (34): kernel-headers-2.6.29.1-1 glibc-2.9-7 binutils-2.19.1-2
gcc-libs-4.4.0-1 ppl-0.10.2-2 cloog-ppl-0.15.3-1 gcc-4.4.0-1
jfsutils-1.1.14-1 kdelibs-4.2.3-1 kdeaccessibility-4.2.3-1
kdebase-runtime-4.2.3-1 kdepimlibs-4.2.3-2 kdebindings-4.2.3-1
kdeadmin-4.2.3-2 kdebase-workspace-4.2.3-1 kdeartwork-4.2.3-1
kdebase-4.2.3-1 kdeedu-4.2.3-1 qt-4.5.1-2 qca-2.0.2-1
kdegames-4.2.3-1 kdegraphics-4.2.3-1 kdemultimedia-4.2.3-1
qca-ossl-2.0.0-1 kdenetwork-4.2.3-3 kdepim-4.2.3-2
kdeplasma-addons-4.2.3-1 kdesdk-4.2.3-1 kdetoys-4.2.3-1
kdeutils-4.2.3-2 kdewebdev-4.2.3-1 openoffice-base-3.1.0-1
psmisc-22.6-2.1 sysvinit-2.86-5

Total Download Size: 28.02 MB
Total Installed Size: 1297.38 MB

Proceed with installation? [Y/n] Y
:: Retrieving packages from extra...
error: failed retrieving file 'qt-4.5.1-2-x86_64.pkg.tar.gz' from mirror.cs.vt.edu : File unavailable (e.g., file not found, no access)
error: failed retrieving file 'qt-4.5.1-2-x86_64.pkg.tar.gz' from mirror.archlinux.com.ve : Not Found
error: failed retrieving file 'qt-4.5.1-2-x86_64.pkg.tar.gz' from archlinux.unixheads.org : Not Found
error: failed retrieving file 'qt-4.5.1-2-x86_64.pkg.tar.gz' from mirrors.easynews.com : File unavailable (e.g., file not found, no access)
error: failed retrieving file 'qt-4.5.1-2-x86_64.pkg.tar.gz' from ftp.gtlib.gatech.edu : File unavailable (e.g., file not found, no access)
error: failed retrieving file 'qt-4.5.1-2-x86_64.pkg.tar.gz' from mirrors.hosef.org : File unavailable (e.g., file not found, no access)
error: failed retrieving file 'qt-4.5.1-2-x86_64.pkg.tar.gz' from ftp.gigabit.nu : File unavailable (e.g., file not found, no access)
error: failed retrieving file 'qca-2.0.2-1-x86_64.pkg.tar.gz' from mirror.cs.vt.edu : File unavailable (e.g., file not found, no access)
error: failed retrieving file 'qca-2.0.2-1-x86_64.pkg.tar.gz' from mirror.archlinux.com.ve : Not Found
error: failed retrieving file 'qca-2.0.2-1-x86_64.pkg.tar.gz' from archlinux.unixheads.org : Not Found
error: failed retrieving file 'qca-2.0.2-1-x86_64.pkg.tar.gz' from mirrors.easynews.com : File unavailable (e.g., file not found, no access)
error: failed retrieving file 'qca-2.0.2-1-x86_64.pkg.tar.gz' from ftp.gtlib.gatech.edu : File unavailable (e.g., file not found, no access)
error: failed retrieving file 'qca-2.0.2-1-x86_64.pkg.tar.gz' from mirrors.hosef.org : File unavailable (e.g., file not found, no access)
error: failed retrieving file 'qca-2.0.2-1-x86_64.pkg.tar.gz' from ftp.gigabit.nu : File unavailable (e.g., file not found, no access)
error: failed retrieving file 'qca-ossl-2.0.0-1-x86_64.pkg.tar.gz' from mirror.cs.vt.edu : File unavailable (e.g., file not found, no access)
error: failed retrieving file 'qca-ossl-2.0.0-1-x86_64.pkg.tar.gz' from mirror.archlinux.com.ve : Not Found
error: failed retrieving file 'qca-ossl-2.0.0-1-x86_64.pkg.tar.gz' from archlinux.unixheads.org : Not Found
error: failed retrieving file 'qca-ossl-2.0.0-1-x86_64.pkg.tar.gz' from mirrors.easynews.com : File unavailable (e.g., file not found, no access)
error: failed retrieving file 'qca-ossl-2.0.0-1-x86_64.pkg.tar.gz' from ftp.gtlib.gatech.edu : File unavailable (e.g., file not found, no access)
error: failed retrieving file 'qca-ossl-2.0.0-1-x86_64.pkg.tar.gz' from mirrors.hosef.org : File unavailable (e.g., file not found, no access)
error: failed retrieving file 'qca-ossl-2.0.0-1-x86_64.pkg.tar.gz' from ftp.gigabit.nu : File unavailable (e.g., file not found, no access)
warning: failed to retrieve some files from extra
error: failed to commit transaction (unexpected error)
Errors occurred, no packages were upgraded.
This task depends upon

Closed by  Andrea Scarpino (BaSh)
Sunday, 21 June 2009, 10:21 GMT
Reason for closing:  Not a bug
Comment by Gerardo Exequiel Pozzi (djgera) - Sunday, 31 May 2009, 03:17 GMT
Or can view this issue in how to mirrors update the repos :)

If mirrors first delete the old packages, and then update to new, there is a problem if maintain the old file database.
If mirrors first update the new packages, and then delete the olds, and finally update the database. "No issues".

Or others scenarios ;)

Comment by Roman Kyrylych (Romashka) - Sunday, 31 May 2009, 11:30 GMT
Exactly. This can be solved by modifying mirrors' update scripts to first rsync everything except *.db.tar.gz and then sync db files,
(though there can still be a small chance that some db file gets updated while new files are synced == some new package file gets referrenced in new db file, but the file won't be synced)
and to always keep old files until full sync is done.

FTR, there is a script on http://wiki.archlinux.org/index.php/Local_Mirror page that was intended for use by mirrors, but besides modifying that script to implement this FR, IMHO there is little that we can do to make sure all mirrors are using one consistent sync process (I'm quite sure many just use simple rsync one-liner to mirror everything).

Loading...