FS#19969 - pacman download issues from googlecode.com domain

Attached to Project: Pacman
Opened by Weng Xuetian (csslayer) - Friday, 25 June 2010, 09:55 GMT
Last edited by Allan McRae (Allan) - Friday, 16 July 2010, 03:40 GMT
Task Type Bug Report
Category General
Status Closed
Assigned To No-one
Architecture All
Severity Low
Priority Normal
Reported Version 3.4.0
Due in Version Undecided
Due Date Undecided
Percent Complete 100%
Votes 0
Private No

Details

Description:
I use google code to create a personal repo, which repo settings is
[csslayer-aur-repo]
Server=http://csslayer-aur-repo.googlecode.com/files
I can use this repo for older pacman, and if I use Xfercommand, like wget to download, it works well.


Additional info:
pacman 3.4.0

Steps to reproduce:
1. add this repo to pacman.conf
2. -Syu
3. shows 404 not found csslayer-aur-repo.db.tar.gz
This task depends upon

Closed by  Allan McRae (Allan)
Friday, 16 July 2010, 03:40 GMT
Reason for closing:  Not a bug
Additional comments about closing:  Issue is the server at googlecode.com
Comment by Allan McRae (Allan) - Friday, 25 June 2010, 10:16 GMT
Post some --debug output.
Comment by Allan McRae (Allan) - Friday, 25 June 2010, 10:18 GMT
I just tested by adding that repo to my pacman.conf and it downloaded without an issues.
Comment by Weng Xuetian (csslayer) - Saturday, 26 June 2010, 06:59 GMT
pacman -Syu --verbose --debug
http://aur.pastebin.com/3dv6gA22

my pacman.conf

http://aur.pastebin.com/SwwNbwPq
Comment by Allan McRae (Allan) - Saturday, 26 June 2010, 07:26 GMT
I copied you setup for that server and all worked well... Can you "ping csslayer-aur-repo.googlecode.com"?
Comment by Weng Xuetian (csslayer) - Saturday, 26 June 2010, 08:01 GMT
As you can see, it will works if I use wget to download (uncomment the Xfercommand with wget), so I think it's not network problem.

You can see the comment below from http://aur.archlinux.org/packages.php?ID=32598, it also happened to others...
Comment by Bartek Iwaniec (hash) - Tuesday, 29 June 2010, 15:10 GMT
I can confirm this bug. I get 404 not found csslayer-aur-repo.db.tar.gz. Wget/Curl (Xfercommand) works just fine.
Comment by Xavier (shining) - Saturday, 03 July 2010, 13:30 GMT
I cannot reproduce either.

Can you post output of wget -d http://csslayer-aur-repo.googlecode.com/files/csslayer-aur-repo.db.tar.gz ?

And also compile the attached test case with : gcc -o dload dload-db.c -lfetch
Then run ./dload
   dload-db.c (0.3 KiB)
Comment by Bartek Iwaniec (hash) - Saturday, 03 July 2010, 13:37 GMT
It's kinda weird on the first run wget -d http://csslayer-aur-repo.googlecode.com/files/csslayer-aur-repo.db.tar.gz couldn't get file, but on another try it downloaded it succesfully. Same thing for ./dload.
   wget1.log (1.3 KiB)
   wget2.log (1.5 KiB)
   dload.log (0.2 KiB)
   dload2.log (0.2 KiB)
Comment by Xavier (shining) - Saturday, 03 July 2010, 21:26 GMT
google URLs usually resolve to multiple ips to share the load, it's the case here. It seems you are unlucky to have it resolved to 209.85.135.82 which indeed does not contain the file. In the second case, it used another ip, which worked.

There are two direct workarounds for this :
1) put an ip that works directly in pacman.conf Server line
2) use /etc/hosts to pick that ip

Anyway this has strictly nothing to do with pacman, and it's good you noticed you could reproduce with wget as well :)
You might want to report the problem to google.
Comment by Bartek Iwaniec (hash) - Sunday, 04 July 2010, 08:36 GMT
Yup, you're right that seems to be the issue.
What i wonder is why this problem appeared after upgrading pacman to 3.4 (or is just coincidence). Have pacman 3.3 tried to download db file again if an error occured?
Comment by Xavier (shining) - Sunday, 04 July 2010, 09:50 GMT
I assumed it was just a coincidence. Can you try to downgrade to 3.3 and see if you can reproduce? Use --debug to make sure it works and actually downloads the file.
Comment by Allan McRae (Allan) - Thursday, 08 July 2010, 04:49 GMT
So we can close this as "Not a Bug"? Given wget is also failing it is definitely a server side issue.
Comment by Bartek Iwaniec (hash) - Monday, 26 July 2010, 17:14 GMT
I've added a line to /etc/hosts and now wget always uses the server with IP specified in /etc/hosts and successfully downloads csslayer-aur-repo.db.tar.gz, however pacman still fails to download database.
Comment by Weng Xuetian (csslayer) - Tuesday, 27 July 2010, 08:47 GMT
Is that refer to user agent?

Loading...