Community Packages

Please read this before reporting a bug:
https://wiki.archlinux.org/title/Bug_reporting_guidelines

Do NOT report bugs when a package is just outdated, or it is in the AUR. Use the 'flag out of date' link on the package page, or the Mailing List.

REPEAT: Do NOT report bugs for outdated packages!
Tasklist

FS#26893 - [duplicity] missing dependency

Attached to Project: Community Packages
Opened by Byron Clark (byronc) - Monday, 14 November 2011, 21:19 GMT
Last edited by Andrea Scarpino (BaSh) - Monday, 28 November 2011, 08:21 GMT
Task Type Bug Report
Category Packages
Status Closed
Assigned To Lukas Fleischer (lfleischer)
Kaiting Chen (kaitocracy)
Architecture All
Severity High
Priority Normal
Reported Version
Due in Version Undecided
Due Date Undecided
Percent Complete 100%
Votes 1
Private No

Details

After updating to duplicity 0.6.16-1 I am unable to backup to Amazon S3. Here's the error I see:
User error detail: Traceback (most recent call last):
File "/usr/bin/duplicity", line 1347, in <module>
with_tempdir(main)
File "/usr/bin/duplicity", line 1330, in with_tempdir
fn()
File "/usr/bin/duplicity", line 1190, in main
action = commandline.ProcessCommandLine(sys.argv[1:])
File "/usr/lib/python2.7/site-packages/duplicity/commandline.py", line 983, in ProcessCommandLine
backup, local_pathname = set_backend(args[0], args[1])
File "/usr/lib/python2.7/site-packages/duplicity/commandline.py", line 876, in set_backend
globals.backend = backend.get_backend(bend)
File "/usr/lib/python2.7/site-packages/duplicity/backend.py", line 154, in get_backend
raise UnsupportedBackendScheme(url_string)
UnsupportedBackendScheme: scheme not supported in url: s3+http://bucket/path

Additional info:
* duplicity-0.6.16-1

The problem is that duplicity added a dependency on FileChunkIO (http://pypi.python.org/pypi/filechunkio/1.5) to the boto backend in 0.6.16. It appears that FileChunkIO isn't yet packaged for ArchLinux.
This task depends upon

Closed by  Andrea Scarpino (BaSh)
Monday, 28 November 2011, 08:21 GMT
Reason for closing:  Fixed
Additional comments about closing:  duplicity 0.6.17-1
Comment by Byron Clark (byronc) - Tuesday, 15 November 2011, 21:35 GMT
If it helps at all, I just packaged filechunkio for the AUR (https://aur.archlinux.org/packages.php?ID=54020). Unfortunately, duplicity is complaining about corruption when using it.
Comment by Jason Chu (jason) - Wednesday, 16 November 2011, 23:04 GMT
There is a patch to 0.6.16 to fix that bug: https://bugs.launchpad.net/duplicity/+bug/871875

Applying it and having filechunkio installed makes everything better.
Comment by Lukas Fleischer (lfleischer) - Friday, 18 November 2011, 08:10 GMT
So, moving python2-filechunkio to [community], adding it as a dependency and cherry-picking commit 801 [1] should work?

[1] http://bazaar.launchpad.net/~duplicity-team/duplicity/0.6-series/diff/801
Comment by Jason Chu (jason) - Friday, 18 November 2011, 08:15 GMT
Actually, from what I can tell, they included the filechunkio dep in the patch. It seems like just cherrypicking the patch without filechunkio should work. At least, it includes all the parts that I needed to get it to work.
Comment by Lukas Fleischer (lfleischer) - Friday, 18 November 2011, 08:44 GMT
I created a package [1], [2] that is built with the aforementioned patch. Please test.

[1] http://cryptocrack.de/tmp/duplicity-0.6.16-2-i686.pkg.tar.xz
[2] http://cryptocrack.de/tmp/duplicity-0.6.16-2-x86_64.pkg.tar.xz
Comment by Byron Clark (byronc) - Friday, 18 November 2011, 16:08 GMT
I'm seeing this error using the test packages:

Uploading s3+http://duplicity/backup/byron/duplicity-inc.20111115T214910Z.to.20111118T155817Z.vol1.difftar.gpg to STANDARD Storage
Upload 's3+http://duplicity/backup/byron/duplicity-inc.20111115T214910Z.to.20111118T155817Z.vol1.difftar.gpg' failed (attempt #1, reason: BackendException: Multipart upload failed. Aborted.)
Uploading s3+http://duplicity/backup/byron/duplicity-inc.20111115T214910Z.to.20111118T155817Z.vol1.difftar.gpg to STANDARD Storage
Upload 's3+http://duplicity/backup/byron/duplicity-inc.20111115T214910Z.to.20111118T155817Z.vol1.difftar.gpg' failed (attempt #2, reason: BackendException: Multipart upload failed. Aborted.)
Uploading s3+http://duplicity/backup/byron/duplicity-inc.20111115T214910Z.to.20111118T155817Z.vol1.difftar.gpg to STANDARD Storage
Upload 's3+http://duplicity/backup/byron/duplicity-inc.20111115T214910Z.to.20111118T155817Z.vol1.difftar.gpg' failed (attempt #3, reason: BackendException: Multipart upload failed. Aborted.)
Uploading s3+http://duplicity/backup/byron/duplicity-inc.20111115T214910Z.to.20111118T155817Z.vol1.difftar.gpg to STANDARD Storage
Upload 's3+http://duplicity/backup/byron/duplicity-inc.20111115T214910Z.to.20111118T155817Z.vol1.difftar.gpg' failed (attempt #4, reason: BackendException: Multipart upload failed. Aborted.)
Uploading s3+http://duplicity/backup/byron/duplicity-inc.20111115T214910Z.to.20111118T155817Z.vol1.difftar.gpg to STANDARD Storage
Upload 's3+http://duplicity/backup/byron/duplicity-inc.20111115T214910Z.to.20111118T155817Z.vol1.difftar.gpg' failed (attempt #5, reason: BackendException: Multipart upload failed. Aborted.)
Giving up trying to upload s3+http://duplicity/backup/byron/duplicity-inc.20111115T214910Z.to.20111118T155817Z.vol1.difftar.gpg after 5 attempts
Backend error detail: Traceback (most recent call last):
File "/usr/bin/duplicity", line 1347, in <module>
with_tempdir(main)
File "/usr/bin/duplicity", line 1330, in with_tempdir
fn()
File "/usr/bin/duplicity", line 1312, in main
incremental_backup(sig_chain)
File "/usr/bin/duplicity", line 540, in incremental_backup
globals.backend)
File "/usr/bin/duplicity", line 368, in write_multivol
(tdp, dest_filename, vol_num)))
File "/usr/lib/python2.7/site-packages/duplicity/asyncscheduler.py", line 145, in schedule_task
return self.__run_synchronously(fn, params)
File "/usr/lib/python2.7/site-packages/duplicity/asyncscheduler.py", line 171, in __run_synchronously
ret = fn(*params)
File "/usr/bin/duplicity", line 367, in <lambda>
async_waiters.append(io_scheduler.schedule_task(lambda tdp, dest_filename, vol_num: put(tdp, dest_filename, vol_num),
File "/usr/bin/duplicity", line 292, in put
backend.put(tdp, dest_filename)
File "/usr/lib/python2.7/site-packages/duplicity/backends/botobackend.py", line 239, in put
raise BackendException("Error uploading %s/%s" % (self.straight_url, remote_filename))
BackendException: Error uploading s3+http://duplicity/backup/byron/duplicity-inc.20111115T214910Z.to.20111118T155817Z.vol1.difftar.gpg

BackendException: Error uploading s3+http://duplicity/backup/byron/duplicity-inc.20111115T214910Z.to.20111118T155817Z.vol1.difftar.gpg
Comment by Jason Chu (jason) - Friday, 18 November 2011, 18:44 GMT
I am seeing the same error. I'm not sure if there's another patch later on that fixes this one, but something else in that patch is causing this problem.
Comment by Lukas Fleischer (lfleischer) - Sunday, 20 November 2011, 19:44 GMT
Can you reproduce that behavior with current -bzr (`bzr branch lp:duplicity` from LaunchPad)? If so, please report this bug upstream.
Comment by Byron Clark (byronc) - Tuesday, 22 November 2011, 15:28 GMT
Backups work correctly with current -bzr.
Comment by Lukas Fleischer (lfleischer) - Wednesday, 23 November 2011, 15:02 GMT
Hm, right... It would be amazing if you could bisect the commit that fixes the error. I can't reproduce that bug myself, unfortunately.
Comment by Lukas Fleischer (lfleischer) - Saturday, 26 November 2011, 14:35 GMT
Fixed in 0.6.17-1?
Comment by Jason Chu (jason) - Sunday, 27 November 2011, 22:41 GMT
Yes, it seems to be fixed in 0.6.17.

Loading...