FS#58029 - [namcap] fails on a very large package

Attached to Project: Arch Linux
Opened by Anadon Aeroheart (anadon) - Thursday, 29 March 2018, 21:04 GMT
Last edited by Jelle van der Waa (jelly) - Friday, 11 August 2023, 15:51 GMT
Task Type Bug Report
Category Arch Projects
Status Closed
Assigned To Kyle Keen (keenerd)
Architecture All
Severity Low
Priority Normal
Reported Version
Due in Version Undecided
Due Date Undecided
Percent Complete 100%
Votes 2
Private No

Details

Description: When packaging unusually large files (240GB), namcap is unable to check the resulting package.


Additional info:
* namcap 3.2.7
* package takes at least 1.1TB to build, and I can't verify that the built package installs due to disk limits and no alternative testing machines.
* Largest file is about 240GB, with about 880GB is total.
* The disk uses BTRFS with transparent compression enabled, with ~1TB physical space left so the disk is not actually running out of space.

Steps to reproduce:
I've uploaded my example packages here:
* https://aur.archlinux.org/packages/pfam/
* https://aur.archlinux.org/packages/superfamily/
standard build procedure, but I highly suggest you modify your makepkg.conf to add '-T0' to the XZCOMPRESS variable. It takes over 110 CPU hours to compress.

The following output is generated:
[anadon@doge pfam]$ namcap pfam-31.0-1-any.pkg.tar.xz
xz: (stdout): Write error: No space left on device
Traceback (most recent call last):
File "/usr/lib/python3.6/runpy.py", line 193, in _run_module_as_main
"__main__", mod_spec)
File "/usr/lib/python3.6/runpy.py", line 85, in _run_code
exec(code, run_globals)
File "/usr/lib/python3.6/site-packages/namcap.py", line 250, in <module>
process_realpackage(package, active_modules)
File "/usr/lib/python3.6/site-packages/namcap.py", line 87, in process_realpackage
pkgtar = open_package(package)
File "/usr/lib/python3.6/site-packages/namcap.py", line 60, in open_package
if '.PKGINFO' not in tar.getnames():
File "/usr/lib/python3.6/tarfile.py", line 1766, in getnames
return [tarinfo.name for tarinfo in self.getmembers()]
File "/usr/lib/python3.6/tarfile.py", line 1758, in getmembers
self._load() # all members, we first have to
File "/usr/lib/python3.6/tarfile.py", line 2355, in _load
tarinfo = self.next()
File "/usr/lib/python3.6/tarfile.py", line 2288, in next
raise ReadError("unexpected end of data")
tarfile.ReadError: unexpected end of data

Given the nature of this problem, it is very hard for be to test more. The PKGBUILD script has been modified to reduce space used, and similar variants build, check, and install without issue but are all smaller.
This task depends upon

Closed by  Jelle van der Waa (jelly)
Friday, 11 August 2023, 15:51 GMT
Reason for closing:  Moved
Additional comments about closing:  https://gitlab.archlinux.org/pacman/namc ap/issues/49
Comment by Neko-san (Neko-san) - Friday, 19 May 2023, 21:17 GMT
I also have this issue with an archive that's about 15GBs (compressed) and about 143GBs uncompressed (the Unreal Engine AUR package, namely)
Comment by Buggy McBugFace (bugbot) - Tuesday, 08 August 2023, 19:11 GMT
This is an automated comment as this bug is open for more then 2 years. Please reply if you still experience this bug otherwise this issue will be closed after 1 month.

Loading...