FS#17358 - Provide aur.archlinux.org/packages/ again

Attached to Project: AUR web interface
Opened by xduugu (xduugu) - Thursday, 03 December 2009, 08:53 GMT
Last edited by Lukas Fleischer (lfleischer) - Thursday, 20 January 2011, 19:40 GMT
Task Type Feature Request
Category Backend
Status Closed
Assigned To Loui Chang (louipc)
Architecture All
Severity Medium
Priority Normal
Reported Version 1.6.0
Due in Version Undecided
Due Date Undecided
Percent Complete 100%
Votes 8
Private No

Details

I'd love to see the index page at aur.archlinux.org/packages/ again because I need a list of all packages with their corresponding last update time to be able to generate and update my aur pacman database[1]. Unfortunately, there is no other good possibility to get this information.
For further details, please have a look at [2].

[1] http://bbs.archlinux.org/viewtopic.php?id=65501
[2] http://bbs.archlinux.org/viewtopic.php?id=85915
This task depends upon

Closed by  Lukas Fleischer (lfleischer)
Thursday, 20 January 2011, 19:40 GMT
Reason for closing:  Won't implement
Additional comments about closing:  Won't implement. See last comment for alternatives.
Comment by Jon Nordby (jonnor) - Monday, 14 December 2009, 12:47 GMT
I also need this functionality (or a way to achieve the same).
Comment by Laszlo Papp (djszapi) - Tuesday, 15 December 2009, 05:55 GMT
Yeah, I used it too in some cases, e.g. when I wrote aur command line helper, and in other cases too to get informations in this format, but maybe I can solve it another way.
Comment by xduugu (xduugu) - Wednesday, 30 December 2009, 01:03 GMT
Any chance to get the index re-enabled anytime soon (or at least a comment from one of the server admins)?
Comment by Loui Chang (louipc) - Friday, 12 March 2010, 21:01 GMT
The directory listing was never meant to be an interface to the AUR.
You should be using the web or json interfaces.

Also that listing is an innaccurate reflection of the packages currently in the AUR.
If you can actually justify the need to have a listing of all packages in the AUR, maybe we can work to fix this.
Comment by xduugu (xduugu) - Sunday, 18 April 2010, 19:43 GMT
As I wrote in the second linked thread, I need it to build a pacman database of the aur. I know that it was never meant as an interface and that it also contained removed packages (see  FS#17195 ), but it was the best option the get a list of all package names and their last update time.

Actually, there are two issues that prevent me from using the json interface, which is a) it is not possible to get a full list of package names and b) the response does not include the last update time. The latter is not that important, though, but it's nice to have because otherwise you have to check all the Last-Modified entry of the http headers.

So crawling the web pages is currently the only option but I do not like it because it generates much traffic and load on the server: First I have to get the package names which means parsing ~ 200 search result pages containing 100 package names each and after that you need one connection per package which means another 21500 connections to the server.

I do not know if my application is a valid reason to provide such a list and the only other application I know that used this page is aur-sync[1].

[1] http://aur.archlinux.org/packages.php?ID=5920
Comment by Jon Nordby (jonnor) - Sunday, 18 April 2010, 22:32 GMT
My usecase is very similar to xduudus, I want to make a tool that builds packages from abs and aur, by letting aur be represented in the same way as abs on disk locally (when using the "abs" cli tool). Its also governed by the same two requirements, a) and b)

An rsync interface would be perfect for my usecase, but the way it was before works almost just as well.
Comment by xduugu (xduugu) - Thursday, 24 June 2010, 12:27 GMT
Any decision made yet?
Comment by Lukas Fleischer (lfleischer) - Thursday, 20 January 2011, 18:49 GMT
We're probably not gonna provide this anymore. Especially, since tarballs are no longer extracted as of 1.8.0 [1]. If you want to build a list of AUR packages, you might wanna have a look at aurdupes [2] or my AUR package list [3] (which doesn't contain info about the update time tho).

[1] http://projects.archlinux.org/aur.git/commit/?id=ec0dfc27deb246ee7d7f19fd5290e499805869d2
[2] http://git.cryptocrack.de/aurdupes.git/
[3] http://cryptocrack.de/files/aurpkglist.txt.gz

Loading...