Welcome, Guest. Please login or register.

Author Topic: AmiGet - Aptitude like app for aminet  (Read 8646 times)

Description:

0 Members and 1 Guest are viewing this topic.

Offline cgutjahr

  • Hero Member
  • *****
  • Join Date: Feb 2003
  • Posts: 692
  • Country: 00
    • Show all replies
Re: AmiGet - Aptitude like app for aminet
« on: January 23, 2017, 06:04:49 PM »
Just so nobody gets confused: This is an official Aminet statement.

Quote

Read and search INDEX [...] Download and search full .readme files for potential matches.

INDEX is close to 7 MB right now, not sure what kind of target audience you have in mind? Downloading a 7 MB file every time you run the application won't be fun on an Amiga. Not to mention the amount of memory searching this file would require.

People downloading 81000 readmes because they want to search something? That's a no-go.

Plus, you'd have to implement a mechanism to make sure the local copy stays up to date. A quick look into our changelog will show you that we're constantly cleaning up the archive and/or the directory tree, or adding new files which won't show up in RECENT.

A much more sensible approach would be to actually ask us for ideas. Here's one: We expand the existing search engine so it displays results in some machine readable format (TSV?, JSON?) and external clients use that instead: they simply download aminet.net/json/some_search_string via HTTP and parse it.

Providing a downloadable version of the entire database would be another option, of course - but not for an Amiga based solution, obviously.

I was planning a new Aminet client anyway (and searching a coder for that job), but a graphical one. For CLI access, there's ADT (Aminet Download Tool) - a console FTP client with some extras (display recent, display directory listings in Aminet format, search for filenames and descriptions).

Most if not all GUI FTP clients on the Amiga cloned these features aswell, so IMHO instead of reinventing the wheel, a better idea might be to update ADT (it doesn't compile on Unix systems anymore, IIRC) and get the search daemon on Aminet (written in Python and C) running again - that way, all Amiga FTP clients would benefit.

But tbh, I don't see the need for a console based client anymore.

Quote

Unpack archive (requires lots of extras to be able to do this on the Amiga. LhA, LZX, UnRar, UnZip, XPK, etc)

No, that actually only requires the XAD library system. Aminet doesn't support RAR or LZX anyway.

Quote

I haven't decided where, but it should also be able to eventually read a dependencies file from someplace that will reach out and grab dependencies for a given archive.

This already exists, there's a 68k port of Grunch - and it's completely dead, because maintaining the database is both a nightmare and a lot of work. The MorphOS database used to be (still is?) quite up to date, but there's simply not enough interest on 68k anymore.

Here's what I had in mind, the target audience being Amigas with moderate to low specs and some form of network access:

  • graphical client, running on its own screen, mimicking the web interface
  • features: Recent, directory browsing, view readmes, simple/advanced search, download one file at a time
  • communicate with aminet.net using HTTP connections
  • use minimal resources (RAM, Chipset, GUI elements) to make sure you're compatible with as many setups as possible
  • try to stay compatible with 1.x (even if there's no TCP stack for 1.x  yet - that would be step 2).
  • free and open source software


Basically: get rid of the Browser (+MUI/Classact) requirement, do not rely on other computers in the household - but still offload all the resource heavy tasks to an external machine (i.e. the Aminet server).
 

Offline cgutjahr

  • Hero Member
  • *****
  • Join Date: Feb 2003
  • Posts: 692
  • Country: 00
    • Show all replies
Re: AmiGet - Aptitude like app for aminet
« Reply #1 on: January 23, 2017, 06:16:03 PM »
Quote from: nyteschayde;820523

Format is TBD but should likely support dependencies, dev dependencies, and optional dependencies

We tried to implement something like that a decade ago, based on Debian's deb format.

I'd have to search for the old drafts, but you need more than just software dependencies. First you need a way to reference packages without relying on their filename (think of mui-master-16.1.lha vs. mui-master-16.2.lha) - we used a NAME: field in the readme ("Name: MUI-Master"), IIRC - min. and/or max. version numbers of the dependency,  CPU/RAM/Chipset requirements... Plus, you'd also have to document compatibility with various OS versions, Chipsets, RTG...
 

Offline cgutjahr

  • Hero Member
  • *****
  • Join Date: Feb 2003
  • Posts: 692
  • Country: 00
    • Show all replies
Re: AmiGet - Aptitude like app for aminet
« Reply #2 on: January 23, 2017, 06:33:41 PM »
Quote from: nyteschayde;820531

The ADT download tool, if it is the one I am thinking of, does not support search.

Yes, it does - in theory. Just like most Amiga specific FTP clients do, who simply reimplemented the protocol they saw in the ADT sources. We stopped running the search daemon on our server years ago, simply because nobody was using it and there was a compatibility issue (IIRC) which would have required some effort that nobody wanted to invest.

Quote

And it doesn't handle dependencies either. All the FTP clients are the same to my knowledge.

That's true for FTP clients, but like I said: Grunch handles dependencies and automatic installation - it just needs database maintainers.

Quote

I'd disagree that there isn't any interest on 68k machines but I could be wrong.

I'm not saying there's no interest in 68k in general - but there are not enough people willing to donate sufficient amount of their spare time to a project like that. Retro gaming, fine-tuning your decade old Workbench setup every few months, buying/cleaning/fixing hardware? Sure, a lot of people love doing that.

But people who reliably take care of a database, every other day? Most of these are on OS4/MOS/AROS these days.

Quote

I am pretty sure there are LZX and at least ZIP files on aminet.

http://aminet.net/search?query=*.lzx

There are ZIP files, of course, but we don't support proprietary formats (with the exception of MP3/MPEG, for historical reasons), our wiki lists supported filetypes.
 

Offline cgutjahr

  • Hero Member
  • *****
  • Join Date: Feb 2003
  • Posts: 692
  • Country: 00
    • Show all replies
Re: AmiGet - Aptitude like app for aminet
« Reply #3 on: January 23, 2017, 06:53:24 PM »
Quote from: nyteschayde;820534
I think we'd have to at least use gadtools.library if we wanted any chance of a decent looking OS2.x+ based GUI. I am not even sure when gadtools.library made its debut offhand. I think it was 2.x but it might have been 3.x

Gadtools was part of 2.x. Not sure you need Gadtools. A menu bar, plus simple text and file requesters should cover most of our needs, IMHO.

Quote

are there any existing search APIs?

Not yet. The only other format option implemented so far is "PRE" (preformatted), and that's just half finished - it was a test for amiga-news.de's 'Aminet uploads' news items. Append &format=pre to the URL of any search results page to see how this works. Oh, and &amount=XXX can be used to determine the amount of files you want to see on the first page.

Quote

PM me and we can exchange emails for putting on together if there isn't one.

I don't see a need for private discussions. Basically, it would come down to having search.php provide whatever format people agree on.