Amiga.org

Amiga computer related discussion => General chat about Amiga topics => Topic started by: nyteschayde on January 10, 2017, 11:04:59 PM

Title: Finally broke down and did it
Post by: nyteschayde on January 10, 2017, 11:04:59 PM
Over a couple of weeks, so as not to spam the aminet.net servers, I mirrored all of aminet.net locally. This is something that I have been dying to do for some time now (especially when it goes down for some unknown reason).

Total content size is about 53.39GB. I may try to burn this to Blu-Ray or several DVDs just to keep a hard copy as well. Now periodic syncing with Transmit for the Mac is all I need to keep it up to date. Yay.
Title: Re: Finally broke down and did it
Post by: nyteschayde on January 10, 2017, 11:15:39 PM
Also archive.org has many of the Amiga Format magazine ISOs.

Code: [Select]

https://archive.org/details/cdrom-amigaformatcd01
https://archive.org/details/cdrom-amigaformatcd02
https://archive.org/details/cdrom-amigaformatcd03
https://archive.org/details/cdrom-amigaformatcd04
https://archive.org/details/cdrom-amigaformatcd05
https://archive.org/details/cdrom-amigaformatcd06
https://archive.org/details/cdrom-amigaformatcd...


For example
Title: Re: Finally broke down and did it
Post by: trekiej on January 11, 2017, 12:52:22 AM
Cool
Title: Re: Finally broke down and did it
Post by: klx300r on January 11, 2017, 03:30:56 AM
@ nyteschayde

now we can all sleep well if the interwebs ever disappear on us:hammer:
Title: Re: Finally broke down and did it
Post by: Rotzloeffel on January 11, 2017, 09:42:13 AM
Quote from: klx300r;819503
now we can all sleep well if the interwebs ever disappear on us:hammer:

format internet: quick

DONE :D
Title: Re: Finally broke down and did it
Post by: jj on January 11, 2017, 10:02:30 AM
Quote from: nyteschayde;819483
Over a couple of weeks, so as not to spam the aminet.net servers, I mirrored all of aminet.net locally. This is something that I have been dying to do for some time now (especially when it goes down for some unknown reason).

Total content size is about 53.39GB. I may try to burn this to Blu-Ray or several DVDs just to keep a hard copy as well. Now periodic syncing with Transmit for the Mac is all I need to keep it up to date. Yay.

Is that all aminet is.  cant imagine there is much traffic now either.  Could easily host that locally at home as a welsh mirror :)
Title: Re: Finally broke down and did it
Post by: Rotzloeffel on January 11, 2017, 02:35:54 PM
Quote from: JJ;819519
 Could easily host that locally at home as a welsh mirror :)

you have internet in Wales ???:eek: Respect :laughing:
Title: Re: Finally broke down and did it
Post by: cgutjahr on January 11, 2017, 03:04:04 PM
Quote from: nyteschayde;819483
I mirrored all of aminet.net locally.

Which is considered abuse by the Aminet team.

It's not "cool", it's stupid.

Quote

(especially when it goes down for some unknown reason).

Aminet consists of eight public and two private mirrors, plus archive.org is about to become an official mirror.
Title: Re: Finally broke down and did it
Post by: Oldsmobile_Mike on January 11, 2017, 03:06:55 PM
Quote from: cgutjahr;819540
Which is considered abuse by the Aminet team.

It's not "cool", it's stupid.


I guess the question then would be, how does one set up to become an official "mirror" (should that be what OP is attempting to do)?
Title: Re: Finally broke down and did it
Post by: kolla on January 11, 2017, 06:45:15 PM
Quote from: cgutjahr;819540
Which is considered abuse by the Aminet team.

It's not "cool", it's stupid.


If it's stupid, then why do they host an rsync service open to anyone? I also keep a local mirror, using rsync  every now and then to keep it updated.
Title: Re: Finally broke down and did it
Post by: paul1981 on January 11, 2017, 09:38:58 PM
Quote from: Rotzloeffel;819517
format internet: quick

DONE :D


Don't use FFS though FFS! :hammer:
Title: Re: Finally broke down and did it
Post by: jj on January 11, 2017, 09:52:41 PM
Quote from: Rotzloeffel;819531
you have internet in Wales ???:eek: Respect :laughing:


:) :):laughing:
Title: Re: Finally broke down and did it
Post by: nyteschayde on January 12, 2017, 12:15:25 AM
Quote from: cgutjahr;819540
Which is considered abuse by the Aminet team.

It's not "cool", it's stupid.


Aminet consists of eight public and two private mirrors, plus archive.org is about to become an official mirror.
This is exactly why I staged it over a long period of time. Give me some credit. Sheesh. Read the OP.
Title: Re: Finally broke down and did it
Post by: nyteschayde on January 12, 2017, 12:16:03 AM
Quote from: kolla;819559
If it's stupid, then why do they host an rsync service open to anyone? I also keep a local mirror, using rsync  every now and then to keep it updated.


Exactly
Title: Re: Finally broke down and did it
Post by: nicholas on January 12, 2017, 12:50:27 AM
Quote from: nyteschayde;819580
This is exactly why I staged it over a long period of time. Give me some credit. Sheesh. Read the OP.


You mean you didn't just leave 'wget -m' running over your lunch break? ;)
Title: Re: Finally broke down and did it
Post by: nyteschayde on January 12, 2017, 12:52:21 AM
Much to my own annoyance, no. I did bits and pieces of trees at a time. Once I finally had it all downloaded, I then waited an extra day and then ran an FTP sync using Transmit to pick up the new files.

Now I can do this once a day and not put any real strain on anything. Today was 22 new files.
Title: Re: Finally broke down and did it
Post by: nicholas on January 12, 2017, 12:55:52 AM
Quote from: nyteschayde;819584
Much to my own annoyance, no. I did bits and pieces of trees at a time. Once I finally had it all downloaded, I then waited an extra day and then ran an FTP sync using Transmit to pick up the new files.

Now I can do this once a day and not put any real strain on anything. Today was 22 new files.


West Coast US mirror time? Or would you need unlimited upload bandwidth at home for that?
Title: Re: Finally broke down and did it
Post by: nyteschayde on January 12, 2017, 01:07:44 AM
Quote from: nicholas;819585
West Coast US mirror time? Or would you need unlimited upload bandwidth at home for that?
Not entirely sure what you mean by this. I downloaded it from wherever I was as I was getting the bits and pieces. Sometimes at work, sometimes at home, etc...
Title: Re: Finally broke down and did it
Post by: nicholas on January 12, 2017, 01:25:53 AM
Quote from: nyteschayde;819587
Not entirely sure what you mean by this. I downloaded it from wherever I was as I was getting the bits and pieces. Sometimes at work, sometimes at home, etc...


I meant is it time to start your own mirror?
Title: Re: Finally broke down and did it
Post by: nyteschayde on January 12, 2017, 01:28:19 AM
Possibly. Have thought about it. I may try to do this. Primarily, though, as an owner of quite a bit of classic hardware in various stages of upgrade, getting software to them without network from time to time is taxing. If I have a way to do this from home, easily, then it vastly simplifies things.

Mostly being social in this thread and sharing experiences, but also letting others know I have the data should something horrible happen. Like, Aminet disappearing.
Title: Re: Finally broke down and did it
Post by: QuikSanz on January 12, 2017, 01:58:51 AM
Quote from: nyteschayde;819589

Mostly being social in this thread and sharing experiences, but also letting others know I have the data should something horrible happen. Like, Aminet disappearing.


Wish someone could have done that with BTTR!
Title: Re: Finally broke down and did it
Post by: nyteschayde on January 12, 2017, 02:00:19 AM
Quote from: QuikSanz;819591
Wish someone could have done that with BTTR!

 Exactly. Or the GeekGadgets stuff. Some of it is out there but so much was lost.
Title: Re: Finally broke down and did it
Post by: cgutjahr on January 12, 2017, 06:00:01 AM
Quote from: kolla;819559
If it's stupid, then why do they host an rsync service open to anyone?

"They" is me, genius.
Title: Re: Finally broke down and did it
Post by: Oldsmobile_Mike on January 12, 2017, 06:09:37 AM
Quote from: cgutjahr;819596
"They" is me, genius.


:flame::flame::flame::flame:
Title: Re: Finally broke down and did it
Post by: kolla on January 12, 2017, 12:12:39 PM
Quote from: cgutjahr;819596
"They" is me, genius.

Then maybe "they" should take action and don't provide a public rsync service, if "they" consider it abuse?

Is Nico still on board? :)

EDIT: while I have the attention of "they"...

Code: [Select]
bash-3.2$ rsync -av rsync://main.aminet.net/aminet .
receiving file list ... done
dev/lib/termcap.readme
game/misc/trackerheroaga.lha
game/misc/trackerheroaga.readme
game/wb/snakee.readme

sent 10833 bytes  received 3869115 bytes  596915.08 bytes/sec
total size is 52962935593  speedup is 13650.42
bash-3.2$ rsync -av rsync://main.aminet.net/aminet .
receiving file list ... done
dev/lib/Termcap.readme
game/misc/TrackerHeroAGA.lha
game/misc/TrackerHeroAGA.readme
game/wb/Snakee.readme

sent 10839 bytes  received 3866166 bytes  704910.00 bytes/sec
total size is 52962935593  speedup is 13660.79
bash-3.2$

The above is running on a mac that has "case obnoxious" HFS+, but still I suspect these duplicates with different cases on main.aminet.net are unintentional and unwanted.
Title: Re: Finally broke down and did it
Post by: jj on January 12, 2017, 07:47:22 PM
so we shouldn't do this ?

http://wiki.aminet.net/How_to_set_up_an_Aminet_mirror
Title: Re: Finally broke down and did it
Post by: cgutjahr on January 12, 2017, 10:46:32 PM
Quote from: JJ;819620
so we shouldn't do this ?

Wow, just wow. The guy running Aminet is telling you that downloading the entire archive is considered abuse - and in return he gets a bunch of middle fingers?

Impressive conduct.
Title: Re: Finally broke down and did it
Post by: Oldsmobile_Mike on January 13, 2017, 12:24:36 AM
Quote from: cgutjahr;819624
Wow, just wow. The guy running Aminet is telling you that downloading the entire archive is considered abuse - and in return he gets a bunch of middle fingers?

Impressive conduct.

Welcome to Amiga.org.  :lol:

That being said, that was kind of a haughty initial reaction.  I don't think anyone here knows who you are from your screen name.  Maybe instead a polite "Hi, I'm the admin of Aminet and I'd prefer you not to do this" would've gone over better?  ;)

Cheers, thanks for all your hard work, in any case!
Title: Re: Finally broke down and did it
Post by: gertsy on January 13, 2017, 06:29:02 AM
Victim syndrome? Agree Oldsmobile_Mike. It's culturally consistent to treat others as you'd expect to be treated.
Title: Re: Finally broke down and did it
Post by: jj on January 16, 2017, 11:24:43 AM
Quote from: cgutjahr;819624
Wow, just wow. The guy running Aminet is telling you that downloading the entire archive is considered abuse - and in return he gets a bunch of middle fingers?

Impressive conduct.

Get over yourself.  Sorry for not knowing who you are.

It was a serious question
Title: Re: Finally broke down and did it
Post by: hishamk on January 16, 2017, 08:00:45 PM
@cgutjahr I've seen so many such online misunderstandings or hurt feelings happen due to not having English as a first language. A more polite response would have been:

"As an Aminet administrator I have to inform you that this construes abuse as per our terms.

On the other hand, we do have an rsync service that you may use under such and such terms...

You also don't really have to worry about Aminet 'disappearing', as we have several mirrors and recently archive.org has come onboard as well!"

It's really not that hard to take sometime and formulate a decent response that doesn't sound borderline turrets.

@nyteschayde is obviously passionate about the Amiga and that's reason enough to spend time on a nicer response.

And as for @kolla's question re rsync, you haven't really clarified it, giving only a crude response (quite rude) of '"they" is me, genius'.

No one on here is really out to 'rob Aminet' or push you off your pedestal. However, as 'they' one would expect a more neutral tone until you are really justified in changing your tone. Then again, I'm assuming you didn't really mean to sound rude and just need to brush up on your English language finesse.
Title: Re: Finally broke down and did it
Post by: paul1981 on January 17, 2017, 10:28:28 AM
Quote from: JJ;819620
so we shouldn't do this ?

http://wiki.aminet.net/How_to_set_up_an_Aminet_mirror

The link has been removed now (12th Jan).

I didn't read your comment as a middle finger either. Like many I suppose, I was slightly confused too as to why there were instructions to do something that one shouldn't do.
Title: Re: Finally broke down and did it
Post by: jj on January 17, 2017, 01:02:46 PM
Quote from: paul1981;819878
The link has been removed now (12th Jan).

I didn't read your comment as a middle finger either. Like many I suppose, I was slightly confused too as to why there were instructions to do something that one shouldn't do.

Hi, thanks for the clarification.  Are you also connected to Aminet?
Title: Re: Finally broke down and did it
Post by: Oldsmobile_Mike on January 17, 2017, 01:40:44 PM
Quote from: paul1981;819878
The link has been removed now (12th Jan).


:angryfire:
Title: Re: Finally broke down and did it
Post by: paul1981 on January 17, 2017, 07:23:17 PM
Quote from: JJ;819883
Hi, thanks for the clarification.  Are you also connected to Aminet?


No not at all, I'm simply an innocent bystander. I was just backing you up because I knew you weren't deliberately being rude to cgutjahr. I think you made a fair point irrespective of whether or not you knew he was.
Title: Re: Finally broke down and did it
Post by: nyteschayde on January 17, 2017, 09:38:36 PM
I really think there should be an easy way for others to mirror or become a mirror. If Aminet was lost, it would be a critical failure for the entire community. It is just this fear that led me to do so in the first place.

At this point in the community, more replication of this stuff, the better. Too many sites supporting the Amiga have gone down and taken all their critical development with them. GeekGadgets, Back To Roots and plenty more; I'm certain.
Title: Re: Finally broke down and did it
Post by: Oldsmobile_Mike on January 24, 2017, 10:52:02 PM
Not directly related to this thread, I was just thinking about it and was interested to find out Aminet has a cafepress shop.  Wow, who knew?  Gotta throw a few bones their way, lord knows I've downloaded enough software off there over the past 20-something years.  ;)

http://www.cafepress.com/aminet
Title: Re: Finally broke down and did it
Post by: nyteschayde on January 24, 2017, 11:05:06 PM
Quote from: hishamk;819848
@cgutjahr I've seen so many such online misunderstandings or hurt feelings happen due to not having English as a first language. A more polite response would have been:

"As an Aminet administrator I have to inform you that this construes abuse as per our terms.

On the other hand, we do have an rsync service that you may use under such and such terms...

You also don't really have to worry about Aminet 'disappearing', as we have several mirrors and recently archive.org has come onboard as well!"

It's really not that hard to take sometime and formulate a decent response that doesn't sound borderline turrets.

@nyteschayde is obviously passionate about the Amiga and that's reason enough to spend time on a nicer response.

And as for @kolla's question re rsync, you haven't really clarified it, giving only a crude response (quite rude) of '"they" is me, genius'.

No one on here is really out to 'rob Aminet' or push you off your pedestal. However, as 'they' one would expect a more neutral tone until you are really justified in changing your tone. Then again, I'm assuming you didn't really mean to sound rude and just need to brush up on your English language finesse.


<3
Title: Re: Finally broke down and did it
Post by: dovegrace on February 17, 2017, 08:45:53 PM
Quote from: Oldsmobile_Mike;820662
Not directly related to this thread, I was just thinking about it and was interested to find out Aminet has a cafepress shop.  Wow, who knew?  Gotta throw a few bones their way, lord knows I've downloaded enough software off there over the past 20-something years.  ;)

http://www.cafepress.com/aminet

Had I seen this link earlier, my wife would have gotten a much different present for Valentine's Day...

http://www.cafepress.com/aminet.43655119

:D
Title: Re: Finally broke down and did it
Post by: nyteschayde on February 18, 2017, 03:47:39 AM
As a woman and an Amiga lover, I would appreciate it. But if your wife would also appreciate such a thong, I'd like to meet her. :)
Title: Re: Finally broke down and did it
Post by: dovegrace on February 18, 2017, 12:34:16 PM
Quote from: nyteschayde;822362
As a woman and an Amiga lover, I would appreciate it. But if your wife would also appreciate such a thong, I'd like to meet her. :)


It would probably have been met with an eyeroll, as she doesn't "get" my fascination with old computers (her words), although she'd likely wear it on occasion.

Perhaps if I explain that Aminet is a great (one could argue VITAL) service, and wearing it is a way of giving back..?
Title: Re: Finally broke down and did it
Post by: darkage on February 18, 2017, 05:27:54 PM
Aminet the protector of thongs.........
Title: Re: Finally broke down and did it
Post by: paul1981 on February 19, 2017, 02:45:47 AM
I see no Aminet tights.
Title: Re: Finally broke down and did it
Post by: nyteschayde on February 19, 2017, 09:21:25 AM
Quote from: dovegrace;822380
It would probably have been met with an eyeroll, as she doesn't "get" my fascination with old computers (her words), although she'd likely wear it on occasion.

Perhaps if I explain that Aminet is a great (one could argue VITAL) service, and wearing it is a way of giving back..?
hahaha, definitely a vital service. Definitely a way of giving back. Perhaps I can talk some sense into her. ;)