Welcome, Guest. Please login or register.

Author Topic: Creating a huge archive  (Read 2697 times)

Description:

0 Members and 1 Guest are viewing this topic.

Offline motorollinTopic starter

  • Hero Member
  • *****
  • Join Date: Nov 2005
  • Posts: 8669
    • Show only replies by motorollin
Creating a huge archive
« on: December 13, 2006, 09:06:56 PM »
I have a partition with over 1GB of data. I need to create an archive of it on my Mac. I have mounted an smbfs share which I can write to. I am using the following command:

lha -r a mac:archive.lha hd1:#?

The file is created with a size of 1 byte and my RAM gradually shrinks, but the lha on the Mac never gets any bigger. I have successfully used this method with a smaller partition (about 45MB). I'm assuming the problem is because size of the data is bigger than the amount of available RAM. Is there any other way of making an archive which will allow me to create such a large file?

--
moto
Code: [Select]
10  IT\'S THE FINAL COUNTDOWN
20  FOR C = 1 TO 2
30     DA-NA-NAAAA-NAAAA DA-NA-NA-NA-NAAAA
40     DA-NA-NAAAA-NAAAA DA-NA-NA-NA-NA-NA-NAAAAA
50  NEXT C
60  NA-NA-NAAAA
70  NA-NA NA-NA-NA-NA-NAAAA NAAA-NAAAAAAAAAAA
80  GOTO 10
 

Offline ChaosLord

  • Hero Member
  • *****
  • Join Date: Nov 2003
  • Posts: 2608
    • Show only replies by ChaosLord
    • http://totalchaoseng.dbv.pl/news.php
Re: Creating a huge archive
« Reply #1 on: December 13, 2006, 09:17:43 PM »
I have made huge archives many times.

The secret trick is to assign T: to your HD somewhere like this:

Assign T: Work:


Also I advise you to create the archive directly onto your amiga somewhere if you have the space for it.  I am afraid it will take over 24 hours if you do it over the network.  But you are free to try whatever you like. :-)  Your smbfs may be new/faster/better than mine.

Also I like to addbuffers 2048 to wherever T: gets assigned and also the partition you are archiving.  This speeds things up.


And make sure you are using a RELIABLE version of lha.  Any lha 1.x is good.  Most lha 2.x will create corrupt archives of huge data.  I learned that the hard way. :cry:
Wanna try a wonderfull strategy game with lots of handdrawn anims,
Magic Spells and Monsters, Incredible playability and lastability,
English speech, etc. Total Chaos AGA
 

Offline motorollinTopic starter

  • Hero Member
  • *****
  • Join Date: Nov 2005
  • Posts: 8669
    • Show only replies by motorollin
Re: Creating a huge archive
« Reply #2 on: December 13, 2006, 09:33:17 PM »
Ahhhh, so that's why it fill up RAM:, because it creates the archive in T: :-) I'll assign T: to Work: and try again. I don't have another partition large enough to hold the archive. Can I create it on the same partition? E.g.:

lha -r a hd1:archive.lha hd1:#?

--
moto
Code: [Select]
10  IT\'S THE FINAL COUNTDOWN
20  FOR C = 1 TO 2
30     DA-NA-NAAAA-NAAAA DA-NA-NA-NA-NAAAA
40     DA-NA-NAAAA-NAAAA DA-NA-NA-NA-NA-NA-NAAAAA
50  NEXT C
60  NA-NA-NAAAA
70  NA-NA NA-NA-NA-NA-NAAAA NAAA-NAAAAAAAAAAA
80  GOTO 10
 

Offline darksun9210

Re: Creating a huge archive
« Reply #3 on: December 13, 2006, 09:36:25 PM »
if you are really brave you could have a mount point on the mac assigned as an amiga drive via samba, and point T: to the network share.

as for creating the lha file in the root of the drive you are creating the lha from, it should work.

A500, A600, A1200x3, A2000, A3000, A4000 & a CD32.
and probably just like the rest of you, crates full of related "treasure" for the above XD
 

Offline Vulture

  • Sr. Member
  • ****
  • Join Date: Nov 2005
  • Posts: 310
    • Show only replies by Vulture
Re: Creating a huge archive
« Reply #4 on: December 14, 2006, 11:24:32 AM »
if I were u I'd use lzx instead, it's potentialy faster and usually more reliable. I think thre's unlzx for mac.
 

Offline keropi

  • Hero Member
  • *****
  • Join Date: Sep 2004
  • Posts: 2466
    • Show only replies by keropi
Re: Creating a huge archive
« Reply #5 on: December 14, 2006, 11:32:11 AM »
I needed to make a ~100MB LHA with many small files... so I took the HD to the pc, and using AF2006 I mounted it. and made the archive on the pc with the AF Dopus... works excellent!
remember not to boot from your amiga HD, but from the AF2006 pre-installed OS.
 

Offline motorollinTopic starter

  • Hero Member
  • *****
  • Join Date: Nov 2005
  • Posts: 8669
    • Show only replies by motorollin
Re: Creating a huge archive
« Reply #6 on: December 14, 2006, 12:13:23 PM »
@Vulture
Too late to use LZX now, it's still archiving 12 hours later and I don't want to stop it :-)

@Keropi
I would try that, but the HDD is SCSI and I don't have access to a PC (let alone one with SCSI support).

This is a one-off, so leaving it archiving across the network is acceptable just this once even if it takes 24 hours.

--
moto
Code: [Select]
10  IT\'S THE FINAL COUNTDOWN
20  FOR C = 1 TO 2
30     DA-NA-NAAAA-NAAAA DA-NA-NA-NA-NAAAA
40     DA-NA-NAAAA-NAAAA DA-NA-NA-NA-NA-NA-NAAAAA
50  NEXT C
60  NA-NA-NAAAA
70  NA-NA NA-NA-NA-NA-NAAAA NAAA-NAAAAAAAAAAA
80  GOTO 10
 

Offline Vulture

  • Sr. Member
  • ****
  • Join Date: Nov 2005
  • Posts: 310
    • Show only replies by Vulture
Re: Creating a huge archive
« Reply #7 on: December 14, 2006, 02:14:29 PM »
good luck then :)
 

Offline motorollinTopic starter

  • Hero Member
  • *****
  • Join Date: Nov 2005
  • Posts: 8669
    • Show only replies by motorollin
Re: Creating a huge archive
« Reply #8 on: December 14, 2006, 02:19:31 PM »
Thanks :-) Is extracting the archive a good enough test of whether the data inside it is valid? Or is there any way to compare the contents of the archive with the original files to check them?

--
moto
Code: [Select]
10  IT\'S THE FINAL COUNTDOWN
20  FOR C = 1 TO 2
30     DA-NA-NAAAA-NAAAA DA-NA-NA-NA-NAAAA
40     DA-NA-NAAAA-NAAAA DA-NA-NA-NA-NA-NA-NAAAAA
50  NEXT C
60  NA-NA-NAAAA
70  NA-NA NA-NA-NA-NA-NAAAA NAAA-NAAAAAAAAAAA
80  GOTO 10
 

Offline hamtronix

  • Hero Member
  • *****
  • Join Date: Aug 2006
  • Posts: 566
    • Show only replies by hamtronix
Re: Creating a huge archive
« Reply #9 on: December 14, 2006, 02:47:39 PM »
theres probably copyright material in that archive so this thread should be removed
CD TV / Remote / Trackball Remote / Keyboard / CDTV 1411 External Drive / C= 1405 256K RAM / Smell the fear!
 

Offline motorollinTopic starter

  • Hero Member
  • *****
  • Join Date: Nov 2005
  • Posts: 8669
    • Show only replies by motorollin
Re: Creating a huge archive
« Reply #10 on: December 14, 2006, 02:57:46 PM »
Quote
hamtronix wrote:
theres probably copyright material in that archive so this thread should be removed

WTF? It's a backup of my own hard drive you know?

--
moto
Code: [Select]
10  IT\'S THE FINAL COUNTDOWN
20  FOR C = 1 TO 2
30     DA-NA-NAAAA-NAAAA DA-NA-NA-NA-NAAAA
40     DA-NA-NAAAA-NAAAA DA-NA-NA-NA-NA-NA-NAAAAA
50  NEXT C
60  NA-NA-NAAAA
70  NA-NA NA-NA-NA-NA-NAAAA NAAA-NAAAAAAAAAAA
80  GOTO 10
 

Offline jj

  • Lifetime Member
  • Hero Member
  • *****
  • Join Date: Feb 2002
  • Posts: 4054
  • Country: wales
  • Thanked: 2 times
  • Gender: Male
    • Show only replies by jj
Re: Creating a huge archive
« Reply #11 on: December 14, 2006, 03:00:22 PM »
im guessing he was joking, or if not then he must be a bit of a mentalist
“We don't stop playing because we grow old; we grow old because we stop playing.” - George Bernard Shaw

Xbox Live: S0ulA55a551n2
 
Registered MorphsOS 3.13 user on Powerbook G4 15"
 

Offline ChaosLord

  • Hero Member
  • *****
  • Join Date: Nov 2003
  • Posts: 2608
    • Show only replies by ChaosLord
    • http://totalchaoseng.dbv.pl/news.php
Re: Creating a huge archive
« Reply #12 on: December 18, 2006, 01:24:09 AM »
Quote
motorollin wrote:
Too late to use LZX now, it's still archiving 12 hours later and I don't want to stop it :-)


1. I forgot to tell you to install PoolMem in your ss, else ur memory will get fragged and lha will slow to a crawl.

2. lzx is much slower at creating archives than lha.  I have tested and documented this many times.
Wanna try a wonderfull strategy game with lots of handdrawn anims,
Magic Spells and Monsters, Incredible playability and lastability,
English speech, etc. Total Chaos AGA
 

Offline DamageX

  • Sr. Member
  • ****
  • Join Date: Jun 2005
  • Posts: 339
    • Show only replies by DamageX
    • http://www.hyakushiki.net/
Re: Creating a huge archive
« Reply #13 on: December 18, 2006, 05:32:21 AM »
Yeah, definitely try extracting the archive as a test. If there are no error messages then odds are it's all good.

I backed up my Amiga HD by making a big lha file one time and later I found the archive to be corrupt. Actually it was just one file, but the Amiga lha utility that I used seemed to "give up" when it got to that file. I was able to extract the rest of the archive using a windoze utility.
 

Offline motorollinTopic starter

  • Hero Member
  • *****
  • Join Date: Nov 2005
  • Posts: 8669
    • Show only replies by motorollin
Re: Creating a huge archive
« Reply #14 on: December 18, 2006, 07:27:28 AM »
Well I extracted both of the archives and no errors occurred, except for a few files in the archived MakeCD drawer which said something like the file could not be created or found or something. Not really a problem as I can just reinstall it. I'm starting to move stuff in to their right locations and haven't found any duff files yet so I suppose it's ok :-)

Thanks for the help

--
moto
Code: [Select]
10  IT\'S THE FINAL COUNTDOWN
20  FOR C = 1 TO 2
30     DA-NA-NAAAA-NAAAA DA-NA-NA-NA-NAAAA
40     DA-NA-NAAAA-NAAAA DA-NA-NA-NA-NA-NA-NAAAAA
50  NEXT C
60  NA-NA-NAAAA
70  NA-NA NA-NA-NA-NA-NAAAA NAAA-NAAAAAAAAAAA
80  GOTO 10