Welcome, Guest. Please login or register.

Author Topic: Bulk Newsgroup Decoding (was:UUDecode question)  (Read 2394 times)

Description:

0 Members and 1 Guest are viewing this topic.

Offline Madgun68Topic starter

  • Hero Member
  • *****
  • Join Date: Mar 2002
  • Posts: 706
    • Show only replies by Madgun68
    • http://home.comcast.net/~madgun1968
Bulk Newsgroup Decoding (was:UUDecode question)
« on: November 11, 2003, 09:41:54 AM »
I'm writing some software for myself to bulk decode newsgroups, but there's one thing puzzling me..

Whole messages have a BEGIN and END. On multipart messages, the END may be 10 messages away.

The question I have is this: Is there sure-fire way of determining which parts of a post contains the encoded bits? I know the lines begin with M but what else do I look for? (Line length?)

I'd appreciate any suggestions..
......
 

Offline zurt

  • Full Member
  • ***
  • Join Date: Feb 2002
  • Posts: 114
  • Country: kp
    • Show only replies by zurt
Re: UUDecode question
« Reply #1 on: November 11, 2003, 10:37:46 AM »
Yup as Far as I Remember, the structure, was something like that

BEGIN 664 ....
Mxxxxxxxxxxxx
Mxxxxxxxxxxxx
Mxxxxxxxxxxxx
Mxxxxxxxxxxxx
END

AFAIK the line lenght was always the same...

Antonio
zurt

AmigaOS user since 1989
MorphOS user since 2003
 

Offline Madgun68Topic starter

  • Hero Member
  • *****
  • Join Date: Mar 2002
  • Posts: 706
    • Show only replies by Madgun68
    • http://home.comcast.net/~madgun1968
Re: UUDecode question
« Reply #2 on: November 15, 2003, 11:02:27 PM »
Perhaps it's just paranoia on my part, but I envisioned some [self censored] posting a message that mimics a uuencoded set of messages.

Anyhoo, I've pretty much got it all figured out how to deal with this crap correctly. For multipart messages, the program does the following:

Basically, an entire newsgroup is processed. The "one part" messages are encoded while multiparts are saved to a temp directory. Once the entire group is processed, it goes in the temp directory, finds all parts for a file and sorts them, creates the single part file and decodes it if all the files are present. (If you don't have all the files, it'll just leave them in case you get the rest later.)

What I'm eventually hoping for is two things:
Fetching news at intervals (like every half hour) and temp files that are only stored for a set period. That way, you have x amount of time for the complete set to arrive before it removes the files.

Oh yeah.. And I suppose a gui/prefs at some point would help too. :-)

(And to think.. I'm only doing this because I'm too cheap/can't afford a similar program on the PC. ;-))
......
 

Offline T_Bone

  • Hero Member
  • *****
  • Join Date: Jun 2002
  • Posts: 5124
    • Show only replies by T_Bone
    • http://www.amiga.org/userinfo.php?uid=1961
Re: UUDecode question
« Reply #3 on: November 16, 2003, 01:15:09 AM »
> (And to think.. I'm only doing this because I'm too cheap/can't afford a similar program on the PC. )

I use Grabit (for windows) under Winex3 in linux (because the binary downloaders for linux SUCK)
It's free.


this space for rent
 

Offline adolescent

  • Hero Member
  • *****
  • Join Date: Sep 2003
  • Posts: 3056
    • Show only replies by adolescent
Re: UUDecode question
« Reply #4 on: November 16, 2003, 03:02:43 AM »
Quote

T_Bone wrote:
> (And to think.. I'm only doing this because I'm too cheap/can't afford a similar program on the PC. )

I use Grabit (for windows) under Winex3 in linux (because the binary downloaders for linux SUCK)
It's free.


Have you tried BNR?  I used this on Windows and also on Linux and haven't found anything better out there.
Time to move on.  Bye Amiga.org.  :(
 

Offline CodeSmith

  • Sr. Member
  • ****
  • Join Date: Sep 2002
  • Posts: 499
    • Show only replies by CodeSmith
Re: UUDecode question
« Reply #5 on: November 16, 2003, 07:26:43 AM »
@Madgun68:

Quote
(And to think.. I'm only doing this because I'm too cheap/can't afford a similar program on the PC. )


Get WinRAR.  It will decode uuencoded files (name them whatever.uue), it has a GUI, it will also do lha and its native format is better than ZIP.  It's also free  :-)
 

Offline Madgun68Topic starter

  • Hero Member
  • *****
  • Join Date: Mar 2002
  • Posts: 706
    • Show only replies by Madgun68
    • http://home.comcast.net/~madgun1968
Re: UUDecode question
« Reply #6 on: November 16, 2003, 07:38:48 AM »
Well, I do want a solution for the Amiga/Morphos too. I'm not writing a complete newsreader. This just works with NewsCoaster.

The uudecoding section is (hopefully) complete. I just need to add the ydec stuff and make sure it works on large multi-part stuff.
......
 

Offline Madgun68Topic starter

  • Hero Member
  • *****
  • Join Date: Mar 2002
  • Posts: 706
    • Show only replies by Madgun68
    • http://home.comcast.net/~madgun1968
Re: Bulk Newsgroup Decoding (was:UUDecode question)
« Reply #7 on: November 20, 2003, 03:01:11 PM »
This has been an interesting experience to say the least. There are several bulk yenc encoders that don't properly follow the guidelines that I've had to make adjustments for.. And now I need to make some changes because several of the amiga's uudecoders are ignorant.

The program is working quite well though! I've probably completed 90% of the functionality, and the multipart decoder has been tested with archives that span over hundreds of messages.

Now if I only had a dime for every mistake I've made or every time I've decided to rewrite part of the program..
......