Amiga.org

Amiga computer related discussion => General chat about Amiga topics => Topic started by: trekiej on May 15, 2011, 03:25:55 AM

Title: Amiga Performance Scale
Post by: trekiej on May 15, 2011, 03:25:55 AM
Is there an Amiga Performance Scale and where do you think Natami and FPGA-Arcade will go on this scale?
Title: Re: Amiga Performance Scale
Post by: thedocbwarren on May 15, 2011, 05:20:00 AM
Natomi sounds kind of neat, but wouldn't a compatible OS on a say a G4 or some-such be better?  Anyway, 68060 is faster than any classic Amiga.

Measuring performance is always tricky since you have the graphics co-processors to take into account, plus blitter, etc.

A base 68000 at 8Mhz is 1 Mip compared to 110 Mips for 68060 75Mhz.

But the original Amiga 1000 had graphics co-processors that could push pixels faster than the 68K could.  So what is performance?
Title: Re: Amiga Performance Scale
Post by: J-Golden on May 15, 2011, 05:28:07 AM
Isn't that what SysInfo and those style of programs were for?
Title: Re: Amiga Performance Scale
Post by: trekiej on May 15, 2011, 06:30:56 AM
Well, I knew I should have been clearer.
I need to find a sysinfo comparison chart or something similar.
I will hunt down Natami and FPGA-Arcade sysinfo shots.
Title: Re: Amiga Performance Scale
Post by: Damion on May 15, 2011, 06:53:48 AM
Quote from: trekiej;637893
Well, I knew I should have been clearer.
I need to find a sysinfo comparison chart or something similar.
I will hunt down Natami and FPGA-Arcade sysinfo shots.


Maybe not what you're looking for, but still interesting:

http://www.amigaspeed.de.vu/
Title: Re: Amiga Performance Scale
Post by: Kesa on May 15, 2011, 07:19:48 AM
Quote from: thedocbwarren;637887
Natomi sounds kind of neat, but wouldn't a compatible OS on a say a G4 or some-such be better?  Anyway, 68060 is faster than any classic Amiga.

Measuring performance is always tricky since you have the graphics co-processors to take into account, plus blitter, etc.

A base 68000 at 8Mhz is 1 Mip compared to 110 Mips for 68060 75Mhz.

But the original Amiga 1000 had graphics co-processors that could push pixels faster than the 68K could.  So what is performance?


I agree that measuring performance is tricky as there are many different variables to consider so i think the way to approach this is to envision what it is going to be used for and start from there otherwise you may end up just confusing yourself :)

My 2 cents is not focusing on the technical aspect but more on what we will be using on the NatAmi and FPGA. Is there any classic software that can take advantage of all this power? I mean for an Amiga a 75Mhz 68060 is ultra fast but the 150 Mhz(?) NatAmi will make the 68060 seem slow.

Maybe another point i am trying to make is maybe the current performance measuring tools will not be relevant for the ng of classic hardware?
Title: Re: Amiga Performance Scale
Post by: trekiej on May 15, 2011, 07:40:37 AM
I can go with that.
I just want to see how the other stack up in some kind of chart or graph.
Natami and Replay should be fairly fast as most everything is on chip, with some exception to other external chips.
Title: Re: Amiga Performance Scale
Post by: J-Golden on May 15, 2011, 10:28:08 AM
Quote from: Kesa;637898
Maybe another point i am trying to make is maybe the current performance measuring tools will not be relevant for the ng of classic hardware?


+1

I remember SysInfo's scale not going far enough when measuring certain processors.  And that was way back then!
Title: Re: Amiga Performance Scale
Post by: Franko on May 15, 2011, 10:46:58 AM
Bit off topic but related in a way...

SysSpeed unlike SysInfo will let you check all the Amiga processors including some basic PPC checks, can't say that any of these utils are very accurate but they do allow you to get an idea of a particular Amiga's performance... :)

Don't quite think it's what you're looking for but in this THREAD (http://www.amiga.org/forums/showthread.php?t=55786&highlight=sysspeed) (on Page 5) a while back I posted various SysSpeed test results for an A1200 with 060 board, might help if you find similar results elsewhere on the site here for other set ups to compare them to... :)

I'd love to see one of the betatesters of the NatAmi post some SysSpeed results in order to compare them to my 060 results... :)

Back on topic... :)

If the NatAmi when released lives up to it's claims then this would really put it at the top of any Amiga performance chart I'd reckon (even better than my Blizzard 060) not sure about FPGA-Arcade as I've never really followed that thread... :)
Title: Re: Amiga Performance Scale
Post by: Karlos on May 15, 2011, 10:57:43 AM
Quote from: thedocbwarren;637887
A base 68000 at 8Mhz is 1 Mip compared to 110 Mips for 68060 75Mhz


Even this is a somewhat awkward comparison. The usual comment about "Meaningless Indicator of Performance Scale" aside, code has to be well-tuned for superscalar execution (bearing in mind that the two execution units are non symmetrical, the secondary execution unit can't do everything the primary unit can) to get anything like that level of performance on 68060.
Title: Re: Amiga Performance Scale
Post by: Kesa on May 15, 2011, 11:05:05 AM
Franko that depends. I think what this thread is trying to say is that it wants graphs and not numbers to look at. You being a die hard Amigan should know this. On Amiga.org if it ain't a picture we ain't looking at it    :p
Title: Re: Amiga Performance Scale
Post by: Franko on May 15, 2011, 11:11:13 AM
Quote from: Kesa;637925
Franko that depends. I think what this thread is trying to say is that it wants graphs and not numbers to look at. You being a die hard Amigan should know this. On Amiga.org if it ain't a picture we ain't looking at it    :p


I would have drawn a graph but me big red crayon broke and that only left me the blue one, so all the results would have got mixed up, that and and I'm crap at drawing... :)

PS: I ain't an Amigan today, today I'm a SNESIAN cos I'm playing some old SNES RPG games... SNES RULEZ... AMIGA SUX... :p
Title: Re: Amiga Performance Scale
Post by: Forcie on May 15, 2011, 11:21:35 AM
This is indeed an interesting topic.
Benchmarks are quite complicated things. What does one actually measure, and does the results make sense to compare with ones run on another architecture?

SysInfos "speed" test, for example, is quite a "stupid" benchmark. It tests very few instructions, and in a very repetitive manner. It makes more sense for testing 000-020 than the more advanced architectures. If we wanted, we could optimise the Natami 050 core to look super good in SysInfo. But this would not necessarily make much sense for achieving good real life performance.

AIBB is a lot more advanced. Maybe we should make an AIBB profile for Natami. I have not used AIBB much myself, though.

However, I think it makes more sense writing "new" benchmark suites for the new classics like FPGAArcade and Natami. There are so many aspects which get lost when running benchmarks made for an A500. Not saying the old ones should not be run too, though :)

Here is a small benchmark suite written by Rune of the Natami Team. It runs code optimised for 030, 060 and N050 in sequence. Source included.

http://www.4shared.com/file/me92duH4/sp_benchmark_11april_.html
Title: Re: Amiga Performance Scale
Post by: Matt_H on May 15, 2011, 03:15:04 PM
I think it's AIBB (http://aminet.net/search?query=aibb) that is/was considered the gold standard in benchmarking. A Natami module for it would be great to have.

SysInfo is good for some quick'n'dirty numbers, but you shouldn't read too much into it. Its tests are not very comprehensive, and like most software from the 3.1-and-earlier era it doesn't know about anything newer than an 040! :)
Title: Re: Amiga Performance Scale
Post by: Ral-Clan on May 15, 2011, 05:00:34 PM
Quote from: Matt_H;637965
I think it's AIBB (http://aminet.net/search?query=aibb) that is/was considered the gold standard in benchmarking. A Natami module for it would be great to have.


I agree.  I would love it if a Natami beta board tester could release an AIBB module for the Natami.  That way I could run tests again my own Amiga hardware (end even emulator setups) and see just how it compares.
Title: Re: Amiga Performance Scale
Post by: Iggy on May 15, 2011, 05:09:44 PM
Not that its relevant, but an NG machine would be much faster.
However, the Natami's advantage over legacy hardware is not limited to just improved CPU performance.
One of the things that drags down later legacy systems is the relatively slow operation of the chipset.
What worked great with a 68000 is virtually crippling with a 68060.
I can't wait to see how the Natami's enhanced blitter (amongst other improved hardware) increases performance.
Title: Re: Amiga Performance Scale
Post by: Brian on May 15, 2011, 05:33:42 PM
Probably not what you're looking for but AHwDb have AIBB scores (http://amiga.resource.cx/perf/aibb.pl?amiga=500&amiga=1200&amiga=2000&amiga=3000&amiga=4000&amiga=other&testgroup=int&testgroup=float&order=emu) for several cards.
Title: Re: Amiga Performance Scale
Post by: Banter on June 03, 2011, 09:56:08 PM
Quote from: trekiej;637900
I can go with that.
I just want to see how the other stack up in some kind of chart or graph.
Natami and Replay should be fairly fast as most everything is on chip, with some exception to other external chips.


Still, comparing other FPGA-based Amigas with NatAmi is like comparing Fiat Panda with latest Ferrari. We are talking about MASSIVE performance difference. I say, wait for the final NatAmi benchmarks and real-world performance tests. You will see this huge difference yourself.
Title: Re: Amiga Performance Scale
Post by: ChaosLord on June 03, 2011, 10:24:29 PM
Quote
I need to find a sysinfo comparison chart or something similar.

Natami is too fast for SysInfo.  One of the test numbers wrapped around to zero.  The speed was too high to fit into the variable.

Natami Team can now either
A: Make the Natami go slower so as not to overwhelm poor widdle SysInfo
or
B: Throw SysInfo in the trash

What do you think they should do?
Title: Re: Amiga Performance Scale
Post by: commodorejohn on June 03, 2011, 11:50:57 PM
C. Update Sysinfo to use larger variables so we can continue comparing apples to apples.
Title: Re: Amiga Performance Scale
Post by: ChaosLord on June 04, 2011, 12:04:10 AM
Quote from: commodorejohn;642257
C. Update Sysinfo to use larger variables so we can continue comparing apples to apples.

Good idea!  Gimme the source.  Thanx, ur a pal  :)
Title: Re: Amiga Performance Scale
Post by: Franko on June 04, 2011, 12:13:25 AM
Quote from: ChaosLord;642249
Natami is too fast for SysInfo.  One of the test numbers wrapped around to zero.  The speed was too high to fit into the variable.

Natami Team can now either
A: Make the Natami go slower so as not to overwhelm poor widdle SysInfo
or
B: Throw SysInfo in the trash

What do you think they should do?


Definitely B ... :)

SysInfo was fine back in the day but even then it couldn't handle an 060... :(

Much better using SysSpeed for testing Amiga's these days, while not perfect it's better than nothing... :)

I did once disassemble SysInfo into it's source code (as I planned to fix it for 060's) but the code was so messy it wasn't worth the bother... :(
Title: Re: Amiga Performance Scale
Post by: ChaosLord on June 04, 2011, 12:27:41 AM
Being a low level coder I never learned how to disassemble an exe into source code that can reassembled.  I gather it involves using "ReSource".

If it is ez 4 u 2 create src code from the exe you could consider doing that and emailing it to me because we have a codeslave in our team who has volunteered to fix it (or at least fix some parts of it).

If I was healthy I would just write my own sysinfoproggy with a better GUI and better tests but oh well...
Title: Re: Amiga Performance Scale
Post by: Franko on June 04, 2011, 12:32:16 AM
Quote from: ChaosLord;642271
Being a low level coder I never learned how to disassemble an exe into source code that can reassembled.  I gather it involves using "ReSource".

If it is ez 4 u 2 create src code from the exe you could consider doing that and emailing it to me because we have a codeslave in our team who has volunteered to fix it (or at least fix some parts of it).

If I was healthy I would just write my own sysinfoproggy with a better GUI and better tests but oh well...


For big disassembling jobs ReSource is a brilliant tool to have but sometime for smaller progs I just use a machine language monitor to disassemble stuff... :)

I might still have the source code kicking around if not I could disassemble it again when I have the time and send it to you... :)
Title: Re: Amiga Performance Scale
Post by: minator on June 04, 2011, 01:23:14 AM
Anyone considered using Coremark? It runs on pretty much anything and it's probably a lot better than most of the Amiga only tests.

http://www.coremark.org/
Title: Re: Amiga Performance Scale
Post by: trekiej on June 04, 2011, 05:07:33 AM
There is povray for Amiga.
020 or greater looks prefered.
http://ftp://ftp.povray.org/pub/povray/Old-Versions/
Title: Re: Amiga Performance Scale
Post by: thedocbwarren on June 05, 2011, 08:34:05 PM
It still comes back to what exactly is being measured.  It's even more muddy these days with so many processors to take into account.