• Welcome to SCdev.org. Please log in.

Welcome to the new SCdev forums!

Benchmarks!

Started by mavis, February 08, 2006, 09:28:02 AM

Previous topic - Next topic

mavis

Just had an idea, was hoping to get some feedback from you guys ...

I have a really old 128MB Toshiba SD card, it's quite slow (I'm sure) ... I also have a 40x Elecom 1GB card, and today I bought a Sandisk Extreme III 1GB (133x) ... Since I have two identical DSs, both purchased at the same time, and two Supercard SDs, it would very easy to do side by side tests. I was thinking that it might clear up once and for the question about SD card speed, if I can demonstrate a consistent disparity in timings - time to load a game, time and fluidity of animated sequences, etc.

So, what do you guys think would be a good set of "benchmarks" to run? I was thinking that I could record the results on video and post them for download - two DSs, both flashme v6, with two SD 1.60 Supercards, running exactly the same files, sitting on the desk, side by side. Of course, I don't know how smart it would be to post evidence of running pirated games on my DS, hehe ... Anyway, maybe loading a game like MKDS, just to see the loading times? And what about the Castlevania intro that everyone keeps talking about? I have every game that has been released, so whatever tests you're interested in seeing, I could do it.

Any ideas?
size=9]
DS : DS Lite (flashed) : DS phat :
Carts : SC SD : SC miniSD  : EZ-Flash V : R4 :
Memory : 2x Sandisk Extreme III 1GB SD : 3x Ritek 133x 1GB miniSD : PNY 1GB microSD : Kingston 1GB microSD :[/size]

ratx

Sata ( The Rain Guy ) wrote a FAT driver type benchmarking app, you should be able to find it on his site. IIRC it did 2 types of random/sequential RW's then displayed the results.

creepyplaidman

Gameplay wise you'd probably want to do:
Tony Hawk
Animal Crossing
Metroid Pinball

mavis

Quote from: "creepyplaidman"Gameplay wise you'd probably want to do:
Tony Hawk
Animal Crossing
Metroid Pinball

OK, so how would you suggest I test those games fairly? I think it would be hard to play a game EXACTLY the same on two different DSs ...
size=9]
DS : DS Lite (flashed) : DS phat :
Carts : SC SD : SC miniSD  : EZ-Flash V : R4 :
Memory : 2x Sandisk Extreme III 1GB SD : 3x Ritek 133x 1GB miniSD : PNY 1GB microSD : Kingston 1GB microSD :[/size]

filozof

Quote from: "mavis"
Quote from: "creepyplaidman"Gameplay wise you'd probably want to do:
Tony Hawk
Animal Crossing
Metroid Pinball

OK, so how would you suggest I test those games fairly? I think it would be hard to play a game EXACTLY the same on two different DSs ...
You can just see if the game works PERFECTY or not.. And people actually use castlevania video as a benchmark.Like here:

http://leo.rampen.ca/m3wiki/index.php/Media_Card

mavis

Quote from: "filozof"
Quote from: "mavis"
Quote from: "creepyplaidman"Gameplay wise you'd probably want to do:
Tony Hawk
Animal Crossing
Metroid Pinball

OK, so how would you suggest I test those games fairly? I think it would be hard to play a game EXACTLY the same on two different DSs ...
You can just see if the game works PERFECTY or not.. And people actually use castlevania video as a benchmark.Like here:

http://leo.rampen.ca/m3wiki/index.php/Media_Card

Thanks for the link, but TBH I was hoping to do something a little more definitive. I mean, everyone's perceptions are different, and without a common point of reference, who's to say that my idea of "perfect" gameplay is the same as yours? That's why I was thinking of running two DSs side by side, starting the game at the same time, and recording the boot and possibly an intro video, in real time, to see if there were any noticeable differences.

As it stands now, there are people that swear by their 150x SD cards, and others who firmly believe that anything over 40x is overkill for the SC. I'd just like to get it sorted out once and for all, so that people won't have to keep asking the same questions over and over again ... ;)
size=9]
DS : DS Lite (flashed) : DS phat :
Carts : SC SD : SC miniSD  : EZ-Flash V : R4 :
Memory : 2x Sandisk Extreme III 1GB SD : 3x Ritek 133x 1GB miniSD : PNY 1GB microSD : Kingston 1GB microSD :[/size]

alexw

Quote from: "mavis"I'd just like to get it sorted out once and for all...

Great... thanks for the efforts !

This can be really useful.

ShadowFalls

What about using it to test GBA games? You can test pure transfer speed right there as it transfers from the card. There would be no perception, just whichever one finishes first. Given it may not be what you are looking for, but the end result would be the same.

mavis

Quote from: "ShadowFalls"What about using it to test GBA games? You can test pure transfer speed right there as it transfers from the card. There would be no perception, just whichever one finishes first. Given it may not be what you are looking for, but the end result would be the same.

Good idea. Actually, I re-patched ACWW to run from the SC instead of SD, and tested it on both SD cards ... The result: the 133x SD card consistently finished about a half second before the 40x SD card. Both cards were freshly formatted, and ACWW was the only game on both of them. Next, I tried to run the intro movie from Castlevania but every time I tried, all I got was the actual game - some anime-looking dude was talking to some anime-looking chick, and then this evil-looking anime lady came down out of the sky, and blah blah blah. No intro movie.

Metroid pinball played just about the same on both cards, as did Tony Hawk ... I don't think I'd be able to tell them apart (the 133x and the 40x) in a blind test.

Basically, aside from the faster transfer speeds when putting stuff on the card from the PC, I don't think there's a huge advantage in buying a 133x over a 40-60x card. I think the most important thing is making sure the card is not fragmented at all, and buying a card from a well-known company rather than a generic one. But in-game, I couldn't really tell the difference in speeds between the two cards.

Hope this is helpful ... :)

ps. the cards I tested were:

1GB Elecom 40x SD (Elecom is a big name in Japan)
1GB Sandisk Extreme III 133x SD
SC SD 1.60
size=9]
DS : DS Lite (flashed) : DS phat :
Carts : SC SD : SC miniSD  : EZ-Flash V : R4 :
Memory : 2x Sandisk Extreme III 1GB SD : 3x Ritek 133x 1GB miniSD : PNY 1GB microSD : Kingston 1GB microSD :[/size]

Koji

Quote from: "mavis"Basically, aside from the faster transfer speeds when putting stuff on the card from the PC, I don't think there's a huge advantage in buying a 133x over a 40-60x card.


I do believe I've been telling people this same thing for the last month or so <_<. Some brands seem to make a difference... but I think in general 40-50 times is about all you need.

mavis

Quote from: "Koji"
Quote from: "mavis"Basically, aside from the faster transfer speeds when putting stuff on the card from the PC, I don't think there's a huge advantage in buying a 133x over a 40-60x card.


I do believe I've been telling people this same thing for the last month or so <_<. Some brands seem to make a difference... but I think in general 40-50 times is about all you need.

Yes, you have. But then there have also been a number of people arguing otherwise. It makes sense that people would be quick to defend their purchases (most people are) but I don't recall having seen someone report on testing two DSs side by side, at the same time - all of the stuff I've seen (aside from your posts) have been people saying 'I bought a new super-fast card and it's much faster' ... Having run the test myself, with two DSs running side by side, I can say without a doubt that there is no discernable difference.

In other words, you were right. :)

I just wanted to see for myself, and to test in way that hadn't been done yet.
size=9]
DS : DS Lite (flashed) : DS phat :
Carts : SC SD : SC miniSD  : EZ-Flash V : R4 :
Memory : 2x Sandisk Extreme III 1GB SD : 3x Ritek 133x 1GB miniSD : PNY 1GB microSD : Kingston 1GB microSD :[/size]

Koji

Heh that wasn't so much an attack on you as to everyone else that's been saying otherwise. But I guess if some people want to believe they are getting better results in gaming, that's for them to believe.

Sadly I'm sure my bragging about being right comes off as egotistical and like a know-it-all... <_< Just seems silly to me to pay twice as much for a card that has no discernable difference.

ShadowFalls

nah Koji, its not egotistical if it is just a straight up fact :)

Well the only benefit to the faster card speed is transferring from the PC to the card which really is pointless. Unfortunately though, I have noticed higher speed cards tend to have a higher failure rate then lower ones.

I will agree that many people try to justify what they spend, I am picking up a different brand then anyone else has listed and will post the results of workability.

MAD2X

My experience with supercard's SD cards with NDS roms:

Sandisk 256MB, works fine beside a couple of games, tony hawk,AC etc... too many slowdowns.

coreMicro 1GB 45X, works great no more slowdowns.

When shopping I saw this 45X SD, 10$ cheaper then the slow sandisk. I knew nothing about coreMicro, i read on the package that it's Canadian made and has lifetime warranty. So I went for it, I figured if it doesnt work I'll bring it back and say it wasn't working. But it turned out great, it's way fast enough. Now I have to see how long it will last lol.
ilver NDS w/Flashme V.6
Supercard SD v1.61 firmware
1 GB coreMicro high speed card

mavis

Quote from: "MAD2X"When shopping I saw this 45X SD, 10$ cheaper then the slow sandisk. I knew nothing about coreMicro, i read on the package that it's Canadian made and has lifetime warranty.

Yeah, that's exactly why I went with the 1G Sandisk Extreme III (133x) - it has a lifetime warranty, as opposed to some of the other cards I found for the same price/speed that had only a one year warranty. Now I just have to make sure I don't throw away the stupid reciept ... lol
size=9]
DS : DS Lite (flashed) : DS phat :
Carts : SC SD : SC miniSD  : EZ-Flash V : R4 :
Memory : 2x Sandisk Extreme III 1GB SD : 3x Ritek 133x 1GB miniSD : PNY 1GB microSD : Kingston 1GB microSD :[/size]