Print

Please login or register.
1 Hour 1 Day 1 Week 1 Month Forever
Login with username, password and session length

[wierd]

The random generator driven nature of DF events means that running the actual game for benchmarking is not a good solution.

A better solution, IMO, would be a surrogate test suite, created using the data collected from the dfhack team.

EG, a bunch of true benchmark computation suites that test performance based on a number of canned computational load patterns, that produce and iterate through big memory structures like DF does.  The data in the structures would always be the same, the computations done on them would always be the same, etc.  As long as it does things reasonably faithfully to the way DF does them, it would make a good baseline to work with.

[BauxiteProcessor]

The random generator driven nature of DF events means that running the actual game for benchmarking is not a good solution.

A better solution, IMO, would be a surrogate test suite, created using the data collected from the dfhack team.

EG, a bunch of true benchmark computation suites that test performance based on a number of canned computational load patterns, that produce and iterate through big memory structures like DF does.  The data in the structures would always be the same, the computations done on them would always be the same, etc.  As long as it does things reasonably faithfully to the way DF does them, it would make a good baseline to work with.

That would be quite super interesting to see. Of course actual game benchmarks could be used to sanity check things in cases where results seem weird.

[redivider]

If you run it for a small time interval and repeat the run more times and avarage it, the random wont have a big impact, in other words the error will be minimal/not seen in practice. You would actually get a practical, functional "real world" result instead of artificial benchmarks of, say an ssd being 0.003s faster.

[Max™]

If you want a computer cruncher, get down to hell in a packed dark fortress and deconstruct it.

[Fleeting Frames]

Would have to be same save every time, but no idea how well caveins correlate with other stuff.