Thanks all for the replies! I'm done with rerunning the tests and in the process of going over the results. As there have been quite some changes due to new damage mechanics and armor removal, it's not as straightforward as just c/ping the numbers.
There are two major changes which I could also cover now:
* Wear - I've mostly seen it on shields and axes so far, but I might add up how much of it occured for what.
* Armor removal - undead and equal-material slashing weapons are more dangerous now.
Since I'm using silver hammers myself, I'm also quite interested in how they compare to steel ones. With the data available for steel hammers, running the tests with silver and comparing the results is definitely doable.
Is there any way we can help you with this research? You said you parsed the combat logs. What scripts do you use to capture and parse them?
Thanks for the offer, though I'm not sure how to help. My current workflow is:
* set up an arena for the test (attack and stat out dwarves and enemies), save it
* rename the folder to something useful for later reuse and identification
* delete gamelog.txt
* run the arena 20 times, abort after each
* split gamelog.txt into fragments along the *Loading Fortress* line, name them according to test setup (via bash)
* load the files iteratively, compute the desired statistics for each file, then compute average and deviation
For analysis, I'm using Apache Spark, since I'm familiar with it and it is convenient for handling line-based data in text format.
I'm not an expert on all the fortress scripting, so I guess if there's a way one can automate the process of setting up arenas or rerunning the arena x times, that could speed things up considerably : )
When DFhack and therapist are up and running on the newer versions of the game where Toady has reworked armor damage mitigation and added mechanics for applying torsion damage to joints I might sit down and try to contribute to this thread with some additional testing. My guess is that blunt weapons will be radically more effective against human sized organic foes compared to before.
Actually, in my tests, iron axes have profited most against iron-armoured organic foes. With armor removal and joint damage, they are now above iron spears. Iron Hammers have also improved somewhat.