Since mining is an all-important facet of Dwarfhood, criminals shall be sentenced to 30 days Lye Making.
Weapons and armor should be your only export, and you should allow for numerous justice chains, preferably one chain per location, with a 1x1 tile for the room. Or, place the chains outside, where prisoners can watch for ambushes. Hammers should be your preferred weapon, but because of material type limitations, perhaps axes because they're similarly big, and very dwarfy. Steel is preferred above all, with very high importance placed on your metalworkers, to the point that they get near-noble accommodations (which are still rather meager). Commoners get small rooms, like a 1x1 room with 4 walls and 4 doors, to make a large grid of dormitories, or just make them all have a 1x1 bedroom that are all packed in. Or no bedrooms, just a large dorm area. Burial requirements are equally meager, with preferably open-air coffins (build a wall, then a floor, and build the coffin under that floor, then remove the floor, for an outdoor coffin) or simply mass burial plots with dozens of unlabeled coffins. Nobles get assigned a coffin, but when they die, their coffin privileges are revoked.
If you'd like a very dwarfy decoration, I've made a custom armor stand that takes one each piece of armor and one weapon, plus an armor stand, to make a construction. With good steel armor, this can make a royal bedroom instantly, or with cheap bronze it can simply be a display. Sadly you cannot get the armor off it like you can with a barracks type of armor stand, but you can mass produce some copper armor to make some stands to give your areas a more military-focused look. Who needs wimpy waterfalls? We've got armor displays in our dining hall!