I checked through the search feature to see if this has been suggested. I can't fathom why it hasn't, but here goes.
As it is, when you have legendary miners mining out a large area, it creates a lot of stone. Unfortunately, this means that every dwarf in your fortress decides that they are more into manual labor than, say, planting seeds for a harvest, and all of them start moving stone back to the piles. Unfortunately, the only way to stop this is to disable stone hauling on every dwarf in the fortress except those that don't usually work (I'm looking at you, legendary potash maker). Of course, that means that then when they are free for a few minutes, they sit in the dining hall and twiddle their thumbs, so you have to go back and tell them to haul stone until you need them again. I believe we all see the problem here.
The solution to this seems fairly simple. Have an option (order, I suppose) that tells dwarves whether you want hauling to be a primary or secondary labor. Effectively, what it would do is make it so that if you chose for it to be secondary, your dwarves would do more important labors until they have no job, and then take the time to go haul stone (or wood, or what have you). This would also help with woodcutters to a degree, since it often takes even longer to move around on the surface since it hasn't been designed for efficiency like your fortress.