What actually happens when you get your ass kicked by bandits attacking your outpost? Do they just, like, leave?
I'm not gonna say definitively, because I've never had it happen, but if they're just normal bandits, it makes perfect sense for them to beat you up (maybe loot your people for food and stuff) and then just scamper off. That's what they do anywhere else.
It's worth noting that you do not have to sit there and take the beating if you're not up for it. If you know bandits are coming you can just skedaddle out of your outpost and stealth on a nearby hillside until they get bored and leave. I've done this, and the bandits didn't seem interested in knocking down my stuff or taking any of my stockpiles of
worthlessprecious rocks. Which is kind of hilarious.
"Hey, Rick, didn't you say there were some guys here?"
"Yeah, I did."
"... I don't see any guys, Rick."
"I'm telling you, give it a few more hours. They're probably just making a run for building supplies or something. See, look at all the crap they built around here."
"Rick, it's been like half a day. I'm getting hungry."
"Yeah, obviously that's why we're
here. We're
hungry bandits, remember?"
"So, should we like, take the food that they're growing in that farm over there? Or take the stuff in those chests and sell it for food somewhere?"
"Pfft, no. What a stupid idea. Let's just leave."
"Okay..."
"Aw, cheer up, Hotlongs. I'm sure they'll be here next week."