Would you rather the way back was uneventful? Plus, who's to say that we wouldn't have been attacked on the road? That's prime bandit bait.
"We tried to play it safe by taking the main road but we got ambushed anyway because the military isn't doing their job" makes you look a lot better than "we took the unsafe side roads and didn't see it coming when we found bandits".
Your eagerness to attribute everything to Sybil's doing is honestly annoying.
Not everything that's Sybil's responsibility is her fault.
If Seaiga was taking a nap instead of watching the mud golems, that's Seaiga's fault, and it's Sybil's responsibility to
dope-slap Seaiga for it and make sure it doesn't happen again.
If Zephyr plans out a bad route, that's his fault, but since we're being hired by Sybil and not Zephyr, it's Sybil's responsibility to either tell him to smarten up or replace him with someone who isn't dumb enough to transport valuables through bandit territory. Since she's stated she's going to have a talk with Zephyr about it, Brady is fine on that point now.
Since Sybil is the one hiring, it
is her responsibility to see that things like the military's lack of presence are accounted for, either personally or by hired hands (like Zephyr). Brady is willing to accept the contract if she says "we'll be ready for it next time" or "now that we know about that, we can react properly" or even "hiring you is part of my plan for how to deal with that in the future".
There's literally no risk of death with the things. Sea's there but, since it didn't come to it, armored dude is there and even beyond that Sybil observes the entire thing and can cancel it at will.
In-character, Brady is unaware of all of this. All he's heard about that situation is "maybe she won't make you fight the mud golems".
Incidentally, if these "bandits" turn out to be more like bandit-themed hitmen because they were hired by other nobles, Brady is unaware of that too.
Is this job rotten? Look at the game title dude.
Just because the game's title says it's a rotten job, doesn't make it not a rotten job! Of course Brady is complain about a rotten job being a rotten job in-character!