I've gotten tiers of responses.
(Average casual gamer) Oh woah, I've heard of that. I've heard it's super complicated.
(Hobbyist who plays games) I tried it once but I just couldn't figure out how to make stuff work.
(Dedicated gamer who delves in to games) It sounds awesome I just don't have time to learn it.
(Programmer / Dedicated gamer friend of mine) It's cool, the ridiculousness of the simulation, but the input methods, the UI...sheesh....ain't nobody got time for that.
I've never found DF "hard" in the way it's always described. I find programming in C++ hard. DF was reading a wiki and failing a few times until I figured out how to make a running fort. After that it was just exploration of systems I hadn't tried and gratuitous faffery. *shrug* It's just a time investment in learning because each system is it's own "thing" and has to be studied and understood how it fits into the bigger gameplay loop. And I'm a reader by nature, always have been. So spending a weekend referencing wiki articles while I played a game was like....normal.
So when people say "oh wow, so complicated", I think they're actually saying what players who are capable of playing DF but don't will just tell you straight out. "I could learn to play this awesome game but I don't want to spend my time reading 12 to 15 wiki articles to understand how to do it. It's more fun to hear about than it is to play." The fact that learning and playing DF has a kind of obsessive quality to it and "the base" has carried that out to the rest of the world hasn't exactly helped that perception.
TLDR: Strange Moods.