I'm disinclined to judge people too harshly for that. Self-interest, like all other aspects of life, isn't objectionable unless it meaningfully interferes with the ability of others to live their lives. Someone who is entirely oriented around personal survival? Okay, yeah, it's selfish, but I'm not going to condemn them for a natural response to a terrifying eventuality. If they cross that line and start harming others for the sake of their own survival, then it's an ethical issue. Someone who runs away from an armed gunman when there are other, more vulnerable people present isn't admirable, but they're not the same as someone who pushes those other people into the line of fire to help themselves survive.
I mean, yes, on a personal level I think that the notion of society operating smoothly because of self-interest is a crock, and that people who are entirely selfish (but who refrain from allowing that selfishness to cause meaningful harm to others) aren't particularly good people, but condemning them for being selfish is too close to thought-crime &c. for my liking.
IOW someone who only cares about their own well-being might be an unpleasant person, but they're not equivalent to someone who actively harms others for their own benefit.
Fuck, man, I don't know. There's too much granularity to ethical issues like this to really present a coherent, comprehensive stance without way more work than I'm willing to put in right now.