That's the point though. Good or bad, sink or swim, you choose who you are and live with the consequences. If that means you like to associate with less than reputable people, fuck anyone that isn't on board with that plan.
And if you decide later on you don't want to associate with those people anymore, then fuck anyone who isn't on board with that plan.
There are times when weakness and doubt are all people need to undercut you. And there are times when all it really takes is the belief that you know, that convinces other people. I led a life surrounded by troublemakers, hooligans and punks. People feared I'd end up dead in a gutter by 20. But I owned my choices, proved them all wrong and still kept the circle of friends I felt drawn to. School used to give me a ton of shit about missing class, and I said "Tough shit, that's how I'm going to roll." Who graduated despite all that? Me. When I got criticized by the dean of my college for "looking like I came in out of the wild", did I let that bug me? No. I went on to do better in that class than anyone, despite looking, in her opinion, like I was "homeless." (It's called not having a car in the dead of winter, you stupid bitch.) I went on to graduate with my degree, despite the presumption that I was just another statistic waiting to happen.
So yeah. Make your choice. Own your choice. Realize it's your choice to make or change. And let the rest of the world sit and spin. Especially school. It's such an infinitesimal part of who you really are, or will become, don't let school administrators get in your head.
Just be a freakin' adult about it, and really, what are they going to say that has any power over you? Adults don't give a fuck, in the end, what other adults think. Start thinking like an adult, and you'll suddenly find you don't really give a fuck either.