You can get around that by using armature wire for the nose.
My mask (heat washable, reusable) has just such a wire. Darnit but it does not do as well as promised, and I have to adjust the thing, consciously avoiding the bits below where the breath passes through. (I'd argue that it's hardly N95 level, even/especially with the rubber-band trick, but that's another issue.)
On my own 'mask regimine', I've just erased three or four long paragraphs, which were getting out of hand, and will (better, if insufficiently) summarise as follows. I don't wear my mask continuously outside the house. If I were to use public transport, I would put it on, and other unavoidably close and internal circumstances. Open air, with no-one nearby (at worst, a transient passing by as I step into the road to avoid an oncoming fellow- pedestrian, hand signaling my intentions and ensuring I'm traffic-free for the duration), the mask would be less useful and even counter-productive. Both in idly fiddling with it and in ultimately in becoming an inattentive bastard lost in his own little
antisocial bubble of smug self-protection.
The time it is not on my face (or at home, awaiting variously its carriage in my travels or a good boil-wash) jt is in a sandwich bag in my pocket. It is extracted and restored in a practiced manner that keeps nominally-infected surfaces from touching those that aren't so designatable. The former goes from the "breath through" part of the cloth through to the bag interior, the latter includes the ear-loops, the bit with the nose-wire in, the outside of the bag and the lining of my pockets and all other pitential contents.
My hands are not gloved. With gloves, I could easily treat
their surfaces as unduly safe when they may not be. Instead, I rely on being concious of what I touch. (Not who. I'm already a dab-hand and
not dabbing my hands onto people in the first place. My last handshake was September/October last year - I could find the exact date easily enough - when profered by an almost perfect stranger in a situatiin it would have been impolite to refuse.)
I also distrust public hand-sanitiser dispensors (you have to somehow manhandle one form of pump or other prior to the dosage-delivery itself, perhaps it was last used by someone conscientious who had good reason to be conscientious, and maybe I get to unknowingly be that person at some point). So I just take more notice of what I
must touch, and how (like favouring a hand).
Oh look, as many paragraphs, but far fewer words in each. That'll have to do.