I have been right next to red wasps to gather things and they don't bother me.

I find these paper wasps are a bit free with their stings. They don't hurt right away or as much as with a yellowjacket, but wait a few hours and the itch and irritation will last me for days. They seem easy to provoke just by being anywhere near the place they are active or near their nest. They are sneaky and will sting wantonly wherever they see bare skin, or even get inside your clothes, or in the house they lurk around and sting when you're unawares. No sign of the missus when I went to close the greenhouse vents this evening, but she may well be still there, just lurking.