That sounds scary!
Ours are not exactly like yours, they are large and make open nests of about 20 individuals - they have a tendency to build under the roof of the house and close to doors. They become aggressive once the nest is large at the end of summer and we get rid of them by spraying the adults at night when they are sleeping and then removing and crushing the nest in the morning or the young wasps that are already pupating will hatch and continue there.
What I can say? beautiful wasps and beautiful house (from the visual side) I'd love to take photos of. But I'd also love to keep it far from my place, heh.
(Our nest also was under the roof).
The love it under the roof, warmer and sheltered. These guys are also interesting to watch as they are social insects but they become a real hazard next to the door and around passageways late in summer