Except that any witch or wizard of any training could mow down scores of muggles. This is prior to the invention of guns, but any gun pre-civil war era wouldn’t be an issue either.

I think there are more advanced spells/enchantments that can protect against modern firearms.

So really it’s about keeping power to themselves, and always has been.