I’d say it is less about not letting them enjoy their interest and more about wearing anime girls on their clothes. That just isn’t appropriate outside of maybe conventions and your own home, at least it is not perceived that way by most people.

Now you could argue that one shouldn’t give a fuck about what anyone thinks, and that’s valid, but misses the point.