I’d definitely notice, mine is less than a year old so I still remember thinking about which side I wanted the refrigerator to open towards.

Plus right now it opens facing the rest of the kitchen area/counter and that works for me. If that suddenly got reversed it’d be a noticeable and annoying change.