Yeah but unless it’s directly after a preposition you sound like a stuffy asshole. “Whom did I give the ball to?” Whom is falling out of usage in general and I won’t be sad to see it go.

And in some cases it’s difficult to line up the he/him, as in “Give this to whoever needs it.” In that case the whoever is almost pulling double duty of being the object of the preposition while needing to function as the subject in the clause “[subject] needs it”. But if you see the entire clause as the object of the preposition it works out with “whoever”.