It’s known as a trial balloon. “Oh, I was only joking! Unless you’re fine with it, then I’m serious.”