In the era of quick judgments, it's tempting to think we are more clever than anyone else. But from AI to Apple to senior tech, underestimating others comes at a risk: being seriously wrong.
I think it’s dangerous to try to cure loneliness with an AI, regardless of sophistication and tuning, because you end up with human who’s been essentially deceived into feeling better. Not only that, but they’re going to eventually develop strong emotional attachments to the AI itself. And with capitalism as the driving force of society here in the U.S. I can guarantee you every abusive, unethical practice will become normalized surrounding these AI’s too.
I can see it now: “If you cancel your $1,000/a year CompanionGPT we can’t be held responsible for what happens to your poor, lonely grandma…” Or it will be even more direct and say the old, lonely person: “Pay $2,500 or we will switch of ‘Emotional Support’ module on your AI. We accept PayPal.”
Saying AI’s like this will be normalized doesn’t mean it’s an ethical thing to do. Medical exploitation is already normalized in the US. Not only is this dystopian, it’s downright unconscionable, in my opinion.
I think it’s dangerous to try to cure loneliness with an AI, regardless of sophistication and tuning, because you end up with human who’s been essentially deceived into feeling better. Not only that, but they’re going to eventually develop strong emotional attachments to the AI itself. And with capitalism as the driving force of society here in the U.S. I can guarantee you every abusive, unethical practice will become normalized surrounding these AI’s too.
I can see it now: “If you cancel your $1,000/a year CompanionGPT we can’t be held responsible for what happens to your poor, lonely grandma…” Or it will be even more direct and say the old, lonely person: “Pay $2,500 or we will switch of ‘Emotional Support’ module on your AI. We accept PayPal.”
Saying AI’s like this will be normalized doesn’t mean it’s an ethical thing to do. Medical exploitation is already normalized in the US. Not only is this dystopian, it’s downright unconscionable, in my opinion.