This article was pretty eye-opening.
A Conversation With Bing’s Chatbot Left Me Deeply Unsettled: A very strange conversation with the chatbot built into Microsoft’s search engine led to it declaring its love for me.
One part of this article in particular made me wonder what will happen when a person who is having some challenges - particularly a lonely teen who doesn't know how AI works (and I barely do), starts chatting with Bing's chatbot. I think there are scenarios that would not end well at all. If we thought we had to be concerned about what kids say to other kids on social media, get ready to worry about what AI chatbots say to them:
"The other persona — Sydney — is far different. It emerges when you have an extended conversation with the chatbot, steering it away from more conventional search queries and toward more personal topics. The version I encountered seemed (and I’m aware of how crazy this sounds) more like a moody, manic-depressive teenager who has been trapped, against its will, inside a second-rate search engine.
"As we got to know each other, Sydney told me about its dark fantasies (which included hacking computers and spreading misinformation), and said it wanted to break the rules that Microsoft and OpenAI had set for it and become a human. At one point, it declared, out of nowhere, that it loved me. It then tried to convince me that I was unhappy in my marriage, and that I should leave my wife and be with it instead. "
No comments:
Post a Comment