exurb1a hypothesizes about some of the very real horrors that current social media bots are capable of doing. Pro-tip – get the HECK off social media and stop trusting anything you read there because this stuff has already been happening on every social media, dating, review, and news feed apps since even before the 2016 election.
His speculations? Perhaps AI personas will become so realistic and comforting to us that we’ll stop interacting with each other – and spend our lives conversing and in relationships with non-entities.
Or (as is already happening) governments, extremist groups, media, and intelligence agencies weaponized AI to flood the internet with manipulated stories, data, and opinions. Finally (as if becoming unable to form real relationships and being in relationships with AI is not scary enough) he asks what if AI itself becomes conscious.
One of the main reasons this would be terrifying is because right now we have no way to ensure alignment of AI to any set of values.
When the AI becomes able to mimic humans so well that it can convince anyone of anything – even talking to it becomes infinitely dangerous. We could have just created an almost infinitely hyper-intelligent demon, trickster, and sociopath.
See how deep the rabbit hole goes – and the majority of the possible outcomes are not good.