To take one of their examples, a superintelligent chatbot “trained to delight and retain users so that they can be charged higher monthly fees to keep conversing” could end up wanting to replace us with simpler and more reliable automated conversation partners. – The Atlantic
