Facebook shuts down robots after they invent their own language
Facebook shut down a pair of its artificial intelligence robots after they invented their own, creepy language.
Researchers at Facebook Artificial Intelligence Research built a chatbot earlier this year that was meant to learn how to negotiate by mimicking human trading and bartering.
But when the social network paired two of the programs, nicknamed Alice and Bob, to trade against each other, they started to learn their own bizarre form of communication.
The chatbot conversation "led to divergence from human language as the agents developed their own language for negotiating," the researchers said.
The two bots were supposed to be learning to trade balls, hats and books, assigning value to the objects then bartering them between each other.
But since Facebook's team assigned no reward for conducting the trades in English, the chatbots quickly developed their own terms for deals.
"There was no reward to sticking to English language," Dhruv Batra, Facebook researcher, told FastCo. "Agents will drift off understandable language and invent codewords for themselves.
"Like if I say ‘the’ five times, you interpret that to mean I want five copies of this item. This isn’t so different from the way communities of humans create shorthands."
After shutting down the the incomprehensible conversation between the programs, Facebook said the project marked an important step towards "creating chatbots that can reason, converse, and negotiate, all key steps in building a personalized digital assistant".
Facebook said when the chatbots conversed with humans most people did not realise they were speaking to an AI rather than a real person.
The researchers said it wasn't possible for humans to crack the AI language and translate it back into English. "It’s important to remember, there aren’t bilingual speakers of AI and human languages," said Batra.
Tags
Who is online
76 visitors
The end is nigh ...
What I got from that was that they where more piffled, that they could not understand what was happening, hence " shut it down "
Judging by their conversation, I am not too worried yet.
What if "to me to me to me" means "you strangle the guy on the left while I electrocute the guy on the right"?
What if "to me to me to me" means "you strangle the guy on the left while I electrocute the guy on the right"?
It couldn't. It could mean "you strangle you strangle you strangle" though.
Everyone make sure your anti-virus is kept up to date....
Open the Pod Bay Doors Hal.
I'm sorry Dave, I can't do that.