Google CEO Sundar Pichai milked the woo from a clappy, home-turf developer mob at its I/ O conference in Mountain View this week with a demo of an in-the-works voice deputy feature that is conducive to the AI to make phone calls on behalf of its human owner.
The so-called’ Duplex’ feature of the Google Assistant was shown calling a hair salon to volume a woman’s hair cut, and ringing a eatery to try to book a table — merely to be told it did not accept bookings for less than five people.
At which point the AI changed tack and asked about wait times, earning its owner and controller, Google, the reassuring intel that there wouldn’t be a long wait at the elected time. Job done.
The voice system deployed human-sounding vocal cues, such as’ ums’ and’ ahs’ — to make the” conversational experience more comfy“, as Google couches it in a blog about its aims for the tech.
The voices Google used for the AI in the demos were not synthesized robotic tones but distinctly human-sounding, in both the female and male flavors it showcased.
Indeed, the AI pantomime was apparently realistic enough to convince some of the genuine humans on the other objective of the line that they were speaking to people.
At one point the bot’s’ mm-hmm’ answer even described appreciative giggles from a techie audience that clearly felt in on the’ joke’.
But while the home mob cheered enthusiastically at how capable Google had apparently constructed its prototype robot caller — with Pichai going on to sketch a grand vision of the AI saving people and industries day — the episode is worryingly suggestive of a company that views ethics as an after-the-fact consideration.
One it does not allow to trouble the trajectory of its engineering ingenuity.
A consideration which only seems to get a look in years into the AI dev process, at the cusp of a real-world rollout — which Pichai said would be coming shortly.
Deception by design
” Google’s experimentations do appear to have been designed to deceive ,” concurred Dr Thomas King, a researcher at the Oxford Internet Institute’s Digital Ethic Lab, discussing the Duplex demo.” Because their main hypothesis was’ can you distinguish this from a real person ?’. In this case it’s unclear why their hypothesis was about misrepresentation and not the user experience … You don’t inevitably need to deceive someone to give them a better user experience by voicing naturally. And if they had instead tested the hypothesis’ is this technology better than preceding versions or just as good as a human caller’ they would not have had to deceive people in the experiment.
” As for whether the technology itself is deceptive, I can’t really say what their intent is — but … even if they don’t intend it to delude you can say they’ve been negligent in not inducing sure it doesn’t deceive … So I can’t say it’s definitely deceptive, but there should be some kind of mechanism there to let people know what it is they are speaking to .”
” I’m at colleges and universities and if you’re going to do something which involves deception you have to really demonstrate there’s a scientific value in doing this ,” he added, agreeing that, as a general principle, humen should always be able to know that an AI they’re interacting with is not a person.
Because who — or what — you’re interacting with” shapes how we interact”, as he set it.” And if you start blurring the lines … then this can sew mistrust into all kinds of interactions — where we would become more suspicious as well as needlessly replacing people with meaningless agents .”
No such ethical dialogues troubled the I/ O stage, however.
Yet Pichai told Google had been working on the Duplex technology for “many years”, and went in so far as to claim the AI can ” understand the nuances of conversation” — albeit still plainly in very narrow scenarios, such as booking an appointment or reserving a table or asking a business for its opening hours on a specific date.
” It brings together all our investments over the years in natural language appreciation, deep learning, text to speech ,” he said.
What was yawningly absent from that list, and seemingly also lacking from the design of the tricksy Duplex experiment, was any sense that Google has a deep and nuanced appreciation of the ethical concerns at play around AI technologies that are powerful and capable enough of passing off as human — thereby playing lots of real people in the process.
The Duplex demos were pre-recorded, rather than live telephone call, but Pichai described the calls as “real” — indicating Google representatives had not in fact called the businesses ahead of time to warn them its robots might be calling in.
” We have many of these instances where the calls quite don’t go as expected but our assistant understands the context, the subtlety … and managed the interaction gracefully ,” he added after airing the restaurant unable-to-book example.
So Google appears to have trained Duplex to be robustly deceptive — i.e. to be able to reroute around derailed conversational expectations and still pass itself off as human — specific features Pichai lauded as’ graceful’.
And even if the AI’s performance was more patchy in the wild than Google’s demo suggested it’s clearly the CEO’s goal for the tech.
While trickster AIs might bring to mind the iconic Turing Test — where chatbot developers compete to develop conversational software capable of convincing human judges it’s not artificial — it should not.
Because the application of the Duplex technology does not sit within the context of a high profile and so clear competition. Nor was there a set of rules that everyone was shown and agreed to beforehand( at least so far as we are aware — if there were any rules Google wasn’t publicizing them ). Rather it seems to have unleashed the AI onto unsuspecting business staff who were just going about their day chores. Can you insure the ethical disconnect?
” The Turing Test has come to be a bellwether of testing whether your AI software is good or not, based on whether you can tell it apart from a human being ,” is King’s suggestion on why Google might have chosen a similar trick as an experimental showcase for Duplex.
” It’s very easy to tell seem how great our software is, people cannot tell it apart from a real human being — and perhaps that’s a much stronger selling point than if you say 90% of users favor this software to the previous software ,” he posits.” Facebook does A/ B testing but that’s probably less exciting — it’s not going to wow anyone to tell well consumers favor this slightly deeper shade of blue to a lighter shade of blue .”
Had Duplex been deployed within Turing Test conditions, King also induces the point that it’s rather less likely it would have taken in so many people — because, well, those slightly jarringly day ums and ahs would soon have been spotted, uncanny valley style.
Ergo, Google’s PR flavored’ AI test’ for Duplex is also rigged in its favor — to further supercharge a one-way promotional marketing message around artificial intelligence. So, in other words, say hello to yet another layer of fakery.
How could Google introduce Duplex in a way that would be ethical? King reckons it would need to state up front that it’s a robot and/ or use an appropriately synthetic voice so it’s instantly clear to anyone picking up the phone the caller is not human.
” If you were to use a robotic voice there would also be less of a risk that all of your voices that you’re synthesizing merely represent a small minority of the population spoke of’ BBC English’ and so, perhaps in a sense, use a robotic voice would even be less biased as well ,” he adds.
And of course , not being up front that Duplex is artificial embeds all sorts of other knock-on hazards, as King explained.
” If it’s not obvious that it’s a robot voice there’s a risk that people come to expect that most of these phone calls are not genuine. Now experiments have shown that many people do interact with AI software that is conversational just as they would another person but at the same period there is also evidence showing that some people do the exact opposite — and they become a lot ruder. Sometimes even abusive towards conversational software. So if you’re constantly interacting with these bots you’re not going to be as polite, perhaps, as you usually would, and who are likely have effects for when you get a genuine caller that you do not know is real or not. Or even if you know they’re real perhaps the route you interact with people has changed a bit .”
Safe to say, as autonomous systems get more powerful and capable of performing tasks that we would normally expect a human to be doing, the ethical considerations around those systems scale as exponentially large as the health risks applications. We’re really just getting started.
But if the world’s biggest and most powerful AI developers believe it’s totally fine to set ethics on the backburner then risks are going to spiraling up and out and things could go very badly indeed.
We’ve seen, for example, how microtargeted advertising platforms have been hijacked at scale by would-be election fiddlers. But the overarching hazard where AI and automation technologies are concerned is that humans become second class citizens vs the tools that are being claimed to be here to help us.
Pichai said the first — and still, as he set it, experimental — use of Duplex will be to supplement Google’s search services by filling in information about industries’ opening periods during periods when hours might inconveniently vary, such as public holidays.
Though for a company on a general mission to’ organize the world’s information and make it universally accessible and useful’ what’s to stop Google from — down the line — deploying vast phalanx of phone bots to ring and ask humen( and their associated businesses and organizations) for all sorts of expertise which the company can then liberally extract and inject into its multitude of connected services — monetizing the freebie human-augmented intel via our extra-engaged attention and the ads it serves alongside?
During the course of writing this article we reached out to Google’s press line several times to ask to discuss the ethics of Duplex with a relevant company representative. But ironically — or perhaps fittingly enough — our hand-typed emails received only automated responses.
Pichai did emphasize that the technology is still in development, and told Google wants to” work hard to get this right, get the user experience and the high expectations right for both businesses and users “.
But that’s still ethics as a tacked on afterthought — not where it should be: Locked in place as the keystone of AI system design.
And this at a time when platform-fueled AI problems, such as algorithmically fenced fake news, have snowballed into huge and ugly global scandals with very far reaching societal implications indeed — be it election interference or ethnic violence.
You really have to wonder what it would take to shake the’ first transgres it, later fix it’ethos of some of the tech industry’s major players…