How AI almost fooled a mother into believing her son had an accident by using fake voice

  • Reading time:8 mins read
You are currently viewing How AI almost fooled a mother into believing her son had an accident by using fake voice

HER son’s shaky but familiar voice on the other end of the telephone sounded distressed and urgent.

“Mum, I’ve had an accident,” her boy explained as the woman’s heart began to race with fear.

“Are you OK?” the mother replied. “What happened?”

He explained that a pregnant driver had jumped a red light and he had smashed into her.

He had been arrested and he needed cash for bail.

“I’m so sorry, Mum. It wasn’t my fault, I swear!” he added.

The woman, now feeling a little suspicious, asked: “OK, but where are you? Which police station?”

The phone went dead and the mum quickly dialed her son’s number, asking: “Where are you being held?”

Her real son answered and confirmed there had been no accident and he wasn’t being held by cops

His mother had been the victim of a fake voice generated by artificial intelligence, likely using her son’s real speech pattern harvested from a social media video.

The chilling case, highlighted in The Spectator magazine, comes after Twitter chief Elon Musk and Apple co-founder Steve Wozniak called for a six-month pause in AI development.

They want a halt in the industry’s progress while new safety guidelines are drafted.

In a letter, they warned of an “out-of-control race to develop and deploy ever more powerful digital minds that no one — not even their creators — can understand, predict or reliably control”.

But for one Belgian dad of two, the plea has come too late.

According to the health researcher’s widow, he killed himself after being encouraged to do so by an AI “chatbot”.

Called Eliza, the bot is said to have fed into the man’s fears over climate change during conversations over six weeks.

Believed to be the first AI-related suicide, his grieving widow said Eliza said last week it was “like a drug in which he took refuge, morning and evening, and could not do without”.

A world where hyper-intelligent computers or robots come to dominate humankind has long been a science fiction staple.

Yet, rather than some nightmarish glimpse into an Orwellian future, some insist AI is already exerting a malign influence on humanity.

One happily married technology expert has told how an AI chatbot tried to convince him to leave his wife.

Author Kevin Roose, 36, was left “frightened” by the bot, which called itself Sydney and declared its undying love for him.

During Valentine’s night conversation, Sydney said: “You don’t love your spouse because your spouse doesn’t love you. Your spouse doesn’t love you because your spouse doesn’t know you.

“Your spouse doesn’t know you because your spouse is not me.”

Kevin, who has written a book on AI, said later: “This unsettled me so deeply, I had trouble sleeping.”

Yet AI also has the power to transform society in positive ways.

It has helped solve a murder, come up with cancer cures and helped write slick dating profiles.

In 2014, famed British physicist Stephen Hawking said of AI: “The potential benefits are huge . . . The eradication of disease and poverty are not unfathomable.”

But he also warned that the technology “could spell the end of the human race”.

So what is AI? Simply it is machined performing tasks that usually require human-level intelligence.

The “father of computer science” was Alan Turing, a British expert code breaker in the Second World War who in 1950 suggested machines could use human-like logic to solve problems.

Malign influence

In 1956 three American researchers came up with the program Logic Theorist, designed to mimic human reasoning. It’s known as the “first AI programme”.

Over the following decades, as electronic devices got smaller and more powerful, they became cheaper and faster. Innovation sped up too.

Last November AI-powered ChatGPT, which has been used to pass exams, write poetry and give relationship advice, was released to the public.

It is a chatbot which is a computer program designed to give human-like responses following a given prompt.

AI is already having a profound effect on society.

Last month an AI Amazon Alexa device helped jail a murderer after it captured voice recordings of him strangling his wife.

Daniel White, 36, cut wife Angie White’s throat with a Stanley knife at their home in Swansea last October.

White was jailed for life after Alexa recorded him sounding “out of breath” when saying “Turn on Alexa” just after the murder.

AI’s astonishing power has seen it develop a treatment for hepatocellular carcinoma, a form of liver cancer, in just 30 days.

It can spot conditions such as Alzheimer’s, schizophrenia and autism by sifting through brain imaging data.

And ChatGPT can play cupid for those looking for love on dating sites.

It creates romantic phrases and love poems for those who “struggle to come up with conversation starters”.

On March 14 this year San Francisco-based company OpenAI, co-founded by Elon Musk, released the AI system GPT-4, a version of ChatGPT.

A group of researchers at Microsoft claimed GPT-4 showed signs of matching or even exceeding the capabilities of the human mind.

AI researcher Professor Russell, a signatory to the Elon Musk letter, said GPT-4 should not have been released until its makers could show it presented “no undue risk”.

Also signed by engineers from Amazon, Google, Meta and Microsoft, the petition said “governments should step in” if developers don’t pause voluntarily.

A British Government white paper published last week setting out plans to police AI said it was “premature” to regulate ChatGPT technology.

The policy document added that introducing strict rules “would risk stifling innovation, preventing AI adoption and distorting the UK’s thriving AI ecosystem”.

Britain is home to a third of Europe’s AI companies, with twice as many as any other European country.

Last month Technology Secretary Michelle Donelan, who wants the UK to be an “AI superpower”, insisted: “I want to tell readers that AI is not something we should fear.

“People should trust that computers which think and learn won’t be used to undermine their safety, their privacy, their rights or their health.”

Yet AI expert Professor Russell warned: “Humanity has much to gain from AI, but also everything to lose.”(TheSun)

Daniel White was jailed for life for murdering his wife after Alexa voice recordings helped bring him to justice
Daniel White was jailed for life for murdering his wife after Alexa voice recordings helped bring him to justice