(Fox News) After a robocall targeted New Hampshire residents with a fraudulent phone call from President Biden, experts are warning that voters may be inundated with content generated by artificial intelligence (AI) with the potential to interfere with the 2024 primary and presidential elections.
While threat actors are using AI to overcome existing security measures and make attacks bigger, faster, and more covert, researchers are now leveraging AI tools to create new defensive capabilities. But Optiv Vice President of Cyber Risk, Strategy and Board Relations James Turgal told Fox News Digital, make no mistake, generative AI poses a “significant threat.”
“I believe the greatest impact could be AI’s capacity to disrupt the security of party election offices, volunteers and state election systems,” he said.
Turgal, a former FBI veteran, noted that a threat actor’s goals can include changing vote totals, undermining confidence in electoral outcomes or inciting violence. Even worse, they can now do so on a massive scale.
Experts say that election offices and staffers need to be trained on social engineering and AI-generated threats for upcoming elections. (Al Drago/Bloomberg/Chip Somodevilla/Chris Delmas/AFP/Getty)
“In the end, the threat posed by AI to the American election system is no different than the use of malware and ransomware deployed by nation-states and organized crime groups against our personal and corporate networks on a daily basis,” he said. “The battle to mitigate these threats can and should be fought by both the United States government and the private sector.”
To mitigate the threat, Turgal suggested that election offices should have policies to defend against social engineering attacks and staff must participate in deep fake video training that informs them on attack vectors, such as email text and social media platforms, in-person and telephone-based attempts.
He also stressed that private sector companies that create AI tools, including large language chatbots, have a responsibility to ensure that chatbots provide accurate information on elections. To do this, companies must confirm their AI models are trained to state their limitations to users and redirect them to authoritative sources, such as official election websites.
When asked by Fox News Digital whether voters may see a larger quantity of AI-generated voices that could potentially sway their decisions, NASA Jet Propulsion Laboratory (JPL) Chief Technology and Innovation Officer Chris Mattmann said, “The cat’s out of the bag.”
The spoof AI call of Biden is currently under investigation by the New Hampshire attorney general’s office and is of unknown origin. Experts said that because programs that can replicate voices are widely available as applications and online services, it is nearly impossible to determine which program created it.
Artificial Intelligence words are seen in this illustration taken on March 31, 2023. (REUTERS/Dado Ruvic/Illustration/File Photo)
The voice, which is a digital manipulation of Biden, told New Hampshire voters that casting their ballot on Tuesday, January 23, would only help Republicans on their “quest” to elect Trump once again.
The voice also claimed their vote would make a difference in November but not during the primary.
While federal laws prosecute knowing attempts to limit people’s ability to vote or sway their voting decisions, regulation on deceptively using AI is still yet to be implemented.
When these audio clips reach such speed and authenticity and are added to AI-generated video trained on millions of hours of clips found in the public lexicon, Mattmann said the predicament gets even worse.
“It’s at that point when they’re literally indiscernible, even from computer programs, that we have a big problem when we start not being able to do some of these steps, like attribution and detection. That’s the moment that you hear everyone worrying about, including myself,” he said.
Years ago, spoof calls and spam calls were typically generated based on a combination of statistical methods and audio dubbing and clipping. Since public figures, such as Biden, are on record with a voice saying many words known to the public, the use of software and careful attention to things like voice tone and background can produce audio that is difficult to differentiate from authentic recordings.
Even on a weak computer, these AI voice models can fully replicate a human voice in around two to eight hours. However, Microsoft’s new text-to-speech algorithm, VALL-E, has shaved voice cloning down to a fraction of the time.
