9 telltale signs that the video you are watching on social media might be a deepfake

2 months ago 27

With the world seeing some major elections across the world this year, especially in the US, UK and France, there has been an avalanche deepfakes. Identifying deepfakes, in such a scenario, becomes extremely important read more

9 telltale signs that the video you are watching on social media might be a deepfake

While the UK election has seen relatively few deepfake incidents, examples from around the world, particularly in the US, highlight the growing prevalence of this technology.

2024 has been the year when deepfakes really took off. Not only has this been a pivotal election year, in several countries like the UK, US, and France which have been gearing up for critical polls, the year has also seen disinformation spreading rampant across social media platforms with a rather feverish ferocity.

Up until the junior leagues, deepfakes of celebrities have been used to scam people, by mainly getting them to “invest” in dubious schemes and apps. Now deepfakes in one of the most important election years, we are seeing a ton of AI-generated images or audio of political figures — making some bizarre statement and behaving in a rather odd way.

While the UK election has seen relatively few deepfake incidents, examples from around the world, particularly in the US, highlight the growing prevalence of this technology. Here’s a guide to identifying deepfakes and understanding their implications.

Identifying Deepfakes: Key Visual Clues

No coherence between body proportions or skintones: Disproportionate facial and body sizes, along with mismatched skin tones, can also signal a deepfake. In March 2022, a video of Ukrainian President Volodymyr Zelenskiy asking civilians to surrender to Russian forces was debunked when viewers noticed the head was disproportionately large compared to the body.

Deepfake 4-2024-07-f3da4007c89b387f500e33edd823efb0Screengrab of a deepfake video of Ukrainian President Volodymyr Zelenskiy, asking Ukranian armed forces to lay down their weapons and surrender to Russia.

Such “puppet-master” deepfakes often reveal their inauthenticity through immobile body parts below the neck.

Extra fingers and limbs: AI-generated images often fail to accurately render human anatomy, resulting in extra fingers or distorted limbs. An image purportedly showing US President Joe Biden and Vice President Kamala Harris celebrating Donald Trump’s indictment circulated on Twitter in April 2023. The image was flagged as a deepfake due to Harris’s right hand having six fingers and other visual inconsistencies like a distorted flag and awry floor patterns.

No real alphabets or numbers: AI image generators struggle with reproducing text and numbers. A fake mugshot of Trump published in April 2023 featured nonsensical letters and numbers in the background instead of a coherent height chart. Such garbled text is a clear indication of AI involvement, as these tools lack the understanding to generate meaningful symbols.

Deepfake 7-2024-07-f9bad3e2f355ca9807ef9050d1f2a452Screengrab of a deepfake video of former US president Donald Trump, getting arrested and photographed for a mugshot. Notice the garbled text on the wall behind him.

Odd-shaped mouth and chin when speaking: One of the most telling signs of a deepfake video is the area around the mouth. Deepfake technology often struggles with rendering this part of the face accurately, leading to fewer wrinkles, less detail, and sometimes a blurry or smudged appearance. Additionally, poor synchronization between a person’s voice and their mouth movements can be a red flag.

For instance, a deepfake video posted in June 2024 depicted Nigel Farage, a political leader, heading the UK’s Reform Party, destroying Rishi Sunak’s house in the video game Minecraft. The imperfect sync between Farage’s voice and mouth movements further indicated the video was manipulated.

Bizarre video edits: Some manipulated videos are so poorly edited that they are easily spotted. Known as “cheapfakes,” these use simple video-editing software to create misleading content.

Deepfake 1-2024-07-e9b4626d44e05568223fba94c5768072Screengrab from a deepfake video of presidential candidate Claudia Sheinbaum, claiming that she would close down churches in the country.

Before the Mexican elections, a video of then-presidential candidate Claudia Sheinbaum was edited to make it appear she wanted to close churches. The video was a patchwork of different clips, including one where she was actually refuting the false claim, highlighting how amateurish editing can reveal a video’s inauthenticity.

No concept of continuity: Another sign of deepfakes is inconsistency within the video. A video circulated in May 2024 falsely showed US State Department spokesperson Matthew Miller justifying Ukrainian military strikes on the Russian city of Belgorod.

Deepfake 3-2024-07-1f5e1d065eae83b89931f9badf6d8ad2Screengrab of a deepfake video of US State Department spokesperson Matthew Miller.

The clip had glaring inconsistencies, such as Miller’s tie and shirt changing colour mid-video, indicating manipulation. Such noticeable changes are often indicative of deepfake technology at play.

Strange speech patterns: Deepfake videos may also have odd speech patterns. For example, a deepfake of Keir Starmer selling an investment scheme used audio edited over his 2023 New Year address. The video’s sentence structure was peculiar, with Starmer saying “pounds” before numbers, suggesting the use of a text-to-audio tool that failed to mimic natural speech patterns accurately. This, coupled with a blurred lower facial area and out-of-sync voice and mouth movements, pointed to the video’s artificial nature.

The minute details: Most people who come across a deepfake are usually scrolling through their social media feeds very casually, that is what makes it difficult for people to spot a deepfake. However, if one is to observe a given deepfake very carefully, especially if it is an AI-generated image, they will see that it has a ton of idiosyncracies.

Deepfake 9-2024-07-bf64523a17ab63786ba2fd2426b18857Deepfaked images of Pope Francis in a puffer jacket. These images went viral. Notice the crucifix and the chain, the Pope’s fingers around the coffer cup, and his glasses.

A case in point would be this image of Pope Francis in a luxury puffer jacket. If you look at the image very carefully, you’ll observe, that many things defy conventional wisdom. The crucifix, for example, is hanging perfectly, but by just one-half of the chain. The Pope’s fingers, look very odd around the cup.

Glasses and Mirrors: As sophisticated as deepfakes have become, they have a really tough time dealing with glasses and mirrors. Even though the computers or clouds that most deepfakes are made on are very powerful and can run circles around practically anything when it comes to physics, they somehow struggle to digitally create how light interacts with glasses or mirrors. Again, lets take the example of Pope Francis here. In the aforementioned image, notice how his glasses sort of blend into his skin. Engines that are used to create deepfakes have a really tough time processing refraction and reflection

How to stay vigilant against deepfakes
As generative AI technology evolves, deepfake detection becomes increasingly challenging. Experts like Dr Mhairi Aitken from the Alan Turing Institute emphasize the importance of common sense and scepticism when encountering potentially misleading media. Comparing suspicious videos with known real footage of the individuals can help identify inconsistencies in voice, mannerisms, and expressions.

Deepfakes not only threaten to mislead voters but also undermine trust in authentic media. Awareness and critical evaluation of digital content are crucial in navigating the information landscape during this election year. As disinformation tactics grow more sophisticated, staying informed and vigilant is the best defence against the manipulation of public opinion.

Read Entire Article