Javascript required
Skip to content Skip to sidebar Skip to footer

Okay Let Me Send This Picture to Dasha Not This One but the One With the Baby

The hidden signs that can reveal a fake photograph

Hany Farid and his team showed that Lee Harvey Oswald's stance in the photograph was entirely plausible and so conclude the photo was genuine (Credit: Hany Farid)

A moving-picture show may say a thousand words, but what if the photo has been fabricated? In that location are ways to spot a fake – yous simply have to look closely enough.

BBC Future has brought you lot in-depth and rigorous stories to help y'all navigate the current pandemic, but nosotros know that'south not all yous want to read. So at present we're dedicating a series to help you escape. We'll be revisiting our nigh pop features from the final 3 years in our Lockdown Longreads .

Y'all'll find everything from the story virtually the earth'due south greatest space mission to the truth about whether our cats really love us, the epic hunt to bring illegal fishermen to justice and the small-scale team which brings long-buried Earth War Two tanks back to life. What you won't find is whatever reference to, well, you-know-what. Enjoy.

Take a wait at the photo below – it's just an ordinary picture of two people outside a edifice, right? Ane of them appears to be handing something to the other.

Now take a closer await. Non everything in this motion picture is equally it seems.

Two men exchanging some documents outside? Not necessarily (Credit: James O'Brien and Hany Farid)

Two men exchanging some documents outside? Non necessarily (Credit: James O'Brien and Hany Farid)

The tell-tale signs may non jump out at yous, but to Hany Farid, the image is littered with evidence – one of the reflections in the window is misaligned and the shadows do non line up.

This photograph is a fake. One of the men was not there at all.

Research suggests that regardless of what y'all might think near your own abilities to spot a hoax, near of us are pretty bad at it. Farid, however, looks at photographs in a different way to most people. Equally a leading expert in digital forensics and image analysis, he scrutinises them for the almost imperceptible signs that suggest an image has been manipulated.

I trick he has picked up over time is to check the points of calorie-free in people's optics. "If you have 2 people standing next to each other in a photograph, and then we will frequently come across the reflection of the calorie-free source (such as the Sun or a photographic camera wink) in their eyes," he explains. "The location, size, and colour of this reflection tells the states about the location, size, and colour of the calorie-free source. If these properties of the calorie-free source are not consistent, then the photo may be a composite."

Another giveaway is the colour of people's ears. "If the Lord's day is backside me, my ears will look red from the front considering you'll see the blood," he says. "If the low-cal is coming from the front, you lot won't see the red in the ear."

But Farid as well has some more scientific tools at his disposal. Every bit the chair of computer scientific discipline at Dartmouth College, he has been studying how to spot photographs that have been manipulated for decades.

Some other types of simulated are easier to spot, like this Time magazine encompass that was found displayed in the United states of america President's golf game clubs (Credit: Washington Mail service/Twitter)

Take shadow, for example. If you draw a line from the edge of a shadow in a photo, to a indicate on the object that is casting the shadow, you lot tin can trace that further to reveal where the low-cal in an prototype is coming from. If you lot map out several points on a shadow, the lines should intersect.

If a photo has been tampered with, the shadows of some objects in the prototype may not match the light sources in the rest of the movie, says Farid. He has shown information technology is possible with this method to identify images that have had objects or people added after they were taken.

Tracing the reflections in an image can make it easy to spot fakes if they don't line up (Credit: James O'Brien and Hany Farid)

Tracing the reflections in an image can arrive piece of cake to spot fakes if they don't line up (Credit: James O'Brien and Hany Farid)

Similarly, reflections similar those in the image at the starting time of this article are also a giveaway. Again, by tracing a line from the person or object creating the reflection and their mirror paradigm, they should all converge at a single point somewhere behind the reflective surface. If they practise not, then something has been doctored.

In today'south world, fake images have implications for everything from politics to medicine.

"At that place isn't an election that goes by where you don't see fake photographs in one form or some other," says Farid. "Images will be manipulated to make a candidate await amend. They might create these crowds to add together diversity so the candidate doesn't look similar a racist, or utilize composites to show their opponents in a negative light."

For example, when a picture was "unearthed" during the 2004 presidential election showing so candidate and Vietnam war veteran John Kerry sitting next to Jane Fonda at an anti-state of war rally in 1970, at least one prominent newspaper referred to the epitome, which spread across the internet. It afterwards turned out to be a blended made from two unlike images.

This photo of politician John Kerry was designed to mislead (Credit: Fourandsix.com)

This photograph of politico John Kerry was designed to mislead (Credit: Fourandsix.com)

Faked pictures are clearly not a new phenomenon, and indeed BBC Time to come has reported on their ubiquity earlier. In 2012, for example, nosotros published a guide to fake images of Hurricane Sandy which were doing the rounds at the fourth dimension. You may well take seen the dramatic, but fake, images of supercell storm clouds swirling above the Statue of Liberty. BBC Future writer Rose Eveleth has also reported on the manner that fake images affect memories.

Doctored images emerged as Hurricane Sandy hit New York in 2012

Doctored images emerged as Hurricane Sandy hit New York in 2012

In fact, doctored images take been used since the early on days of photography. Even a famous portrait of US President Abraham Lincoln is widely regarded as a blended, with the president's head added onto the body of another politico (see below). The ubiquity of digital cameras and photo editing software has made the issue more troublesome than e'er.

(Credit: Library of Congress)

Even governments are non above releasing manipulated images – Iran famously released a picture of a missile test in 2008 where ane that had likely failed to launch had been made to look as if it had worked with some creative copy and paste (run across below). When photographs from places like North Korea, Iraq and Syria are used to help governments make crucial security decisions, their veracity must be verified wherever possible, warns Farid.

Iran's show of military might in 2008 was doctored to remove a launcher which failed to fire – and replaced with a fourth projectile. (Courtesy: Fourandsix.com)

Islamic republic of iran'due south prove of military might in 2008 was doctored to remove a launcher which failed to burn – and replaced with a fourth projectile. (Courtesy: Fourandsix.com)

The Defense Advanced Enquiry Projects Agency (Darpa), which develops technology for the US armed forces, is attempting to create a tool that volition automatically notice the manipulation of images and videos and appraise their integrity. Farid is working as a researcher on one of the Darpa teams forth with Kevin Conner, who co-founded paradigm analysis firm Fourandsix with Farid in 2011. They accept licensed their tool izitru, which looks at how a file is packaged and helps determine if an image came directly from the camera, to the bureau.

"The challenge is that the engineering science is not at the stage where you can feed in whatever random image and get dorsum some unequivocal respond," says Conner, who worked at Adobe for 16 years and spent much of that time working on Photoshop. "It may not be possible to really go to that signal, but that is substantially what Darpa is trying to do."

By themselves, though, humans are exceptionally poor at identifying untrustworthy images. A recent study from Stanford Academy, for case, demonstrated that students from centre school to college struggle to analyse whether things they read online are credible. In one exercise, students were shown a photograph of what were supposedly "Fukushima Nuclear Flowers", similar to the image below, posted to a website without credentials. Of the 170 high school students who saw the image, less than 20% successfully questioned the source of the photo.

This effect is not due to radiation, it's actually a natural process called fasciation (Credit: Candiru/Flickr/PD)

This consequence is not due to radiation, it'due south actually a natural process called fasciation (Credit: Candiru/Flickr/PD)

Even if nosotros are sceptical of the source of an prototype, we are yet bad at centre-balling inconsistencies. In one study conducted at the Federal Academy of Rio Grande do Sul in Brazil, for instance, participants were presented with a serial of photos and asked if they had been manipulated. While some of them were not altered in any fashion, more than half had been spliced (meaning that they were a composite of multiple photos), had areas that had been erased, or contained areas that were copied and pasted from the same image. Participants were merely able to spot the fakes nearly 47% of the time.

Victor Schetinger, a doctoral candidate who worked on the report, says friends and colleagues regularly ask him about the legitimacy of photos. "All my research has informed me to conclude that I tin't tell (them) by examining a photo visually," he says. "A lot of things can happen with an image that tin leave artefacts and create something very visually striking. For example, maybe the image was saturated, maybe at that place was a strange wink, possibly a piece of grit on the lens. People will doubtable it's fake, but you shouldn't assume that's the example."

This photo of Barack Obama circulated in 2008, but is fake - the clock is a clue, a reference to a Hillary Clinton TV ad about picking up the phone at 3:00 (Credit: Snopes)

This photo of Barack Obama circulated in 2008, but is simulated - the clock is a clue, a reference to a Hillary Clinton Idiot box ad nearly picking upwards the phone at 3:00 (Credit: Snopes)

If you're curious about your ability to spot the difference between real images and those that take been Photoshopped, Adobe has put together a little online quiz. When I took it, I guessed correctly 15 out of 25 times, or nearly 60% of the time.

  • Take Adobe's fake photograph quiz

"More often than not, people retrieve that the real images are fake and that things that are fake are real," says Farid. "And their confidence is very high. And so people are both ignorant and confident, which is the worst combination."

The solution is to turn to computers to spot the inconsistencies that humans can miss. Photographic forensics uses a bombardment of techniques and algorithms to identify fake photos, many of which examine whether images fit with the laws of physics. While information technology may never be possible to cosign a photograph to 100% confidence, forensics specialists can test photos using a number of techniques.

Let'south look at a famous photograph that has had conspiracy theorists whispering for decades.

This picture of Lee Harvey Oswald has often been claimed by conspiracy theorists to be a fake (Credit: Warren Commission/Wikipedia Eatables)

The photo higher up is of Lee Harvey Oswald, the former U.s. Marine who assassinated President John F Kennedy in 1963. According to regime, the photograph was taken in Oswald's backyard and sent to his friend in April 1963. Investigators used it as prove of Oswald's guilt later matching markings from the rifle in the epitome to the gun plant in the Texas Schoolhouse Book Depository in Dallas, Texas, after the assassination. Questions over the authenticity of the photograph have fueled conspiracy theories that Oswald was framed for the assassination past the authorities, or criminal groups, particularly because Oswald himself denied the photo was existent and was killed past a gunman before he could stand trial.

Conspiracy theorists accept pointed to a few features in the picture equally "bear witness" of tampering – the shadows, particularly those on Oswald'southward face, appear to some every bit if they are cast from a unlike light source than the shadows of other objects in the photo. Oswald'south mentum looks broader than in his mugshot while his opinion supposedly looks odd given the weight of the gun while others dispute the length of the gun itself in the image.

Farid and his colleagues examined the photo in a serial of papers published in 2009, 2010 and 2015. In their analyses, researchers built 3D models of the scene and of Oswald based on his mugshot, his known superlative and weight, and the weight of the gun. They found that the shadows in the scene were consistent with a unmarried light source, with the shadows on his face bookkeeping for the appearance of a broader chin than that in his mug shot.

They also found that his posture was plausible given his middle of mass and the manner he was conveying the gun, and estimated that the length of the rifle in the photograph, after accounting for perspective, was xl.186in (101.2cm) long, less than an inch shorter than the length reported by the manufacturer. In all, the researchers couldn't find any evidence of photo tampering.

Hany Farid and his team showed that Lee Harvey Oswald's stance in the photograph was entirely plausible and so conclude the photo was genuine (Credit: Hany Farid)

Hany Farid and his team showed that Lee Harvey Oswald's stance in the photograph was entirely plausible and and so conclude the photo was genuine (Credit: Hany Farid)

"And then this is a good example of the failure of our visual system to reason correctly," says Farid. "You can't actually fault information technology because at first glance, some aspects of the photo do expect weird. This is an interesting example where the forensic science can show that things that people are pointing to are non actually inconsistent with reality – they are all perfectly physically plausible."

Other methods of authentication have nothing to do with the content of an image, but rather how its data file is packaged by the software that encodes it. When an image comes off a phone or photographic camera, for example, it is often packaged every bit a jpeg file, which uses a type of lossy compression. Usually there tin be a lot of information in a photograph, so to reduce the size of digital files, some of the information is discarded (hence "lossy") based on sure algorithms that make the file smaller. In add-on, there is metadata associated with the paradigm, with information well-nigh when the epitome was taken, what camera was used, how the thumbnail should look, and even the location where it was captured.

"At that place's no such affair every bit a single jpeg format," explains Farid. "Every camera compresses by different amounts. An iPhone compresses a lot more than a high-end SLR, for example. Even a point-and-shoot camera has dissimilar quality settings, and the way they create the thumbnails or shop the metadata is a little different. All those things get embedded into a file."

Law enforcement agencies often use this to help verify whether a picture has been altered since it was downloaded from the camera. "When yous expect into the packaging of a jpeg using code – the order in which all the bits of information are ordered are very specific and are very dissimilar for Photoshop versus an iPhone versus Panasonic or Nikon," explains Farid. "So we can look at the packaging of a file and say this has gone through Photoshop because at that place are these tell-tale signs."

It is withal possible, however, for a photograph to be manipulated and the information reordered to look accurate, but information technology's difficult to do. Farid compares it to trying to repackage an item similar a new computer after yous have taken it out of the box it came in.

"The way the parcel is wrapped with the Styrofoam, etc," he explains. "If you lot try to take it all apart and put it dorsum together, it would exist very hard to get information technology to look the exact aforementioned style. Hiding [file manipulation] is the digital equivalent of that. You tin do it if you lot endeavour really difficult merely it'southward almost impossible, and you about always make mistakes."

By tracing a line from a shadow in an image back to a light source, it is possible to see if something has been added to a picture (Credit: Hany Farid)

Past tracing a line from a shadow in an image back to a low-cal source, it is possible to see if something has been added to a picture (Credit: Hany Farid)

Despite this, Farid emphasises that forensic techniques do not guarantee fake photos can be spotted. They are, even so, creating an arms race between hoaxers and those working in the forensic community.

"They enhance the bar for the level of difficulty and skill required to create a compelling imitation," says Farid. "My hope is that when you run a photo through 20 or and so unlike forensic techniques, and every unmarried 1, from the packaging to the shadows to the colour to the noise is completely consistent, it is more probable that the photo is real."

And then what can the rest of us exercise to spot those pesky false images circulating on the cyberspace? While we might not be able to utilize the total range of forensic techniques at Farid'south disposal to spot inconsistencies in images, there are other ways we can examine photos more critically. Reverse paradigm searches (which can be done at sites like tineye.com or Google Images) are a good way to find out if a specific image has already been revealed as a fake. Reputable sites like snopes.com likewise vet viral images.

Farid also suggests looking at the source of the image. "Photos published on mainstream and reputable news sites similar the New York Times accept a high likelihood of being existent equally compared to photos published on unknown media sites, blogs, or Facebook," he says.

Yet even supposedly reliable news organisations can become duped past a skilful photo. Often the best course of activity is to ask yourself if a photo is simply likewise good to be true.

"A healthy amount of scepticism is always required when consuming digital images," urges Farid. "But don't let that scepticism overwhelm yous as it is but equally easy to think that a real photo is fake, as the other style effectually."

Join 800,000+ Future fans by liking the states on Facebook , or follow us on Twitter .

If you lot liked this story, sign up for the weekly bbc.com features newsletter , chosen "If You Only Read half dozen Things This Week". A handpicked selection of stories from BBC Future, Earth, Culture, Upper-case letter, and Travel, delivered to your inbox every Friday.

Okay Let Me Send This Picture to Dasha Not This One but the One With the Baby

Source: https://www.bbc.com/future/article/20170629-the-hidden-signs-that-can-reveal-if-a-photo-is-fake