Photo Tweaks Could Protect Your Privacy from Algorithms

A new technique could protect your privacy online by safeguarding sensitive information in photos uploaded to social media, researchers say.

The method guards users’ privacy by making subtle changes that are almost imperceptible to humans but render selected features undetectable by algorithms.

In one second, the human eye can only scan through a few photographs. Computers, on the other hand, are capable of performing billions of calculations in the same amount of time. With the explosion of social media, images have become the new social currency on the internet.

Today, Facebook and Instagram can automatically tag a user in photos, while Google Photos can group one’s photos together via the people present in those photos using Google’s own image recognition technology.

Dealing with threats against digital privacy today, therefore, extends beyond just stopping humans from seeing the photos, but also preventing machines from harvesting personal data from images. The frontiers of privacy protection need to be extended now to include machines.

Visual distortion using currently available technologies will ruin the aesthetics of the photograph as the image needs to be heavily altered to fool the machines. To overcome this limitation, the researchers developed a “human sensitivity map” that quantifies how humans react to visual distortion in different parts of an image across a wide variety of scenes.

The development process started with a study involving 234 participants and a set of 860 images. Researchers showed participants two copies of the same image and they had to pick out the copy that was visually distorted.

After analyzing the results, the researchers discovered that multiple factors influence human sensitivity. These factors included things like illumination, texture, object sentiment, and semantics.

Using this “human sensitivity map” the team fine-tuned their technique to apply visual distortion with minimal disruption to the image aesthetics by injecting them into areas with low human sensitivity.

“It is too late to stop people from posting photos on social media in the interest of digital privacy. However, the reliance on AI is something we can target as the threat from human stalkers pales in comparison to the might of machines,” says Mohan Kankanhalli, professor and dean of NUS Computing.

“Our solution enables the best of both worlds as users can still post their photos online safe from the prying eye of an algorithm.”

End users can use this technology to help mask vital attributes on their photos before posting them online and there is also the possibility of social media platforms integrating this into their system by default. This will introduce an additional layer of privacy protection and peace of mind.

The team also plans to extend this technology to videos, which is another prominent type of media frequently shared on social media platforms.

The research will appear in the Proceedings of the 27th ACM International Conference on Multimedia.

This article was originally published in Futurity. It has been republished under the Attribution 4.0 International license.