Apple to check iCloud, iPhone photo uploads for child abuse images

Apple will scan photo libraries stored on iCloud and iPhones in the US for known images of child sexual abuse, the company says, drawing praise from child protection groups but crossing a line that privacy campaigners warn could have dangerous ramifications. The company will also examine the contents of end-to-end encrypted messages for the first time. The system, as per a Financial Times report, is called NeuralMatch.

It aims to leverage a team of human reviewers to contact law enforcement authorities when it finds images or content relating to Child Sexual Abuse Material (CSAM). The said system was reportedly trained using 200,000 images from the National Center for Missing and Exploited Children. As a result, it will scan, hash, and compare the photos of Apple users with a database of known images of child sexual abuse.

“According to people briefed on the plans, every photo uploaded to iCloud in the US will be given a ‘safety voucher,’ saying whether it is suspect or not. Once a certain number of photos are marked as suspect, Apple will enable all the suspect photos to be decrypted and, if apparently illegal, passed on to the relevant authorities,” said the Financial Times report.

Now, following the report, Apple published an official post on its Newsroom to further explain how the new tools work. These tools are developed in collaboration with child safety experts and will use on-device machine learning to warn children as well as parents about sensitive and sexually explicit content on iMessage.

Furthermore, the Cupertino giant added that it will integrate “new technology” in iOS 15 and iPadOS 15 to detect CSAM images stored in iCloud Photos. If the system detects images or content relating to CSAM, Apple will disable the user account and send a report to the National Center for Missing and Exploited Children (NCMEC). However, if a user is mistakenly flagged by the system, they can file an appeal to recover the account.

How Apple’s new system will work?

Here is how Apple’s system works, Law enforcement officials maintain a database of known child sexual abuse images and translate those images into “hashes” – numerical codes that positively identify the image but cannot be used to reconstruct them.

When a user uploads an image to Apple’s iCloud storage service, the iPhone will create a hash of the image to be uploaded and compare it against the database. Photos stored only on the phone are not checked, Apple said, and human review before reporting an account to law enforcement is meant to ensure any matches are genuine before suspending an account.

Possible Implications behind this system

Matthew Green, a cryptography researcher at Johns Hopkins University, warned that the system could theoretically be used to frame innocent people by sending them seemingly innocuous images designed to trigger matches for child abuse images. “Researchers have been able to do this pretty easily,” he said of the ability to trick such systems.

Other abuses could include government surveillance of dissidents or protesters. “What happens when the Chinese government says: ‘Here is a list of files that we want you to scan for,’” Green asked. “Does Apple say no? I hope they say no, but their technology won’t say no.”

Other privacy researchers such as India McKinney and Erica Portnoy of the Electronic Frontier Foundation wrote in a blog post that it may be impossible for outside researchers to double check whether Apple keeps its promises to check only a small set of on-device content.

The move is “a shocking about-face for users who have relied on the company’s leadership in privacy and security,” the pair wrote.

A big question is why now and not sooner. Apple said its privacy-preserving CSAM detection did not exist until now. But companies like Apple have also faced considerable pressure from the U.S. government and its allies to weaken or backdoor the encryption used to protect their users’ data to allow law enforcement to investigate serious crime.

Also Read:

LEAVE A REPLY

Please enter your comment!
Please enter your name here

This site uses Akismet to reduce spam. Learn how your comment data is processed.

More like this

Apple Watch SE Refresh: A Plastic Chassis Sparks Controversy Among Apple’s Design Team

Apple Watch SE Refresh: A Plastic Chassis Sparks Controversy...

Apple is known for its premium materials, but a major shift could be on the horizon. Reports...
M5 MacBook Air: Apple’s Next-Gen Laptop Already in Development

M5 MacBook Air: Apple’s Next-Gen Laptop Already in Development

Apple’s M5 MacBook Air is already in development despite recent M4 launch. Discover release timeline, expected specs,...
Apple Watch With a Camera? Here’s What to Expect by 2027

Apple Watch With a Camera? Here’s What to Expect...

Apple is set to revolutionize the wearable tech industry once again. Reports suggest that by 2027, we...
Apple's Next-Gen AirPods May Feature Tiny Infrared Cameras

Apple’s Next-Gen AirPods May Feature Tiny Infrared Cameras

Apple is reportedly working on a groundbreaking upgrade for future AirPods—integrating tiny infrared cameras to enhance spatial...
iPhone 18 to Feature Breakthrough 2nm A20 Chip: What This Means for Performance

iPhone 18 to Feature Breakthrough 2nm A20 Chip: What...

Apple is gearing up to make history with the iPhone 18, as renowned analyst Ming-Chi Kuo confirms...

LATEST NEWS

Final Fantasy 9 Remake Speculation Grows After Anniversary Site Launch

Square Enix has reignited excitement for a potential Final Fantasy 9 remake by launching an official website celebrating the game's 25th anniversary. The new...

IPL 2025: LSG Edge MI in Thriller as Marsh, Markram Shine and Avesh Holds Nerve at Death

Tilak Varma retired out while Hardik Pandya took charge of strike rotation, but their late push wasn’t enough as Mumbai Indians (MI) fell short...

Motorola Razr 60 & 60 Ultra Leak Reveals Design, Specs & Colors

Motorola's upcoming foldable phones, the Razr 60 and Razr 60 Ultra, have surfaced online ahead of their official launch. Although the company has not...

IPL 2025: PBKS vs RR – Preview, Prediction, Starting XI and Where To Watch The Match LIVE

IPL 2025 promises more excitement as Punjab Kings take on Rajasthan Royals in Match 18, scheduled for Saturday, April 5, at the Maharaja Yadavindra...

Featured