麻豆传媒

Apple will inspect every photo uploaded to the cloud by US users of iPhones and iPads to detect images of child sexual abuse, and will report any found to a nonprofit that investigates cases of child exploitation. The new measure has been praised by child welfare charities but condemned by privacy campaigners, who believe it opens the door to other types of surveillance from authoritarian governments.

Rather than examining the photographs themselves, will include an algorithm that creates a string of characters 鈥� a hash 鈥� unique to each photo on the device. It will then compare these to hashes of known abuse images from child safety organisations. It says that this will be done on the customer鈥檚 device rather than company servers so Apple will never see the contents, even when flagged as possible abuse images.

Any positive matches will trigger a human double-check of the photo鈥檚 hash within Apple and if this confirms a match with the hash of a known image containing child sexual abuse, the information will be reported to the US nonprofit organisation , which will pass them on to law enforcement to decide whether to make a legal request either to see the images or for information about the device鈥檚 owner. The feature will launch later this year in the US as an update to iOS and iPadOS.

Andy Burrows at the UK聽 says he would welcome Apple launching the system in the UK, too. While Facebook refers millions of images of child sexual abuse to authorities each year, Apple refers just a handful because its messaging system and image storage systems are encrypted and it cannot tell what content is being sent or stored. 鈥淚t鈥檚 an innovative and very welcome step, and it鈥檚 one that we鈥檇 like to see extended to the UK as quickly as possible,鈥� says Burrows.

Of all the technology giants, Apple is considered to be the strongest on privacy. Its business model is more about selling high-end devices and services than collecting data on customers and advertising to them, so it can differentiate itself by taking a strong stance on protecting its customers鈥� data. But neuralMatch has sparked a backlash among campaigners and academics. An open letter calling for the technology to be scrapped has been signed by privacy groups, academics and 6000 individuals.

at the Electronic Frontier Foundation says the tool is聽 鈥渁 backdoor to encryption鈥� that will ultimately allow governments to snoop on the photos we take, with users not necessarily aware it is happening.

鈥淲e all agree that child exploitation is a serious problem,鈥� she says. 鈥淏ut it鈥檚 only a matter of time before lawmakers and governments seek to use this backdoor technology to filter out speech they don鈥檛 like.鈥�

at Privacy International agrees that the tool risks 鈥渙pening the door to mass surveillance鈥� around the world. 鈥淏y opening the floodgates, even for something as important as protecting children, Apple and the rest of the industry will inevitably be unable to resist doing the same for other reasons and for other governments,鈥� he says.

Apple didn鈥檛 respond to a request for an interview but said that it would refuse any requests from governments to turn the technology on images other than those of child sexual abuse.

鈥淲e have faced demands to build and deploy government-mandated changes that degrade the privacy of users before, and have steadfastly refused those demands. We will continue to refuse them in the future,鈥� it said.

But there is certainly cause for concern about what authoritarian governments would request Apple tracks using neuralMatch if the service launched globally. Apple has at times from handsets sold in a few countries including Saudi Arabia by government request, and a recent New York Times investigation revealed that have been made for the Chinese government also.

Currently neuralMatch will be used only in the US, but at law firm decoded.legal says it is unlikely that Apple would build such a complex system only to use it in one country. Many believe it will gradually be turned on around the world.

Brown says that the feature is likely to be allowed under EU law, which demands that anyone collecting data on individuals either seeks their consent or uses only what is absolutely needed to run a service for that person. It is possible that Apple could make the case that preventing images of child sexual abuse on its cloud service is an essential measure in providing that service, he says.

Brown, too, points out that the system could easily be misused by governments. Alternatively, media companies may be keen to use a version of the software to catch people sharing copyrighted content. 鈥淲here does it stop?鈥� he asks.

There are also fears that neuralMatch could provide false positives. Although Apple says that the system will see less than one in a trillion false positives every year, at Princeton University says it is difficult to see how it arrived at that number.

鈥淓ven if Apple did test on real accounts, there aren鈥檛 a trillion iCloud users 鈥� and you鈥檇 actually need even more accounts than that to have statistical confidence,鈥� he says. 鈥淯ltimately a system like this depends on trust in Apple, NCMEC and other involved parties.鈥�

Mayer has urging caution on systems like neuralMatch because of issues with privacy and false positives. 鈥淚t鈥檚 disappointing that, just as we were urging caution and further research, Apple was barreling forward with implementation. And it鈥檚 even more disappointing that Apple hasn鈥檛 meaningfully acknowledged those problems, let alone explained how it鈥檚 going to address them,鈥� he says.