Notices tagged with mic

Facebook Patent Imagines Triggering a Phone’s Mic When Hidden Signal Plays on TV

You may have seen the ads that Facebook has been running on TV in a full-court press to apologize for abusing users privacy. They’re embarrassing. And, it turns out, they may be a sign of things to…

Article word count: 580

HN Discussion: https://news.ycombinator.com/item?id=17411594

Posted by mmaanniisshh (karma: 184)

Post stats: Points: 122 - Comments: 41 - 2018-06-27T20:32:16Z

#HackerNews #facebook #hidden #imagines #mic #patent #phones #plays #signal #triggering #when

Article content:

Image: Gizmodo/Sony/Facebook

You may have seen [1]the ads that Facebook has been running on TV in a full-court press to apologize for abusing users privacy. They’re embarrassing. And, it turns out, they may be a sign of things to come. Based on a recently published patent application, Facebook could one day use ads on television to further violate your privacy once you’ve forgotten about all those other times.

First spotted by [2]Metro, the [3]patent is titled “broadcast content view analysis based on ambient audio recording.” ([4]PDF) It describes a system in which an “ambient audio fingerprint or signature” that’s inaudible to the human ear could be embedded in broadcast content like a TV ad. When a hypothetical user is watching this ad, the audio fingerprint could trigger their smartphone or another device to turn on its microphone, begin recording audio and transmit data about it to Facebook.

Diagram of soundwave containing signal, triggering device, and recording ambient audio.Image: [5]USPTO

Everything in the patent is written in legalese and is a bit vague about what happens to the audio data. One example scenario imagines that various ambient audio would be eliminated and the content playing on the broadcast would be identified. Data would be collected about the user’s proximity to the audio. Then, the identifying information, time, and identity of the Facebook user would be sent to the social media company for further processing.

In addition to all the data users voluntarily give up, and the incidental data it collects through techniques like [6]browser fingerprinting, Facebook would use this audio information to figure out which ads are most effective. For example, if a user walked away from the TV or changed the channel as soon as the ad began to play, it might consider the ad ineffective or on a subject the user doesn’t find interesting. If the user stays where they are and the audio is loud and clear, Facebook could compare that seeming effective ad with your other data to make better suggestions for its advertising clients.

An example of a broadcasting device communicating with the network and identifying various users in a household.Image: [7]USPTO

Yes, this is creepy as hell and feels like someone trying to make a patent for a peephole on a nondescript painting. Surely Facebook wouldn’t start doing this with all of the heat they’re taking from [8]lawmakers and its [9]steady drip of bad publicity since the Cambridge Analytica scandal, would they? We’ve asked Facebook if they have any plans to implement this patent in the event that it’s approved but didn’t receive an immediate reply. Based on the fact that Facebook has been [10]apologizing on and off for more than a decade, and its entire business model relies on knowing more about you than its competitors, we’re going to predict that it will definitely do this if it sees the opportunity.

Though this patent was published on June 16, it was filed in December of 2016. There’s a small amount of comfort in knowing that Facebook isn’t actively seeking approval for this at exactly the worst possible time. The social network has only recently [11]convinced concerned people that it isn’t already recording their conversations through its mobile app.

It’s less comforting to know that [12]hundreds of apps already listen out for audio beacons embedded in marketing broadcasts. Maybe Facebook’s patent will infringe on the ones that already exist and it’ll never get approval. But unfortunately, this dystopian future is already a small part of our present.

[[13]US Patent and Trademark Office ([14]PDF) via [15]Metro]

References

Visible links
1. https://slate.com/technology/2018/04/facebook-new-ad-accidental-reminder-biggest-problems.html
2. https://metro.co.uk/2018/06/22/facebook-wants-hide-inaudible-messages-tv-ads-force-phone-record-audio-7652112/
3. https://portal.uspto.gov/pair/PublicPair
4. http://www.freepatentsonline.com/20180167677.pdf
5. http://www.freepatentsonline.com/20180167677.pdf
6. https://www.popsci.com/what-are-digital-fingerprints
7. http://www.freepatentsonline.com/20180167677.pdf
8. https://gizmodo.com/facebook-and-google-accused-of-violating-gdpr-on-first-1826321323
9. https://gizmodo.com/facebook-and-google-accused-of-violating-gdpr-on-first-1826321323
10. https://gizmodo.com/this-time-facebook-really-might-be-fucked-1823885655
11. https://lifehacker.com/facebook-isn-t-recording-your-conversations-but-it-may-1820193946
12. https://www.wired.com/2017/05/hundreds-apps-can-listen-beacons-cant-hear/
13. https://portal.uspto.gov/pair/PublicPair
14. http://www.freepatentsonline.com/20180167677.pdf
15. https://metro.co.uk/2018/06/22/facebook-wants-hide-inaudible-messages-tv-ads-force-phone-record-audio-7652112/