Post Syndicated from Charles Q. Choi original https://spectrum.ieee.org/tech-talk/consumer-electronics/portable-devices/google-hum
To use the new feature on a mobile device, open the latest version of the Google app or find the Google Search widget. Tap on the mic icon and say “what’s this song?” or click the “Search a song” button. Then start humming for 10 to 15 seconds. On Google Assistant, say, “Hey Google, what’s this song?” and then hum the tune. Perfect pitch is not needed.
The new feature is based on machine learning models that analyze each hum, whistle or singing and remove details such as accompanying instruments and the voice’s timbre and tone. They next compare the melody to thousands of songs from around the world.
The feature will show users a list of the most likely songs based on the melody. They can then select a match, explore information on the song and artist, view any accompanying music videos or listen to the song, find the lyrics, or check out other recordings of the song if they are available.
“It could certain help connect musical artists and the music industry with customers,” says Chris Rodgers, CEO and founder of Colorado SEO Pros. “In the music creation process, musicians might come up with amazing ideas, and it’ll turn out those came from something they heard and replayed in their mind one-hundred times and then thought it was their own brilliant idea. So maybe this new feature could almost be a way to do an [intellectual property] check. ‘I’ve got this amazing song, but is it really similar to something else out there?'”
Moreover, a user might hear a jingle in a commercial or some message from social media and want to identify those melodies. “I can see Google try to monetize that opportunity like they try to monetize everything,” Rodgers says.
The new feature is currently available in English on iOS, and in more than 20 languages on Android. Google plans to expand it to more languages in the future.
“It’s a cool feature. I don’t think it has big commercial applications at this point, but I do think it helps the Google brand,” Rodgers says.
One concern with this new feature is that Google may use such technology to covertly identify people by the sounds of their voices. “We know the technology is already there for the big tech companies to turn on receivers in phones,” Rodgers says. “And there’s a lot of anecdotal evidence that some of them may be listening to you. Facebook has denied this up and down, but I myself have anecdotal evidence.”
“These are hard questions none of us have the answers to,” Rodgers says. “We’re all navigating a world of variables and unknowns hoping these companies have our best interests in mind while trying to enjoy the quote-unquote free technology they have, but at the end of the day, we know it comes at some kind of price.”