Apple Music is using AI to make karaoke tracks

Apple Music Sing, rolled out with the latest OS update, has a suite of features to turn favorite songs into sing-alongs.

Apple has added a karaoke feature to Apple Music, rolled out in time for serenading on the most important holiday of the year — I’m talking, of course, about Valentine’s Day.

Included in the iOS 16.2 update, Apple Music Sing allows users to independently adjust the volume of the vocals on a track, including fading them away enough to essentially turn them into karaoke backing tracks. The Music app’s enhanced lyric presentation then allows users to sing along (to the best of their abilities).

“We already know our users all over the world love to follow along to their favorite songs, so we wanted to evolve this offering even further to enable even more engagement around music through singing,” Oliver Schusser, vice president of Apple Music and Beats, said.

Apple didn’t comb through all the millions of songs in its library and adjust them one by one, though — Sing leverages machine learning AI, which isolates the vocal tracks in real time and then allows users to independently control the volume. 

Apple didn’t adjust millions of songs in its library one by one — Sing leverages machine learning AI which isolates the vocal tracks in real time and then allows users to independently control the volume. 

The tech is based off of previous work for Apple’s noise canceling and FaceTime applications, TechCrunch reported. And while the vocals get low like they’re wearing boots with the fur, the words aren’t removed fully.

The lyrics function — already “consistently one of the most popular features” of Apple Music, per Schusser — also received an upgrade. 

Real-time lyrics will now move in time to the song, animating every syllable and including visual cues for when artists are holding a note, per TechCrunch. Lyrics will separate and animate backing vocals for easier following along, while a “duet view” splits combined vocals to different sides of the screen.

Android users will get these lyric enhancements, but no slider; currently, the whole kit and kaboodle is limited to compatible iPhones and iPads, as well as Apple TV 4K.

Not every song currently has the Sing feature, which is enabled by using the slider from the lyrics mode. Currently, the feature works with the services’ most popular songs, and 50 playlists have been released with cuts ready to go, including staples like Shania Twain’s “Man! I Feel Like a Woman!”,  newer tracks from acts like Olivia Rodriguo and Gunna, and Rihanna’s “Umbrella,” which Freethink used as a demo.

Apple is second to the karaoke game behind Spotify, which launched theirs in June. But, as Engadget noted, the two services seem to be taking different tacks; Spotify’s records and rates performances, turning them into a game, while Apple Music Sing seems more oriented to karaoke’s party-time roots. 

We’d love to hear from you! If you have a comment about this article or if you have a tip for a future Freethink story, please email us at [email protected]

Related
Kendrick Lamar deepfakes made by South Park creators’ studio 
Rapper Kendrick Lamar harnesses the artistic power of deepfake technology in the new music video for his song “The Heart Part 5.”
Researchers develop a paper-thin loudspeaker 
The flexible, thin-film device has the potential to make any surface into a low-power, high-quality audio source.
World-class choir performs advent carols in VR
The Church of England is releasing performances of advent carols in virtual reality to bring Christmastime to social-distancing parishioners.
Apes and NFTs run the first metaverse music group 
Universal Music Group has just “signed” KINGSHIP, a band of four NFTs of Bored Apes and Mutant Apes, destined to perform in the metaverse.
Decentraland announces the Metaverse Festival
Virtual reality (VR) platform Decentraland is hosting a four-day long Metaverse Festival, with headliners Deadmau5 and Paris Hilton.
Up Next
Chance the Rapper concert film
Subscribe to Freethink for more great stories