Apple Music is using AI to make karaoke tracks

Apple Music Sing, rolled out with the latest OS update, has a suite of features to turn favorite songs into sing-alongs.

Apple has added a karaoke feature to Apple Music, rolled out in time for serenading on the most important holiday of the year — I’m talking, of course, about Valentine’s Day.

Included in the iOS 16.2 update, Apple Music Sing allows users to independently adjust the volume of the vocals on a track, including fading them away enough to essentially turn them into karaoke backing tracks. The Music app’s enhanced lyric presentation then allows users to sing along (to the best of their abilities).

“We already know our users all over the world love to follow along to their favorite songs, so we wanted to evolve this offering even further to enable even more engagement around music through singing,” Oliver Schusser, vice president of Apple Music and Beats, said.

Apple didn’t comb through all the millions of songs in its library and adjust them one by one, though — Sing leverages machine learning AI, which isolates the vocal tracks in real time and then allows users to independently control the volume. 

Apple didn’t adjust millions of songs in its library one by one — Sing leverages machine learning AI which isolates the vocal tracks in real time and then allows users to independently control the volume. 

The tech is based off of previous work for Apple’s noise canceling and FaceTime applications, TechCrunch reported. And while the vocals get low like they’re wearing boots with the fur, the words aren’t removed fully.

The lyrics function — already “consistently one of the most popular features” of Apple Music, per Schusser — also received an upgrade. 

Real-time lyrics will now move in time to the song, animating every syllable and including visual cues for when artists are holding a note, per TechCrunch. Lyrics will separate and animate backing vocals for easier following along, while a “duet view” splits combined vocals to different sides of the screen.

Android users will get these lyric enhancements, but no slider; currently, the whole kit and kaboodle is limited to compatible iPhones and iPads, as well as Apple TV 4K.

Not every song currently has the Sing feature, which is enabled by using the slider from the lyrics mode. Currently, the feature works with the services’ most popular songs, and 50 playlists have been released with cuts ready to go, including staples like Shania Twain’s “Man! I Feel Like a Woman!”,  newer tracks from acts like Olivia Rodriguo and Gunna, and Rihanna’s “Umbrella,” which Freethink used as a demo.

Apple is second to the karaoke game behind Spotify, which launched theirs in June. But, as Engadget noted, the two services seem to be taking different tacks; Spotify’s records and rates performances, turning them into a game, while Apple Music Sing seems more oriented to karaoke’s party-time roots. 

We’d love to hear from you! If you have a comment about this article or if you have a tip for a future Freethink story, please email us at [email protected]

AI is already making “functional music” for major label artists
UMG has teamed up with an AI startup to turn its artists’ music into “soundscapes” designed to help listeners sleep, focus, and more.
How AI is changing music forever
Musicians and technologists Holly Herndon and Mat Dryhurst discuss the AI music revolution and the critical importance of artist consent in building this new future
These “AI Artists” don’t want to ape existing art — they want to create something new entirely
We sat down with two prominent AI artists to talk about their projects and their quest to create new genres.
Listening to the right tunes can prevent motion sickness in VR
Playing “joyful” music can reduce the symptoms of cybersickness from VR, according to a small study out of Scotland.
Google’s AI music generator is like ChatGPT for audio
Google has unveiled MusicLM, an advanced AI music generator that can produce audio based on a short text description.
Up Next
Kendrick Lamar deepfake music video
Subscribe to Freethink for more great stories