ResourcesMusic TranscriptionAndrew Carlins•9 min read

Can AI Transcribe Multiple Instruments at Once?

Yes. Songscription's Multi-Instrument mode transcribes a mixed recording in one pass, with a separate part for each instrument it hears. It still helps to understand the two problems hiding in the question, polyphony and separating instruments, and when a single-instrument pass is the better tool.

Can AI Transcribe Multiple Instruments at Once?

Part of our guide to transcribing a full band.

It is one of the first things people ask about AI transcription: can it take a full song, with drums and bass and guitar and vocals all going at once, and write out every part? The answer is now yes. Songscription's Multi-Instrument mode transcribes a mixed recording in one pass and gives you a separate part for each instrument. That said, the question is really two questions wearing one coat, and understanding both helps you get better results and pick the right mode.

It comes down to a word people use loosely. Reading many notes at once from a single instrument is polyphony, and AI does it well, especially on piano. Pulling several different instruments apart from one mixed recording is multi-instrument transcription, which is harder, and it is the problem Multi-Instrument mode is built to handle. Here is what is going on under the hood, what you can expect today, and how to get readable notation from a multi-instrument recording.

Two Different Questions in One

When people say "multiple instruments at once," they usually mean one of two things, and the difference matters.

  • Many notes at the same time from one instrument, like a thick piano chord. This is polyphonic transcription, and it is a problem AI has gotten very good at.
  • Many different instruments at the same time in one mixed recording, like a full band. This requires working out which sounds belong to which instrument before or while transcribing, which is harder.

Conflating the two is what makes the topic confusing. A tool can be excellent at the first and find the second more demanding, because they are not the same skill. Our explainer on monophonic versus polyphonic transcription covers the first axis in detail.

Many Notes at Once: Polyphony

Reading a stack of notes that sound together is polyphonic transcription, and it is where modern AI shines. A piano playing a five-note chord with an inner line moving underneath is exactly the kind of dense, simultaneous music that used to take a trained ear ages to pick apart, and a good model reads it cleanly. So if your "multiple" means the rich, many-voiced playing of a single piano, the answer is a confident yes. Our deep dive on polyphonic piano transcription covers how that works and why piano is the strongest case for it.

Many Instruments at Once: Every Part in One Pass

A full-band recording mixes several instruments into one stream of sound, and their frequencies overlap and mask each other. A bass note can hide under a kick drum, and a guitar chord can blur into the keys. To write each instrument on its own staff, a system has to decide which notes belong to which instrument, transcribe each part, and lay them out as a score.

Songscription's Multi-Instrument mode does that in one pass. Pick "Multi-Instrument" in the instrument picker, upload a recording or paste a YouTube, TikTok, or Instagram link, and you get a multi-staff score with a separate track for each instrument it hears, whether that is a rock rhythm section, a horn section, or a string quartet, plus multitrack MIDI you can open in a DAW like Ableton, Logic, FL Studio, or GarageBand. Keyboard tracks are split into left and right hands.

The honest caveats: some parts may need cleanup in the built-in editor, especially where instruments pile into the same range, and accuracy is highest on clean, well-balanced recordings. Large, dense ensembles such as a full orchestra are the hardest case, so expect more cleanup there. A choir comes back as one voice track rather than separate soprano, alto, tenor, and bass parts. When one part matters most, single-instrument mode is still the cleanest route.

The Practical Workflow

There are three dependable ways to get readable notation from a multi-instrument recording today, and you pick by what you actually want.

  • Want every part fast? Choose Multi-Instrument and upload the recording once. You get every instrument as a separate part in one pass, ready to edit and download as PDF, MIDI, or MusicXML.
  • Want one part as clean as possible? Choose that instrument in single-instrument mode. The model isolates it directly from the full mix, so you do not need to split the song into stems first. On an especially dense recording, optional stem separation can make the part cleaner still.
  • Want one playable score? Use piano cover, piano plus vocals, or lead sheet mode to condense the song into a single part, usually on a grand staff. Faster to play from, and often all a player needs.

Our guide to transcribing a full band recording walks through the Multi-Instrument route, and transcribing multi-track audio to sheet music covers working from stems. For a side-by-side look at the tradeoffs, see one-pass vs per-instrument transcription. Either way, you start from any recording with audio to sheet music. To try it on your own song, start from the Multi-Instrument transcription page.

Which Instruments Songscription Reads

Multi-Instrument recognizes keys (including organ and mallet percussion), guitars, bass, strings (including harp and timpani), brass, woodwinds, saxophones, synths, voice, and drums, each on its own part. Single-instrument mode uses per-instrument models. Piano is the most mature and handles dense polyphony best, and other models cover guitar, bass, and drums, along with melodic lines like trumpet, saxophone, and violin. When one part matters most, a single-instrument pass gives the model one narrow target and usually reads more cleanly than the same part from a one-pass transcription. For examples of that focused approach, our guides to transcribing a bass line and drums show it in action.

Frequently Asked Questions

Can AI transcribe multiple instruments at once?

Yes. Songscription's Multi-Instrument mode takes a mixed recording and transcribes it in one pass, with a separate track for each instrument it hears, including keys, guitars, bass, strings, brass, woodwinds, saxophones, synths, voice, and drums, delivered as a multi-staff score plus multitrack MIDI. Some parts may need cleanup in the built-in editor, and accuracy is highest on clean recordings. When you need one part as clean as possible, single-instrument mode isolates that instrument from the mix directly, with no stems needed.

What is the difference between polyphonic transcription and separating instruments?

Polyphonic transcription is reading several notes sounding at the same time from one source, like a piano chord, and writing them all down. Separating instruments is working out which notes in a mixed recording belong to the vocal, the bass, the guitar, and so on. They are different problems: one is about hearing a stack of notes, the other is about un-mixing a recording. Multi-instrument transcription needs both, which is why a full band is harder than a single clean instrument.

How do I transcribe a song with several instruments?

Pick the mode that matches your goal. For every part at once, choose Multi-Instrument in Songscription and upload the recording; you get a separate part for each instrument it hears in one pass. For the cleanest possible version of one part, choose that instrument in single-instrument mode, which isolates it from the full mix without stems. For one playable version of the song, use piano cover, piano plus vocals, or lead sheet mode, which condense the whole song into a single part.

Which instruments can Songscription transcribe?

Multi-Instrument transcribes a mixed recording in one pass and recognizes keys, guitars, bass, strings, brass, woodwinds, saxophones, synths, voice, and drums, each on its own part. In single-instrument mode, piano is the most mature model and handles dense, polyphonic playing best, and other models cover guitar, bass, drums, and melodic lines such as trumpet, saxophone, and violin. Single-instrument models are generally robust enough to isolate the instrument you want from a full mix, so stems are optional, though stem separation can help on an especially dense recording.

About the author

Andrew Carlins

Written by

Andrew Carlins

Co-Founder & CEO, Songscription

Andrew co-founded Songscription at Stanford with a few fellow musicians who were tired of not finding the notes to the songs they wanted to play. He grew up playing piano and baritone saxophone and performing in musical theater, and though he hasn't performed in years, he likes to think he's still pretty sharp. He writes about getting a song off the recording and onto the page.

More about the team

Keep exploring more posts on the same topics.