Generative audio examples & sources for researchers.

TLDR

I prompted & generated a 32 second song. Constantly trimmed & prompted the generation to brute force every component to emerge as a solo instrument.

Generative audio

Generative audio platforms can not generate individual components of a completed track . But you can prompt & force some platforms to generate solo instruments & reconstruct the song. These examples were all from Udio

Pyschedelic funk is isolated into eight parts by prompting & took about 90 attempts.

Disco boogie was isolated into multiple parts by prompting around 70 times

Bossa Nova jazz was Isolated into multiple parts by prompting around 40 times

Movie theme was isolated into multiple parts by prompting around 40 times

The maximum amount of instruments I have isolated is eight with a free account.

Observations

Some instruments will be panned in the stereo field to reflect the production decisions of that decade.

You can hear breath on wind instruments. fingers gliding on string instruments.

Some instruments sound like gm midi presets when you remove the layers.

Some parts will have ambience or multiple microphone positions

You can hear room ambience , delay , reverb , compression etc

Thoughts

Generative audio at present is not sonically equivalent to audio which is emitted by strings or wind instruments. But some generations can be equally expressive and competitive with a sample library & midi peripheral workflow.

These examples were all generated with a free account with Udio, I did not perform any tests with Suno or any other platforms as they struggle to generate genres in decades where synthesisers were not used or prevalent. Suno outputs mp3 & many generations also have channel fader zippering noise.

Screening & watermarking

Generative audio can be isolated within the platform & tools can potentially be trained to assist or replicate the workflow. Which means all the claims & attempts to watermark & screen need re-evaluating & scrutinisng. To account for hybrid workflows sample packs or loop libraries.

submitted by /u/elemen2
[link] [comments]

Generative audio examples & sources for researchers.

Quick Overview

Key Points

Outline