Semantune

Semantune is an audio-based puzzle game that challenges the player to create a song or a sound effect by generating semantic tokens that are then converted into audio codec tokens with Bark. The player can use any text prompt beyond speech, such as music lyrics, which the model will transform into high-level semantic tokens. The challenge lies in creating an audio experience that matches the given prompt with the limited non-speech sounds known to Bark.