SPIN an AI-based Music Synthesizer


SPIN is an AI-Based Music Synthesizer that looks like a cross between a turntable and an MPC.

Arvind Sanjeev shared this intro video for SPIN, an AI music synthesizer that enables you synthesize compositions in collaboration with a language model, MusicGen.

SPIN looks a bit like a cross between a turntable and an MPC, but it really provides an interface for controlling the parameters for music generation and playback. A DVS (Digital Vinyl System) lets you slow down, zoom in, scratch and listen between the notes.

You can use it to create new compositions, as a simple sound synthesizer, as a playful scratch tool, or to play generative background music.

How It Works

Under the hood, SPIN takes the input prompts in the form of button presses through an Arduino Mega. This is sent via serial to a Raspberry Pi which prompts the MusicGen API.

MusicGen is a single Language Model (LM), designed to create high-quality music based on cues from text descriptions or melodies.

An MP3 file is received as the output of MusicGen, which is loaded onto a Digital Vinyl System (DVS). A transmuted Numark PT-01 and a timecoded control vinyl record serve as the turntable. The Xwax DVS package for Raspberry Pi reads the vinyl timecode through a Behringer audio driver, and the output is played via stereo speakers.

“There are a lot of amazing generative music experiments, from Dadabots’s relentless death metal streaming AI on YouTube to Holly Herndon’s experiments around voice transplantations,” notes Sanjeev. “But I realized we hit a tipping point when I stumbled upon the Riffusion music model; I was taken aback by its depth and realism, including its new update that adds lyrical voices to the output. Inspired by this, I wanted to build a platform to let me further explore and combine never-before-heard combinations of music and sounds. This laid the seed for building SPIN.”

More information on the project is available at Arvind Sanjeev website.

Check out SPIN, and share your thoughts on it in the comments!

 

Dr.Fone V13 One-Stop Complete Mobile Solution

Wondershare RecoveritData Recovery

Exclusive Education Savings for Wondershare

Sam Ash $50 Gift Certificate Offer

Save an Extra 12% Gear $499 & Up: Use Code TREE

Pro Desktop Microphone: Save 50% With Code CREATE

Sam Ash Deals Shop: Save Up to 60% on Musical Instruments and Pro Sound Equipment

Great deals on Live Sound and Lighting gear. Microphones, speakers, mixers and more. Fast, free shipping.

Great deals on Recording Gear. Interfaces, headphones, monitors and more. Fast, free shipping.

Great deals on DJ and Production Gear. Fast, free shipping.

Sam Ash Music Flash Deals: Special Discounts on Musical Instruments & Music Studio Gear

Shop Used Musical Instruments, Used Guitars, Used Drums, Used Pianos, Used Pro Audio Gear, Used DJ Equipment

Samson Recording Headphones: Save Up to 70%

MODO Bass 2 or MODO Drum 1.5 €/$79.99 (up to 60% off)

T-RackS 5 MAX 79.99 (up to 73% off)

AmpliTube 5 MAX or TONEX MAX 149.99 each or 249.99 for both PLUS a free MODO bonus

ARC Studio - Make any studio monitors sound better

ARC 4 - Mix faster and more confidently than ever

MODO BOGO sale

T-RackS singles €/$29.99 sale

AmpliTube 5 €/$49.99 sale

€/$39.99 AmpliTube Collections

T-RackS 5 €/$49.99 - 22 mixing & mastering plugins

Up to 50% off Total Studio 4 MAX complete music production software bundle

TONEX ODS Legends Signature Collection

Pianoverse NY Grand S274

Pianoverse Black Diamond B280

Pianoverse Royal Upright Y5

Pianoverse Concert Grand YF3

Pianoverse piano virtual instrument

UNO Synth true analog synthesizer - ultra-portable and ultra-affordable

iRig HD X

iRig USB mobile audio interface for guitar & bass

UNO Synth Pro X Paraphonic dual filter analog synthesizer

 


Leave a comment

Name: (Required)

eMail: (Required)

Website:

Comment: