GANStrument
Generating novel instrument sounds for your music using AI
Synthesize innovative sounds using AI to generate new instruments
GANStrument is an AI synthesizer that creates new instrument sounds by intelligently blending and transforming existing sounds. Starting from up to three input sounds, GANStrument uses generative AI technology to create new instrument sounds that accurately reflect the input sounds, producing excellent pitch accuracy and timbre consistency across the entire keyboard range. GANStrument has already earned acclaim at a prestigious information processing conference.
Try the demo web app now and contact us for potential collaboration.
GANStrument overview
Transform one sound into another, or create a novel instrument timbre that is a smooth, natural-sounding blend.
Start from up to three input sounds - use pitched instruments or non-pitched sounds. Select how much of each input you want to blend. From this, GANStrument uses AI to create a new sound.
Generate up to 88 notes of a keyboard from one note or sound. Each output note has a convincing sound with accurate pitch across the keyboard range.
Example GANStrument output sounds
Here are some examples of sounds generated by GANStrument from a range of different input samples, some pitched and some non-pitched. The generated output notes are all pitched and are 1 second long.
Input 1
Input 2
GANStrument Output
Synth Lead
Synth Wah
Output
Bongo
Bass
Output
Conga
Electric Piano
Output
Cat
Koto
Output
GANStrument demo web application
Try out the GANStrument demo web application.
(recommended browsers: Google Chrome, Mozilla Firefox)
Watch a short video of the GANStrument demo web application, then try the demo web app yourself:
1. Select your input sounds
Choose any combination of up to three input sounds from samples provided in the app or you can upload your own.
2. Choose the blending ratio
Use the sliders to adjust the blending ratio – how much of each input sound you want to blend. And pick a pitch.
3. Click Generate
GANStrument synthesizes the output using your chosen sounds and settings.
4. Play and refine your new sounds
Output is generating all of the keys on an 88-key keyboard. Attach your MIDI device to play, or use the UI keyboard. Adjust the blend ratio or choose new sounds and re-generate!
Why use Sony's GANStrument
Create a huge range of new sounds intuitively without the complexities of traditional synthesizers.
GANStrument intelligently blends and transforms (up to three sounds), going beyond simple sound layering to craft innovative and distinctive sounds, with you controlling the blend.
GANStrument's outstanding sound quality is more realistic than that produced by older AI synthesizers, resulting in convincing new instrument timbres.
Find out about GANStrument technology here.
Get access to our TechHub library and build your own GANStrument-based synthesizer.
Who uses GANStrument
- Sample Pack Producers
- Loop Track Producers
- Sound engineers
- Musicians, DJs, producers
- Film and games producers
- Audio software developers
- Music and technology researchers
Potential application areas
Stimulate creativity with fresh instrument sounds.
Create soundtrack music tailored from sounds sourced from the action and content of movies, TV shows, games, and other media.
Create sound effects libraries for games, anime, advertising, and more.
The research behind GANStrument
GANStrument is led by the Flow machines team at Sony Computer Science Laboratories (Sony CSL), Tokyo, Japan.
Read more about GANStrument on Flow Machines Website and Music team at Sony CSL.
Related research publications are the GANStrument 1.0 paper and the GANStrument 2.0 paper.
Interested in collaborating with the GANStrument team? Contact Us