yb.png

AI PUBLICATIONS + PRODUCTS


I specialize in machine learning for music, speech and audio generation. These include modern diffusion and LLM approaches as well as methods which combine ML with classical signal processing.




ripple-cover.png
00 PUBLICATIONS & PATENTS

These are a selection of my publications and patents in the field of music technology and Generative AI. As research scientist and engineer, I specialize in the fields of audio signal processing, neural audio synthesis, large language modeling for audio and real time signal processing.


Read More

.png



SeedMusic.png
01 SEED-MUSIC

SEED-MUSIC is a unified framework leveraging both auto-regressive language modeling and diffusion for controlled music generation and audio editing workflows.


Read More

@ByteDance/Tiktok
2024

.png


Doubao.png
02 DOUBAO 豆包 AI AGENT MUSIC GENERATION

Doubao is an AI Agent akin to China’s ChatGPT. A unique feature is its integrated music generation features.


Read More

@ByteDance/Tiktok
2024
.png


Haimian.png03 HAIMIAN 海绵音乐 AI MUSIC GENERATION

Doubao is an AI Agent akin to China’s ChatGPT. A unique feature is its integrated music generation features.

Read More

@ByteDance/Tiktok
2024
.png


ripple-2-cover.png
04 RIPPLE

Ripple is a mobile app for music-making powered by AI. Hum a tune. Type some lyrics. Upload a voice memo. Ripple will instantly transform it into a song. 

Read More

@TikTok
2023

.png




mawf-cover.png05 MAWF AUDIO PLUGIN

Mawf is a DAW plugin for transforming inputs like singing and everyday sounds into musical instruments. It uses industry-first realtime audio ML that runs on the cpu.

Read More

@TikTok
2022
.png



tone-transfer-cover.png
06 TONE TRANSFER

Tone Transfer is a website that lets you transform everyday sounds into musical instruments. It is powered by audio ML running directly on the web.

Read More


@Google
2021

.png




india.png
07 SOUND OF INDIA

Sounds of India is a unique and fun interactive musical experience launching for India’s 74th Independence Day, inspired by Indian tradition and powered by machine learning. 

Read More

@Google
2020

.png



mawf-cover-1.png
08 DDSP: DIFFERENTIABLE DIGITAL SIGNAL PROCESSING

DDSP is an open-source library fusing modern machine learning with classical signal processing. 

Read More

@Google
2020

.png