MusicTransformer written for MaestroV2 using the Pytorch framework for music generation

Local windowed attention multi-instrumental music transformer for supervised music generation

SOTA Google's Perceiver-AR Music Transformer Implementation and Model

Absolutely amazing SOTA Google Colab (Jupyter) Notebooks for creating/training SOTA Music AI models and for generating music with Transformer technology (Google XLNet/Transformer-XL)

My project to build and train a Music Transformer in PyTorch.

GPT3-based Multi-Instrumental MIDI Music AI Implementation

[SOTA] [92% acc] 786M-8k-44L-32H multi-instrumental music transformer with true full MIDI instruments range, efficient encoding, octo-velocity and outro tokens

Full-attention multi-instrumental music transformer featuring asymmetrical encoding with octo-velocity, and chords counters tokens, optimized for speed and performance

[DEPRECIATED] [PyTorch 2.0] [638M] [85.33% acc] Full-attention multi-instrumental music transformer for supervised music generation, optimized for speed, efficiency, and performance

Tutorial for Harvard Medical School ML from Scratch Series: Transformer from Scratch. Demo the usage of transformer in various domains: Music sheet, audio signal, image generation & discrimination

SOTA Piano Transformer model trained on 4.2GB of Solo Piano MIDI music

[DEPRECEATED] Multi-Instrumental Music Transformer trained on 12GB/400k MIDIs

[DEPRECIATED] Very fast, large music transformer with 8k sequence length, efficient heptabit MIDI notes encoding, true full MIDI instruments range, chords counters and outro tokens

[DEPRECEATED] Piano Transformer model trained on 2.6GB of MIDI piano music

Local windowed attention multi-instrumental music transformer tailored for music orchestration/instrumentation and stable music generation

Experimental music transformer to explore new techniques and ideas

Very fast and efficient large multi-instrumental music transformer with 8k sequence length, dynamic MIDI notes encoding, full MIDI instruments range, chords counters and outro tokens

Melody Lyric Transformer Implementation and Model

Solo Piano Music AI Implementation

A dedicated convenient repo for different Music Transformers implementations (Reformer/XTransformer/Sinkhorn/etc)