A repo containing all building blocks of transformer model for text classification in Pytorch.
The repo contains implementation of following:
- Multi head self attention
- Transformer block
- Transformer encoder based classifier
- Movies reviews sentiment dataloader