🧑‍🏫 60 Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠

18 Lessons, Get Started Building with Generative AI 🔗 https://microsoft.github.io/generative-ai-for-beginners/

Unify Efficient Fine-Tuning of 100+ LLMs

Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch

CVPR 2024 论文和开源项目合集

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

🔍 LLM orchestration framework to build customizable, production-ready LLM applications. Connect components (models, vector DBs, file converters) to pipelines or agents that can interact with your data. With advanced retrieval methods, it's best suited for building RAG, question answering, semantic search or conversational agent chatbots.

RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.

👑 Easy-to-use and powerful NLP and LLM library with 🤗 Awesome model zoo, supporting wide-range of NLP tasks from research to industrial applications, including 🗂Text Classification, 🔍 Neural Search, ❓ Question Answering, ℹ️ Information Extraction, 📄 Document Intelligence, 💌 Sentiment Analysis etc.

Machine Learning Engineering Open Book

Ongoing research training transformer models at scale

💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

An implementation of model parallel GPT-2 and GPT-3-style models using the mesh-tensorflow library.

A PyTorch-based Speech Toolkit

Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM

State-of-the-art Machine Learning for the web. Run 🤗 Transformers directly in your browser, with no need for a server!

This repository contains demos I made with the Transformers library by HuggingFace.

💡 All-in-one open-source embeddings database for semantic search, LLM orchestration and language model workflows

An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library.

BertViz: Visualize Attention in NLP Models (BERT, GPT2, BART, etc.)