This project uses PyTorch to classify bone fractures. As well as fine-tuning some famous CNN architectures (like VGG 19, MobileNetV3, RegNet,...), we designed our own architecture. Additionally, we used Transformer architectures (such as Vision Transformer and Swin Transformer). This dataset is Bone Fracture Multi-Region X-ray, available on Kaggle.

Orchestrate Swarms of Agents From Any Framework Like OpenAI, Langchain, and Etc for Business Operation Automation. Join our Community: https://discord.gg/DbjBMJTSWD

Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch

Pure C 3D Hybrid GAN using Cross attention, attention and convolution

Class-Conditional self-reward mechanism for improved Text-to-Image models

QuillGPT is an implementation of the GPT decoder block based on the architecture from Attention is All You Need paper by Vaswani et. al. in PyTorch. Additionally, this repository contains two pre-trained models — Shakespearean GPT and Harpoon GPT, a Streamlit Playground, Containerized FastAPI Microservice, training - inference scripts & notebooks.

Machine translation and Sentiment Analysis with the (scaled dot product) attention mechanism

Self configuring and adapting vision transformer for segmentation of 3d images

Gradient Frequency Attention: Tell Neural Networks where speaker information is.

The official code of "CSTA: CNN-based Spatiotemporal Attention for Video Summarization"

X-Llama🦙 is an Extensible advanced language model framework, inspired by the original Llama model.

Sequence-to-sequence framework with a focus on Neural Machine Translation based on PyTorch

Simplified Implementation of SOTA Deep Learning Papers in Pytorch

Embark on a journey of paralleled/unparalleled computational prowess with FJFormer 🔥 - an arsenal of custom Jax Flax Functions and Utils that elevate your AI endeavors to new heights!

This collection of notebooks is based on the Dive into Deep Learning Book. All of the notes are written in Pytorch and the d2l/torch library

An ultimately comprehensive paper list of Vision Transformer/Attention, including papers, codes, and related websites

This project implements a Convolutional Neural Network (CNN) with attention mechanisms for brain tumor detection using MRI images. The code utilizes PyTorch for building and training the neural network.The goal of this project is to classify MRI images into two categories: yes (tumor) and no (no tumor).

A transformer-based model for learning datasets of multiband light curves.

This repository contains my original code solutions and project reports, as well as the provided problem formulations for assignments 1, 2, 3 and 6 for the Natural Language Processing course, held in the Autumn semester 2022 at ETH Zürich. Each folder contains the files of the corresponding assignment.

A novel implementation of fusing ViT with Mamba into a fast, agile, and high performance Multi-Modal Model. Powered by Zeta, the simplest AI framework ever.