🤖 Collect practical AI repos, tools, websites, papers and tutorials on AI. 实用的AI百宝箱 💎

Finetune Llama 3, Mistral & Gemma LLMs 2-5x faster with 80% less memory

An Easy-to-use Knowledge Editing Framework for LLMs.

🤖 The free, Open Source OpenAI alternative. Self-hosted, community-driven and local-first. Drop-in replacement for OpenAI running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. It allows to generate Text, Audio, Video, Images. Also with voice cloning capabilities.

目标：构建一个更符合语言学的小而美的 llama 分词器，支持中英日三国语言和数门编程语言

Unify Efficient Fine-Tuning of 100+ LLMs

MinimalChat is a lightweight, open-source chat application that allows you to interact with various large language models.

LLM inference in C/C++

XMPP Bot designed for privacy AI language model interactions

The Role of Model Architecture and Scale in Predicting Molecular Properties: Insights from Fine-Tuning RoBERTa, BART, and LLaMA

This repository contains a web application designed to execute relatively compact, locally-operated Large Language Models (LLMs).

A high-throughput and memory-efficient inference and serving engine for LLMs

Get up and running with Llama 3, Mistral, Gemma, and other large language models.

🔥🔥🔥 This repository lists some awesome public Rust projects, Videos, Blogs and Jobs.

Run any open-source LLMs, such as Llama 2, Mistral, as OpenAI compatible API endpoint in the cloud.

RepairLLaMA: Efficient Representations and Fine-Tuned Adapters for Program Repair

Maid is a cross-platform Flutter app for interfacing with GGUF / llama.cpp models locally, and with Ollama and OpenAI models remotely.

Tools for merging pretrained large language models.

⚡️Open-source AI LangChain-like RAG (Retrieval-Augmented Generation) knowledge database with web UI and Enterprise SSO⚡️, supports OpenAI, Azure, LLaMA, Google Gemini, HuggingFace, Claude, Grok, etc., chat bot demo: https://demo.casibase.com, admin UI demo: https://demo-admin.casibase.com

A toolkit for controllable, private AI on consumer hardware in rust