rustformers llm Ideas · Discussions · GitHub

Sort by: Latest activity

Categories

Ideas Discussions

Share ideas for new features

You must be logged in to vote

Loading "unaligned" models with proper alignment

iacore started May 22, 2023 in Ideas · Closed

2
You must be logged in to vote

Run (New) 5-bit Quantized Models

PeytonCleveland started May 17, 2023 in Ideas · Closed

4
You must be logged in to vote

Roadmap for multiple backends and dealing with quantization format changes

philpax started May 21, 2023 in Ideas

3
You must be logged in to vote

Binding to llama.cpp

shadowmint started Apr 9, 2023 in Ideas

10