Skip to content
#

serving-infrastructure

Here is 1 public repository matching this topic...

Learn the ins and outs of efficiently serving Large Language Models (LLMs). Dive into optimization techniques, including KV caching and Low Rank Adapters (LoRA), and gain hands-on experience with Predibase’s LoRAX framework inference server.

  • Updated Apr 12, 2024
  • Jupyter Notebook

Improve this page

Add a description, image, and links to the serving-infrastructure topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the serving-infrastructure topic, visit your repo's landing page and select "manage topics."

Learn more