#

trainium

Here is 1 public repository matching this topic...

vllm-project / vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

amd cuda inference pytorch transformer llama gpt rocm model-serving mlops llm inferentia llmops llm-serving trainium

Updated May 10, 2024
Python

Improve this page

Add a description, image, and links to the trainium topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the trainium topic, visit your repo's landing page and select "manage topics."