Skip to content

Latest commit

 

History

History
23 lines (17 loc) · 2.53 KB

README.md

File metadata and controls

23 lines (17 loc) · 2.53 KB

LmScript

Controllable Language Model Interactions in TypeScript

  • A suite of tools for easy, fast, and controllable interactions with language models.
  • Open models and open source.
  • Supports SGLang and vLLM (Outlines).

Documentation, Tutorial, Examples

Check out the LmScript Docs

Projects

Project Description
Typescript Client Dependency-free client that creates and executes LmScript programs with different backends.
GUI Desktop Application that creates and executes LmScript programs.
Runpod Serverless SGLang Docker image that runs SGLang on Runpod Serverless.
Docker SGLang Docker image that runs SGLang
Runpod Serverless vLLM Docker image that runs vLLM (Outlines) on Runpod Serverless.