LLM Controller Interface for vLLM (LLM output format controller)

[Ksuriuri]

I made a simple implementation of controllable generation of large language models based on vLLM, enabling precise control over the model's output format through additional control information: Ksuriuri/LLMCI

The performance looks good to me, feel free to try it if you need😊

[AaronFriel]

Neat project and clever use of stop tokens to add fixed content! That said, this isn't quite the same as AICI, so I wonder if it should share the same name?

[Ksuriuri]

Thank you for your comment and suggestion! I think LLMCI is more suitable and I change the name.