Skip to content
OGIOS edited this page Sep 18, 2023 · 4 revisions

Welcome to the huggingchat-api wiki!
Here we gonna talk about the release after v0.0.2.0.

There're a lot of changes made in v0.0.2.0,
If the problem occurred after updating, please downgrade to v0.0.1.6.

Feature:

  • No changes to the usage of existing methods which avoids rewriting the code.
  • Every request is run in async event_loop.
  • Migrate from requests to aiohttp.
  • New dataclass: ModelConfig / RequestOptions / RequestData for easier customization of request data and model parameters.

Running

Before

Customized thread queue, every task takes a thread which consumes a lot of resources.

After

Creates a CoroutineLoop which includes a single thread and an event_loop runs within it.
Every task associated with http request is going to be wrapped as a workflow and then submitted to the event_loop.

Others words

This project is now maintained by myself only, there maybe some delay of the new feature and bug fix, feel free to contribute PRs.
I've spent 2 days reconstructing the main part of the code, learned a lot of async coding in Python, but still, i may do something in the wrong way, please report it to me if you find it, thanks.

Feel free to ask any questions or share me with your thoughts!

Clone this wiki locally