Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Some clarity on rate limiting. #325

Open
AyushExel opened this issue Oct 17, 2023 · 2 comments
Open

Some clarity on rate limiting. #325

AyushExel opened this issue Oct 17, 2023 · 2 comments

Comments

@AyushExel
Copy link

Hey great job on the multi-lingual models. I've been trying the cohere trial api and I have a question about rate-limiting.
The error says that the number of requests is rate limited to 10/min. But I'm getting these errors even after 4-5 requests (these are batched requests). So I was wondering if the rate-limit also applied at token level like openAI api?

@samuelpath
Copy link

Hi @AyushExel, I'm not sure this is the best place to ask your question since it is not really related to Python's SDK per se (the API key is language agnostic and can also be used with Node, Go, Curl, Cohere's CLI, and so on).

You would stand a better chance to get a prompt answer by asking your question on Cohere's Discord community, in the #general-chat channel.

@mehrdad-es
Copy link

@AyushExel , were you able to answer your question?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants