Add chunk size parameter to EmbeddingsRequest #111
Labels
enhancement
New feature or request
good first issue
Good for newcomers
help wanted
Extra attention is needed
Feature Request
Azure OpenAI only allows one single string to be part of an embeddings request. Other frameworks have a
chunk_size
orembed_batch_size
parameter for this.Describe the solution you'd like
I'd propose a
int? ChunkSize = null
parameter for theEmbeddingsRequest
. If it's> 0
, the there should be multiple requests being made withn
lines per requests.Describe alternatives you've considered
I did the chunking myself, but as other frameworks have this built-in, we might also want to add such a parameter here.
Additional context
Quote from MS docs about this limitation:
The text was updated successfully, but these errors were encountered: