You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Can we add an option to configure batch with requests_per_minute and batch_size?
This would be useful, when I am limited to i.e. 120 rpms, but also each object is quite big (like when working with images and videos) and the vectorization is slow (so sending 120 objects each time could result in timeouts or network issues).
One example, where I would use this is with multi2vec modules.
source=os.listdir("./source/video/")
animals=client.collections.get("Animals")
withanimals.batch.rate_limit(requests_per_minute=100) asbatch:
fornameinsource:
print(f"Adding {name}")
path="./source/video/"+namebatch.add_object({
"name": name, # name of the file"path": path, # path to the file to display result"video": toBase64(path), # image to vectorize
})
Can we add an option to configure batch with requests_per_minute and batch_size?
This would be useful, when I am limited to i.e. 120 rpms, but also each object is quite big (like when working with images and videos) and the vectorization is slow (so sending 120 objects each time could result in timeouts or network issues).
One example, where I would use this is with multi2vec modules.
I would like to add
batch_size
in there:The text was updated successfully, but these errors were encountered: