The following quota exhausted: MatchingEngineStreamUpdateThroughput

[Ludovic-Emo-Pyl-Tech]

Hello,

Could you please help on this error running a notebook step ?

Notebook

Question Answering with Documents using LangChain 🦜️🔗 and Vertex AI Matching Engine
here: https://github.com/GoogleCloudPlatform/generative-ai/blob/main/language/use-cases/document-qa/question_answering_documents_langchain_matching_engine.ipynb

We get the same result on Google Colab and on a Vertex AI User managed notebook.

Step

doc_ids = me.add_texts(texts=texts, metadatas=metadatas)

Error

status = StatusCode.RESOURCE_EXHAUSTED
details = "The following quota exhausted: MatchingEngineStreamUpdateThroughput."
debug_error_string = "UNKNOWN:Error received from peer ipv4:[REDACTED]:443 {grpc_message:"The following quota exhausted: MatchingEngineStreamUpdateThroughput.", grpc_status:8, created_time:"2023-10-17T19:08:25.548707816+00:00"}"

Questions

1. The default region quota for MatchingEngineStreamUpdateThroughput is 300 KB, which quota increase value should we ask for ?
2. Would you explain how to evaluate the needed value ?
3. Would it be possible to improve the notebook to prevent the quota increase need ?

Thanks in advance for your help
Ludovic