Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

google drive connector exportSizeLimitExceeded #1453

Open
acidgeneration opened this issue May 13, 2024 · 0 comments
Open

google drive connector exportSizeLimitExceeded #1453

acidgeneration opened this issue May 13, 2024 · 0 comments

Comments

@acidgeneration
Copy link

When this problem occurs, scanning stops completely without being able to continue.

Traceback (most recent call last):
  File "/app/danswer/background/indexing/run_indexing.py", line 177, in _run_indexing
    for doc_batch in doc_batch_generator:
  File "/app/danswer/connectors/google_drive/connector.py", line 515, in poll_source
    yield from self._fetch_docs_from_drive(start, end)
  File "/app/danswer/connectors/google_drive/connector.py", line 497, in _fetch_docs_from_drive
    raise e
  File "/app/danswer/connectors/google_drive/connector.py", line 479, in _fetch_docs_from_drive
    text_contents = extract_text(file, service) or ""
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/app/danswer/connectors/google_drive/connector.py", line 319, in extract_text
    .execute()
     ^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/googleapiclient/_helpers.py", line 130, in positional_wrapper
    return wrapped(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/googleapiclient/http.py", line 938, in execute
    raise HttpError(resp, content, uri=self.uri)
googleapiclient.errors.HttpError: <HttpError 403 when requesting https://www.googleapis.com/drive/v3/files/1St_FBwaIm0sdHNHjH0lhG14GQKj5XEonqZmzXUlH_Yk/export?mimeType=text%2Fcsv returned "This file is too large to be exported.". Details: "[{'message': 'This file is too large to be exported.', 'domain': 'global', 'reason': 'exportSizeLimitExceeded'}]">
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant