Increase slack connector processing rate

[narendrapatel]

We are evaluating danswer and towards the same had a question around slack integration.
We have more than 6 million messages on public channels of which 1.2 million are from users and rest are from integrations.

We observed that the slack connector pulls only user conversations from channels and ignores messages from integrations. Is this assumption correct?

Also the doc processing from slack into danswer is taking quite some time. In last 7 days it was able to process 500k messages.
We have currently deployed danswer in kubernetes and for every pod restart or indexing error it starts again from scratch pulling all slack messages and then ignores the ones it has processed and actions on the new messages. But this process takes hours due high slack message count.

We even tried to move the Background pod deployment in kubernetes on GPU nodes but it did not helped.

Is there a way to make slack ingestion faster? Any guidance would be really appreciated.