start to get more cancelled error when hitting async streaming endpoint

[yw791772]

Hi,
I've been using langserve for a while

• I follow the add_routes pattern to add a streaming endpoint.
• on the client side, I've adopt to the client code you have.

I've notice that recently, I start to get some asyncio.exceptions.CancelledError: Cancelled by cancel scope 7f019f67a680 error

see stack trace:

async for sse in event_source.aiter_sse():
  File "/workspaces/revbots/apps/skills/services/server_sent_events.py", line 106, in aiter_sse
    async for line in self._response.aiter_lines():
  File "/home/vscode/.local/share/virtualenvs/skills-dFScuIaR/lib/python3.10/site-packages/httpx/_models.py", line 963, in aiter_lines
    async for text in self.aiter_text():
  File "/home/vscode/.local/share/virtualenvs/skills-dFScuIaR/lib/python3.10/site-packages/httpx/_models.py", line 950, in aiter_text
    async for byte_content in self.aiter_bytes():
  File "/home/vscode/.local/share/virtualenvs/skills-dFScuIaR/lib/python3.10/site-packages/httpx/_models.py", line 929, in aiter_bytes
    async for raw_bytes in self.aiter_raw():
  File "/home/vscode/.local/share/virtualenvs/skills-dFScuIaR/lib/python3.10/site-packages/httpx/_models.py", line 987, in aiter_raw
    async for raw_stream_bytes in self.stream:
  File "/home/vscode/.local/share/virtualenvs/skills-dFScuIaR/lib/python3.10/site-packages/httpx/_client.py", line 149, in __aiter__
    async for chunk in self._stream:
  File "/home/vscode/.local/share/virtualenvs/skills-dFScuIaR/lib/python3.10/site-packages/httpx/_transports/default.py", line 254, in __aiter__
    async for part in self._httpcore_stream:
  File "/home/vscode/.local/share/virtualenvs/skills-dFScuIaR/lib/python3.10/site-packages/httpcore/_async/connection_pool.py", line 367, in __aiter__
    raise exc from None
  File "/home/vscode/.local/share/virtualenvs/skills-dFScuIaR/lib/python3.10/site-packages/httpcore/_async/connection_pool.py", line 363, in __aiter__
    async for part in self._stream:
  File "/home/vscode/.local/share/virtualenvs/skills-dFScuIaR/lib/python3.10/site-packages/httpcore/_async/http11.py", line 349, in __aiter__
    raise exc
  File "/home/vscode/.local/share/virtualenvs/skills-dFScuIaR/lib/python3.10/site-packages/httpcore/_async/http11.py", line 341, in __aiter__
    async for chunk in self._connection._receive_response_body(**kwargs):
  File "/home/vscode/.local/share/virtualenvs/skills-dFScuIaR/lib/python3.10/site-packages/httpcore/_async/http11.py", line 210, in _receive_response_body
    event = await self._receive_event(timeout=timeout)
  File "/home/vscode/.local/share/virtualenvs/skills-dFScuIaR/lib/python3.10/site-packages/httpcore/_async/http11.py", line 224, in _receive_event
    data = await self._network_stream.read(
  File "/home/vscode/.local/share/virtualenvs/skills-dFScuIaR/lib/python3.10/site-packages/httpcore/_backends/anyio.py", line 35, in read
    return await self._stream.receive(max_bytes=max_bytes)
  File "/home/vscode/.local/share/virtualenvs/skills-dFScuIaR/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 1133, in receive
    await self._protocol.read_event.wait()
  File "/usr/local/lib/python3.10/asyncio/locks.py", line 214, in wait
    await fut
asyncio.exceptions.CancelledError: Cancelled by cancel scope 7f019f67a680

any suggestions?

[yw791772]

I think it's because my client code didn't pass a timeout parameter, and my payload is large to the open ai, and client code consider it time out, still verifying