Usage Stream in Cancelled Streams

[rodrigoGA]

Confirm this is a feature request for the Python library and not the underlying OpenAI API.

• This is a feature request for the Python library

Describe the feature or improvement you're requesting

I'm unsure whether this should be a feature request or a bug report. But the behavior of the stream's usage in cases where a stream is cancelled is unclear. That is, there are many scenarios in which the response is discarded before it's completed, such as an interruption in a conversation. In these contexts, the stream can be cancelled using

stream = self.client.chat.completions.create(...)
...
stream.response.close()

However, in these cases, I'm unable to read the usage of the stream. How should this be interpreted?

From a developer's standpoint, using the library, it would be more convenient if the usage is available in the response once the response is completed, rather than having to subscribe to the chunks once they're cancelled. That is, stream.response.usage.

Additional context

No response

[rattrayalex]

usage is not sent from the API if you cancel the stream, so this isn't possible to do in the SDK.