Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove cached_ar_key/cached_ar_value in prefill results to save memory. #636

Closed
wants to merge 12 commits into from

Merge branch 'main' into prefill-memory-optimize

74b78c4
Select commit
Failed to load commit list.
Closed

Remove cached_ar_key/cached_ar_value in prefill results to save memory. #636

Merge branch 'main' into prefill-memory-optimize
74b78c4
Select commit
Failed to load commit list.