Skip to content

Pull requests: microsoft/DeepSpeed-MII

New pull request New
17 Open 190 Closed
17 Open 190 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Reuse KV cache of prefixes
#484 opened May 27, 2024 by tohtana • Draft
Enable streaming option in the OpenAI API server
#480 opened May 16, 2024 by adk9 Loading…
1
2
Allow model to generate added tokens - fix generation issue in Llama3 models
#473 opened May 9, 2024 by weiqisun Loading…
6
Add Kubernetes health check route to REST server
#445 opened Mar 20, 2024 by richiejp Loading…
Update model support
#429 opened Mar 5, 2024 by mrwyattii Loading…
Pydantic v2 migration
#423 opened Feb 27, 2024 by mrwyattii • Draft
add stable diffusion CI workflow
#412 opened Feb 14, 2024 by mrwyattii Loading…
use deploy_rank to allocate gpus
#234 opened Sep 14, 2023 by tulika612 Loading…
Multi model refactor
#223 opened Aug 9, 2023 by TosinSeg • Draft
Lazy loading
#220 opened Aug 7, 2023 by TosinSeg • Draft
Add Pydantic v2 support
#213 opened Jul 25, 2023 by mrwyattii • Draft
1
Multi model deployment
#208 opened Jun 27, 2023 by TosinSeg • Draft
69
Fix for Stable Diffusion deployments
#172 opened Apr 25, 2023 by mrwyattii Loading…
1
Non-blocking client API
#158 opened Mar 12, 2023 by tohtana Loading…
4
Add AML local deployment type
#143 opened Feb 1, 2023 by mrwyattii Loading…
1 of 3 tasks
1
Support text2text-generation pipelines and T5 models in particular
#124 opened Dec 25, 2022 by philhchen Loading…
3
add ds inject policies
#46 opened Aug 2, 2022 by jeffra • Draft
ProTip! Add no:assignee to see everything that’s not assigned.