Skip to content

Issues: flashinfer-ai/flashinfer

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

30 Open 24 Closed
30 Open 24 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

CUDA Error: no kernel image is available for execution on the device (209) /tmp/build-via-sdist-nl8se4dx/flashinfer-0.0.4+cu118torch2.2/include/flashinfer/attention/decode.cuh: line 871 at function cudaFuncSetAttribute(kernel, cudaFuncAttributeMaxDynamicSharedMemorySize, smem_size)
#249 opened May 16, 2024 by lucasjinreal
2
Circular import error when importing built-from-source flashinfer
#248 opened May 15, 2024 by vedantroy
1
multiple definition of `cuda::__3::pipeline...
#245 opened May 14, 2024 by jpf888
能否支持Volta/Tesla架构？
#242 opened May 10, 2024 by alexngng
Support MLA (Multi-Head Latency Attention) in DeepSeek-v2
#237 opened May 7, 2024 by yzh119
Vllm support
#202 opened Apr 12, 2024 by MikeChenfu
[LoRA] Roadmap of LoRA operators
#199 opened Apr 8, 2024 by yzh119
3 tasks
1
Shared-prefix rope issue
#194 opened Apr 1, 2024 by lkc1997
1
Does flashinfer support float datatype?
#191 opened Mar 26, 2024 by ZSL98
How was the data in the blog measured?
#188 opened Mar 21, 2024 by cloudhan
5
Make flashinfer kernels cuda graphs friendly
#187 opened Mar 20, 2024 by AgrawalAmey
7
[BUG] model Yi-34B compat
#181 opened Mar 14, 2024 by Qubitium
1
1
JIT compilation priority: high
#170 opened Mar 11, 2024 by yzh119
1
stack smashing detected in begin_forward when compiling directly from the repo
#166 opened Mar 8, 2024 by mkrima
1
[Performance] Support strides in attention kernels
#163 opened Mar 7, 2024 by yzh119
Support for Volta / Turing architectures
#160 opened Mar 7, 2024 by tgaddair
4
Sliding window attention
#159 opened Mar 6, 2024 by WoosukKwon
2
Faster compilation times
#154 opened Mar 5, 2024 by skrider
5
Downloadable Package in PyPI
#153 opened Mar 4, 2024 by WoosukKwon
5
QUESTION: How to implement a tree attention with flashinfer
#152 opened Mar 4, 2024 by UranusSeven
@yzh119
4
[Feature request] Interleaved ROPE support
#151 opened Mar 4, 2024 by guocuimi
@yzh119
Still looking forward to an e2e example!
#149 opened Mar 4, 2024 by ZSL98
@yzh119
1
[Feature Request] Versatile head dimension
#142 opened Feb 29, 2024 by yzh119
4
[Feature Request] More versatile GQA group sizes
#140 opened Feb 27, 2024 by yzh119
@yzh119
Can I only profile dense layer or attention layer in flashinfer rather than the whole kernel?
#139 opened Feb 27, 2024 by yintao-he
@yzh119
ProTip! Updated in the last three days: updated:>2024-05-17.