Skip to content

Issues: QwenLM/qwen.cpp

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

62 Open 8 Closed
62 Open 8 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

qwen1.5 support?
#80 opened Feb 27, 2024 by anan1213095357
2
使用qwen.cpp对原模型进行转化为什么文件反而增大了？
#79 opened Feb 25, 2024 by zzzcccxx
Does it support Qwen1.5 Model?
#78 opened Feb 8, 2024 by kicGit
8
why missing "assistant" here
#76 opened Jan 31, 2024 by feixyz10
crash if compliing in debug mode, everything is ok if in release mode
#75 opened Jan 31, 2024 by feixyz10
如何下载tiktoken_cpp
#74 opened Jan 25, 2024 by eswulei
添加tokens生成速度
#73 opened Jan 22, 2024 by OliverQueen1466
请问用qwen.cpp量化后的模型如何使用optimum-benchmark进行性能基准测试,现在参照readme中所述只得到一个build文件夹，不清楚如何进行下一步的测试
#72 opened Jan 18, 2024 by suyu-zhang
Why does TextStreamer hold on punctuation?
#71 opened Jan 8, 2024 by Wovchena
windows 下使用qwen.cpp 问题
#70 opened Dec 29, 2023 by kingpingyue
[BUG] Qwen-1.8-Chat，用llama.cpp量化为f16，然后推理回答错乱，请问1.8在llama.cpp还不支持吗？
#69 opened Dec 26, 2023 by Lyzin
2 tasks done
@simonJJJ
3
多轮会话
#67 opened Dec 25, 2023 by litongjava
如何将gradio架构构建的前端和qwen-cpp推理代码连接？
#66 opened Dec 22, 2023 by tougeqaq
2
💡 [Question] - 您好，请教个问题，qwen-cpp BaseStreamer 如何通过std::string 构造一个　BaseStreamer？Ｃ＋＋代码少一个构造方式 question Further information is requested
#62 opened Dec 18, 2023 by micronetboy
@simonJJJ
您好，请教个问题，qwen-cpp BaseStreamer 如何通过std::string 构造一个　BaseStreamer？Ｃ＋＋代码少一个构造方式
#61 opened Dec 18, 2023 by micronetboy
希望团队能继续支持qwen.cpp
#60 opened Dec 16, 2023 by awtestergit
3
💡 [Question] - <title>qwen-cpp 只使用 cpu 和 启用 cpu BLAS 加速, 在都不使用GPU的情况下，速度有多大差别？我测试没有差别 question Further information is requested
#63 opened Dec 15, 2023 by micronetboy
@simonJJJ
💡 [Question] - QwenCPP Python Binding 如何 支持 BLAS CPU 加速 question Further information is requested
#64 opened Dec 15, 2023 by micronetboy
@simonJJJ
2
Python Binding 如何 支持BLAS CPU 加速
#59 opened Dec 15, 2023 by micronetboy
pip install -U qwen-cpp 报错
#58 opened Dec 14, 2023 by micronetboy
2
💡 [REQUEST] - CPU 的 qwen-cpp 如何封装为一个 http 服务？ question Further information is requested
#65 opened Dec 14, 2023 by micronetboy
@simonJJJ
4
为啥qwen.cpp在A100和A10性能差距很大
#56 opened Dec 11, 2023 by zhangzai666
1
CUDA error 2 at /home/qwen.cpp/third_party/ggml/src/ggml-cuda.cu:7196: out of memory
#55 opened Dec 8, 2023 by youngallien
在MacOS，用python调用qwen_cpp载入模型进行推理，只能启动CPU，无法使用GPU。
#54 opened Dec 8, 2023 by bigbigtooth
1
qwen_cpp可以提供api接口实现web服务么
#53 opened Dec 7, 2023 by zhangzai666
1
ProTip! Type g i on any issue or pull request to go back to the issue listing page.