Skip to content

Issues: intel-analytics/ipex-llm

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

794 Open 1,433 Closed
794 Open 1,433 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Improve First Token Latency for multi-GPU projects (by flash attention or alternative)
#10897 opened Apr 26, 2024 by moutainriver
Issue with saving and loading low bit BLIP-2 model
#10892 opened Apr 26, 2024 by wayfeng
@pengyb2001
Can provide llama.dll build guide？
#10875 opened Apr 24, 2024 by KiwiHana
@rnwang04
2
RuntimeError: "fused_dropout" not implemented for 'Byte' when running trl ppo finetuning
#10854 opened Apr 23, 2024 by Jasonzzt
3
How to use BigDL to achieve early stop function
#10853 opened Apr 23, 2024 by gdg1212
1
GPU hang when switch between Llama2 and Llama3 on ARC770 user issue
#10852 opened Apr 23, 2024 by moutainriver
@qiuxin2012
1
Running 2 x A770 with Ollama, inference responses slow down dramatically user issue
#10847 opened Apr 22, 2024 by digitalscream
@sgwhat
21
How to use BigDL to calculate MSE values user issue
#10831 opened Apr 22, 2024 by gdg1212
@qiuxin2012
1
[MTL][Qwen] model fail RuntimeError: "normal_kernel_cpu" not implemented for 'Byte'
#10826 opened Apr 22, 2024 by juan-OY
@leonardozcm
1
[vLlm-serving] When run "VLLM_BUILD_XPU_OPS=1 pip install --no-build-isolation -v -e . ", it reports can't find dpct.hpp user issue
#10825 opened Apr 22, 2024 by johnysh
@gc-fu
11
ollama no GPU - Intel Arc A750 Windows and Linux user issue
#10823 opened Apr 21, 2024 by Daroude
@sgwhat
2
[Feature Request] IPEX-LLM + Axolotl Docker Image user guide
#10821 opened Apr 21, 2024 by kwaa
@qiyuangong
23
Llama-CPP Install Issue - Windows user issue
#10820 opened Apr 21, 2024 by ElliottDyson
4
Unable to run llama_cpp example from quickstart guide (PI_ERROR_BUILD_PROGRAM_FAILURE) user issue
#10819 opened Apr 20, 2024 by tristan-k
1
chatglm3-6b with fp8, 1k input, 512 output, and batch 64 failed by all-in-one benchmark tool user issue
#10818 opened Apr 20, 2024 by Fred-cell
@lalalapotter
How does llama cpp backend work? user issue
#10803 opened Apr 19, 2024 by chsasank
3
Flex 170 GPU ollama unbale to detect GPU and sycl-ls also not detecting it !!! user issue
#10801 opened Apr 18, 2024 by shailesh837
3
Ipex-llm older ollama serve hangs after 5 minutes Intel Arc GPU 770 user issue
#10800 opened Apr 18, 2024 by shailesh837
1
Model output is different when using default optimize_model user issue
#10782 opened Apr 17, 2024 by vishnumadhu365
1
streamlit iGPU -RuntimeError: Native API failed. Native API returns: -999 (Unknown PI error) -999 (Unknown PI error) user issue
#10778 opened Apr 17, 2024 by JamieVC
1
deepspeed_optimize_model_gpu Qwen/Qwen-7B-Chat user issue
#10763 opened Apr 15, 2024 by kevin-t-tang
@plusbang
1
MiniGPT4-Video support user issue
#10759 opened Apr 15, 2024 by violet17
1
Feature Request: RoSA and QRoSA user issue
#10755 opened Apr 12, 2024 by ElliottDyson
1
GPTQ inference issue on intel gpu user issue
#10754 opened Apr 12, 2024 by a32543254
@liu-shaojun
3
Llava-v1.5-7b ValueError: Unrecognized configuration class <class 'transformers.models.llava.configuration_llava.LlavaConfig'> for this kind of AutoModel: AutoModelForCausalLM. user issue
#10744 opened Apr 11, 2024 by russell-tankl
1
ProTip! Type g i on any issue or pull request to go back to the issue listing page.