App uses CPU while GPU is selected and available

[limonlumentoz]

Bug Report

GPT4All cant use my GPU anymore and falls back to my GPU, leading to much slower generation and processing.

Steps to Reproduce

1. Open GPT4All
2. Set the default device to GPU
3. Select chat or make a new one, load any model
4. Write your prompt, the speed is at around 3 tokens/second and the device used is not being shown.

Expected Behavior

I would expect GPT4All to use my GPU, since the drivers are up to date and there is no other app using the GPU, but it instead uses my CPU.

Your Environment

• GPT4All version: 2.7.3 - latest at the time
• Operating System: Windows 10
• Specs: intel i7-12650H CPU, Nvidia RTX 4060 Laptop GPU

[Minecodes]

Same for me. It says "GPU loading failed (out of VRAM?)". I looked in the task manager and the GPU 2.5 of 8 GB VRAM. I'm using an RTX 3060 Ti and an i7 10700KF

[Xuzhour]

same for me. It says "GPU loading failed (out of VRAM?)" 3060ti i7 1185G7

[hjyue1]

same for me.

[cebtenzzre]

Duplicate of #1543