❓ [Question]: is there any way to use Open AI for free ??

[internetboy7]

Your Question

so i tried revered proxy but it's not working, it's showing me this error after 33%

ERROR : Exception : GPT3 error: Too many requests, you can send 3 requests per 15 seconds, please wait and try again later.

i know GPT4 is not that expensive but i am a student i just want it for free !! XD

is there any way or should i just buy it?

[davidmartinrius]

You could use your own LLM such as Llama 2. But you need a GPU with at least 24GB vram to work comfortably.

[Mr9inety6iX]

You could use your own LLM such as Llama 2. But you need a GPU with at least 24GB vram to work comfortably.

HOW brother?

[davidmartinrius]

You can use https://github.com/oobabooga/text-generation-webui with some model like Llama2, Vicuña, or the model which you prefer (in the project of text-generstion-webui are some suggested models)
Once you installed it and the webui is running you can use the api from your own server instead of using openai. You should make some modifications in ShortGPT but it should be quite simple.
When using this webui you can leverage on your CPU in case that you do not have GPU. Or if you have a GPU below 24GB, you can also use simpler models like Llama2-13B from https://huggingface.co/TheBloke/Llama-2-13B-GGML

If you have more questions I will be glad to respond.

David Martin Rius

[ArsenKakasyan]

https://github.com/xtekky/gpt4free

[daniyalkhalid7]

You can use https://github.com/oobabooga/text-generation-webui with some model like Llama2, Vicuña, or the model which you prefer (in the project of text-generstion-webui are some suggested models) Once you installed it and the webui is running you can use the api from your own server instead of using openai. You should make some modifications in ShortGPT but it should be quite simple. When using this webui you can leverage on your CPU in case that you do not have GPU. Or if you have a GPU below 24GB, you can also use simpler models like Llama2-13B from https://huggingface.co/TheBloke/Llama-2-13B-GGML

If you have more questions I will be glad to respond.

David Martin Rius

Can you help me make changes in shortgpt?
I can run GPT4 and ollama both locally.
but I don't know how to integrate that in Shortgpt.

[davidmartinrius]

You can use https://github.com/oobabooga/text-generation-webui with some model like Llama2, Vicuña, or the model which you prefer (in the project of text-generstion-webui are some suggested models) Once you installed it and the webui is running you can use the api from your own server instead of using openai. You should make some modifications in ShortGPT but it should be quite simple. When using this webui you can leverage on your CPU in case that you do not have GPU. Or if you have a GPU below 24GB, you can also use simpler models like Llama2-13B from https://huggingface.co/TheBloke/Llama-2-13B-GGML
If you have more questions I will be glad to respond.
David Martin Rius

Can you help me make changes in shortgpt? I can run GPT4 and ollama both locally. but I don't know how to integrate that in Shortgpt.

You can create you own function like this one:

ShortGPT/shortGPT/gpt/gpt_utils.py

Line 72 in 969d818

def gpt3Turbo_completion(chat_prompt="", system="You are an AI that can give the answer to anything", temp=0.7, model="gpt-3.5-turbo", max_tokens=1000, remove_nl=True, conversation=None):

[9volt24]

https://github.com/xtekky/gpt4free

I tried this and got everything setup, but how am I supposed to find my freegpt4 API key???

[davidmartinrius]

https://github.com/xtekky/gpt4free

I tried this and got everything setup, but how am I supposed to find my freegpt4 API key???

I guess you missed the "free" part haha

Obviously, you do not need any api key if you integrated gpt4free...