OfflineAI is an artificial intelligence that operates offline and uses machine learning to perform various tasks based on the code provided. It is built using two powerful AI models: Mistral AI and GPT4All.
- Uses advanced machine learning techniques to generate responses
- Operates offline for privacy and convenience
- Built using the powerful Mistral AI model mistral-7b-instruct-v0.1.Q4_0 and Nomic Ai library
- gpt4all
- mistralai
Please note that an internet connection is required for the first-time installation to download the necessary libraries and models.
You can install these libraries using pip by running the following command:
'''pip install gpt4all mistralai'''
After installing the libraries, OfflineAI will automatically download the necessary models for the application to function properly. The default model used by OfflineAI is the mistral-7b-instruct-v0.1.Q4_0.gguf model, which is the best overall fast instruction following model.
Here are some details about the default model:
- SIZE: 3.83 GB
- RAM: 8 GB
- Model: mistral-7b-instruct-v0.1.Q4_0.gguf
- Type: Fast instruction following model
- Features: Fast responses, trained by Mistral AI, uncensored, licensed for commercial use Once the libraries and models are installed, you can run OfflineAI locally on your machine without an internet connection.
To use OfflineAI, you will need to have a model file for Mistral AI and a model file for GPT4All. Once you have the model files, you can run the Offlineai.py script to interact with the AI. The script will print the AI's responses to the console.
Please note that while OfflineAI uses advanced machine learning techniques to generate responses, there is no guarantee that its responses will be accurate or appropriate for all situations. Use OfflineAI responsibly and at your own risk.
Mistral AI is a state-of-the-art language model developed by Hugging Face. It is trained on a massive dataset of diverse texts and can generate coherent and contextually relevant responses to a wide range of prompts. Mistral AI is used in OfflineAI to generate responses to user inputs.
Support my work:
BTC: bc1q7wth254atug2p4v9j3krk9kauc0ehys2u8tgg3
ETH & BNB: 0x68B6D33Ad1A3e0aFaDA60d6ADf8594601BE492F0
Buy me a coffee: https://www.buymeacoffee.com/CorvusCodex
If you believe in the potential of open-source AI and want to support its development, consider buying me some equipment. With your help, I can build more powerful in-house AI models that can be used to improve OfflineAI and other open-source projects.
Your support will go towards purchasing high-performance hardware such as GPUs, CPUs, and other necessary components that will allow me to train and test AI models more efficiently. This will ultimately lead to better and more accurate AI models that can benefit everyone.
Here's how you can support the development of open-source AI models:
- Buy me some equipment from my wishlist
- Support my work for a month or year by becoming a member on Buy Me a Coffee
- Make a one-time donation through Buy Me a Coffee
Thank you for your support! Together, we can push the boundaries of what's possible with open-source AI.
The code within this repository comes with no guarantee, the use of this code is your responsibility. I take NO responsibility and/or liability for how you choose to use any of the source code available here. By using any of the files available in this repository, you understand that you are AGREEING TO USE AT YOUR OWN RISK. Once again, ALL files available here are for EDUCATION and/or RESEARCH purposes ONLY.
OfflineAI is released under the MIT License. See the LICENSE file for more details.
Copyright (c) 2023 CorvusCodex
Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the "Software"), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions:
The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software.
THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.
