Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ollama interface problem #11

Open
iplayfast opened this issue Mar 28, 2024 · 3 comments
Open

ollama interface problem #11

iplayfast opened this issue Mar 28, 2024 · 3 comments
Labels
bug Something isn't working

Comments

@iplayfast
Copy link

 ✓ Ready in 667ms
 ○ Compiling / ...
 ✓ Compiled / in 1628ms (1571 modules)
 ✓ Compiled in 293ms (470 modules)
There was a problem with your fetch operation: [Error: Network response was not ok. Status: 422]
Error: Network response was not ok. Status: 422
    at getImages (webpack-internal:///(rsc)/./app/action.tsx:178:19)
    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
    at async Promise.all (index 0)
    at async eval (webpack-internal:///(rsc)/./app/action.tsx:293:43)
Error: Network response was not ok. Status: 422
    at getImages (webpack-internal:///(rsc)/./app/action.tsx:178:19)
    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
    at async Promise.all (index 0)
    at async eval (webpack-internal:///(rsc)/./app/action.tsx:293:43)
 ⨯ unhandledRejection: Error: Network response was not ok. Status: 422
    at getImages (webpack-internal:///(rsc)/./app/action.tsx:178:19)
    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
    at async Promise.all (index 0)
    at async eval (webpack-internal:///(rsc)/./app/action.tsx:293:43)
 ⨯ unhandledRejection: Error: Network response was not ok. Status: 422
    at getImages (webpack-internal:///(rsc)/./app/action.tsx:178:19)
    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
    at async Promise.all (index 0)
    at async eval (webpack-internal:///(rsc)/./app/action.tsx:293:43)
Error fetching search results: [Error: HTTP error! status: 422]
Error fetching videos: [Error: Network response was not ok. Status: 403]
The streamable UI has been slow to update. This may be a bug or a performance issue or you forgot to call `.done()`.


app/config.tsx

// - The below are going to be the default values, eventually this will move to a UI component so it can be easily changed by the user
// - To enable + use Ollama models, ensure inference and/or embeddings model are downloaded and ollama is running https://ollama.com/library 
// - Icons within UI are not yet dynamic, to change currently, you must change the img src path in the UI component
// - IMPORTANT: when Ollama Embeddings + Ollama inference enabled at the same time, this can cause time-to-first-token to be quite long
// - IMPORTANT: Follow-up questions are not yet implrmented with Ollama models, only OpenAI compatible models that use  {type: "json_object"}

export const config = {
    useOllamaInference: true, 
    useOllamaEmbeddings: true, 
    inferenceModel: 'mistral', //mixtral-8x7b-32768', // Groq: 'mixtral-8x7b-32768', 'gemma-7b-it' // OpenAI: 'gpt-3.5-turbo', 'gpt-4' // Ollama 'mistral', 'lla
ma2' etc
    inferenceAPIKey: process.env.GROQ_API_KEY, // Groq: process.env.GROQ_API_KEY // OpenAI: process.env.OPENAI_API_KEY // Ollama: 'ollama' is the default
    embeddingsModel: 'llama2', // Ollama: 'llama2', 'nomic-embed-text' // OpenAI 'text-embedding-3-small', 'text-embedding-3-large'
    textChunkSize: 500, // Recommended to decrease for Ollama
    textChunkOverlap: 200, // Recommended to decrease for Ollama
    numberOfSimilarityResults: 4, // Numbher of similarity results to return per page
    numberOfPagesToScan: 5, // Recommended to decrease for Ollama
    nonOllamaBaseURL: 'https://api.groq.com/openai/v1', //Groq: https://api.groq.com/openai/v1 // OpenAI: https://api.openai.com/v1 
};
@noodleA1
Copy link

I'm getting something a little similar:

(base) arw@AIMonster:/mnt/e/AI_Directories/llm-answer-engine$ npm run dev

ai-rsc-demo@0.0.0 dev
next dev

▲ Next.js 14.1.2

✓ Ready in 1690ms
○ Compiling / ...
✓ Compiled / in 3s (1588 modules)
✓ Compiled in 217ms (470 modules)
Error fetching videos: [Error: Network response was not ok. Status: 403]
Error: Network response was not ok. Status: 403
at getVideos (webpack-internal:///(rsc)/./app/action.tsx:227:19)
at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
at async Promise.all (index 2)
at async eval (webpack-internal:///(rsc)/./app/action.tsx:293:43)
Error: Network response was not ok. Status: 403
at getVideos (webpack-internal:///(rsc)/./app/action.tsx:227:19)
at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
at async Promise.all (index 2)
at async eval (webpack-internal:///(rsc)/./app/action.tsx:293:43)
⨯ unhandledRejection: Error: Network response was not ok. Status: 403
at getVideos (webpack-internal:///(rsc)/./app/action.tsx:227:19)
at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
at async Promise.all (index 2)
at async eval (webpack-internal:///(rsc)/./app/action.tsx:293:43)
⨯ unhandledRejection: Error: Network response was not ok. Status: 403
at getVideos (webpack-internal:///(rsc)/./app/action.tsx:227:19)
at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
at async Promise.all (index 2)
at async eval (webpack-internal:///(rsc)/./app/action.tsx:293:43)
The streamable UI has been slow to update. This may be a bug or a performance issue or you forgot to call .done().
...

app/config is the default, and I have all api keys (brave, openai, groq, serper)

@noodleA1
Copy link

running a different search, this came up with a few different errors. yes...yes, I searched up kiwis

▲ Next.js 14.1.2

✓ Ready in 1743ms
○ Compiling / ...
✓ Compiled / in 1494ms (1570 modules)
✓ Compiled in 457ms (470 modules)
Error fetching videos: [Error: Network response was not ok. Status: 403]
Error: Network response was not ok. Status: 403
at getVideos (webpack-internal:///(rsc)/./app/action.tsx:227:19)
at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
at async Promise.all (index 2)
at async eval (webpack-internal:///(rsc)/./app/action.tsx:293:43)
Error: Network response was not ok. Status: 403
at getVideos (webpack-internal:///(rsc)/./app/action.tsx:227:19)
at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
at async Promise.all (index 2)
at async eval (webpack-internal:///(rsc)/./app/action.tsx:293:43)
⨯ unhandledRejection: Error: Network response was not ok. Status: 403
at getVideos (webpack-internal:///(rsc)/./app/action.tsx:227:19)
at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
at async Promise.all (index 2)
at async eval (webpack-internal:///(rsc)/./app/action.tsx:293:43)
⨯ unhandledRejection: Error: Network response was not ok. Status: 403
at getVideos (webpack-internal:///(rsc)/./app/action.tsx:227:19)
at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
at async Promise.all (index 2)
at async eval (webpack-internal:///(rsc)/./app/action.tsx:293:43)
Error fetching image link https://plantinstructions.com/wp-content/uploads/2017/03/kiwi-in-a-pot.jpg: [TypeError: fetch failed] { cause: [Error: redirect count exceeded] }
Error fetching image link https://plantinstructions.com/wp-content/uploads/2017/03/kiwi-plant.jpg: [TypeError: fetch failed] { cause: [Error: redirect count exceeded] }
The streamable UI has been slow to update. This may be a bug or a performance issue or you forgot to call .done().

@noodleA1
Copy link

Another attempt after uninstalling node/npm
...
(base) arw@AIMonster:/mnt/e/AI_Directories/llm-answer-engine$ npm run dev

ai-rsc-demo@0.0.0 dev
next dev

▲ Next.js 14.1.2

✓ Ready in 13.7s
○ Compiling / ...
✓ Compiled / in 14.1s (1588 modules)
✓ Compiled in 334ms (470 modules)
Error fetching videos: [Error: Network response was not ok. Status: 403]
Error: Network response was not ok. Status: 403
at getVideos (webpack-internal:///(rsc)/./app/action.tsx:227:19)
at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
at async Promise.all (index 2)
at async eval (webpack-internal:///(rsc)/./app/action.tsx:293:43)
Error: Network response was not ok. Status: 403
at getVideos (webpack-internal:///(rsc)/./app/action.tsx:227:19)
at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
at async Promise.all (index 2)
at async eval (webpack-internal:///(rsc)/./app/action.tsx:293:43)
⨯ unhandledRejection: Error: Network response was not ok. Status: 403
at getVideos (webpack-internal:///(rsc)/./app/action.tsx:227:19)
at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
at async Promise.all (index 2)
at async eval (webpack-internal:///(rsc)/./app/action.tsx:293:43)
⨯ unhandledRejection: Error: Network response was not ok. Status: 403
at getVideos (webpack-internal:///(rsc)/./app/action.tsx:227:19)
at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
at async Promise.all (index 2)
at async eval (webpack-internal:///(rsc)/./app/action.tsx:293:43)
Error fetching image link https://s3g2u3k4.rocketcdn.me/wp-content/uploads/sites/4/2022/03/kiwi.jpg: [TypeError: fetch failed] {
cause: [Error: getaddrinfo ENOTFOUND s3g2u3k4.rocketcdn.me] {
errno: -3008,
code: 'ENOTFOUND',
syscall: 'getaddrinfo',
hostname: 's3g2u3k4.rocketcdn.me'
}
}
Error fetching image link https://plantinstructions.com/wp-content/uploads/2017/03/kiwi-in-a-pot.jpg: [TypeError: fetch failed] { cause: [Error: redirect count exceeded] }
Error fetching image link https://plantinstructions.com/wp-content/uploads/2017/03/kiwi-plant.jpg: [TypeError: fetch failed] { cause: [Error: redirect count exceeded] }
The streamable UI has been slow to update. This may be a bug or a performance issue or you forgot to call .done().

@developersdigest developersdigest added the bug Something isn't working label Apr 12, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

3 participants