Support for Ollama #616

Activity

1. josStorer commented on Jan 26, 2024

   

   josStorer

   on Jan 26, 2024

   Member

   More actions

   Could you please capture the request through F12 Network in the Ollama WebUI, and provide the relevant request headers and body
2. Donno191 commented on Feb 15, 2024

   

   Donno191

   on Feb 15, 2024

   More actions

   It would be nice to use ollama ! Maybe it works with the support of ollama openai api ? Example of settings ?
3. josStorer commented on Mar 3, 2024

   

   josStorer

   on Mar 3, 2024

   Last edited by josStorer

   Member

   More actions

   @Mulugruntz @Donno191

   After consulting the documentation of ollama, I found that ollama provides APIs compatible with OpenAI API.

   And for the 403 error, it is actually caused by cross-origin requests. According to https://github.com/ollama/ollama/blob/main/docs/faq.md#how-can-i-allow-additional-web-origins-to-access-ollama, you can set environment variable OLLAMA_ORIGINS to *, and then restart ollama to allow requests from browser extensions.

   The settings of ChatGPTBox are as follows:
   

   👍React with 👍8Reacted by Donovan Renato Fourie, nvidiaxinec, Yolo, J Elizondo, Carsten Uhlig, Jianbo Lin, Stephen Karl Larroque and Leonardo Poggiani

   🎉React with 🎉1Reacted by Stephen Karl Larroque
4. BarfingLemurs commented on Mar 5, 2024

   

   BarfingLemurs

   on Mar 5, 2024

   More actions

   thanks for the tip, filling the model name eg: "gemma:2b" is a requirement for ollama to works, along with: export OLLAMA_ORIGINS=* on linux.

   👍React with 👍1Reacted by Jianbo Lin
5. josStorer

   closed this as completedon Mar 24, 2024
6. Katzenwerfer commented on Jul 3, 2024

   

   Katzenwerfer

   on Jul 3, 2024

   More actions

   Something to note.
   Setting origins with a wildcard is generally not recommended.
   It is better to be specific and ideally add moz-extension://[ID OF THE EXTENSION], or with a wildcard if you can't find the ID moz-extension://*

   👍React with 👍1Reacted by J Elizondo
7. lrq3000 commented on Nov 28, 2024

   

   lrq3000

   on Nov 28, 2024

   More actions

   For reference, the issue was discussed here on the ollama issues tracker:

   • OpenAI API 403 error with 'Origin' http request header ollama/ollama#2425

   For better security, it was suggested here to set the var to the following:

   OLLAMA_ORIGINS=chrome-extension://* ollama serve

   Note that on Windows you need to logout and log back in, or restart the computer, for the environment variable change to take effect. If you want to try asap, you can instead kill ollama, then open a command line terminal and write:

   ollama serve```
   
   This will temporarily allow cross origin access. But this won't persist, if you want a permanent environment change, use instead:
   
   ```setx OLLAMA_ORIGINS *```
   
   Of course you need to have downloaded a model in ollama beforehand (eg, ```ollama run phi3.5```).
   

   👍React with 👍1Reacted by josc146