thanks, just => ollama and openwebui is locally installed without Docker, right?
sorry im not using these replies correctly i think lol.
yes ollama just directly, but webui is on docker.
Ok, I quickly showed this at the end, when I switch to my other PC:
Not sure if this helps you, but let me know.
yea not sure cause i dont have ollama or anything on my windows rig, it has a very low gpu. so i remote into my linux box for all this. but it either wont connect to my ollama or will give me “Failed to spawn bolt shell/Failed to execute” errors.
Can you try out the stack from my video with everything in docker. If this works, we can try figuring out further, what the problem is with your local ones.
Also the process should be same on linux and windows.
My issue would be I already have ollama and a bunch of models I use, so adding another ollama would have issues with it as below:
Error response from daemon: driver failed programming external connectivity on endpoint ollama (7c722f2f787f76715b4b414143b34c31502e1766c209d46398796fee5fcc83e2): failed to bind port 0.0.0.0:11434/tcp: Error starting userland proxy: listen tcp4 0.0.0.0:11434: bind: address already in use
then when i do get ollama connected to bolt, it wont actually code anything, in the bolt terminal it will say
Failed to spawn bolt shell
Failed to execute ‘postMessage’ on ‘Worker’: SharedArrayBuffer transfer requires self.crossOriginIsolated.
you just need to close/quit/stop your local ollama and then run the docker container (as I did in my video. had this error also because I forgot )
Try to set this variable as well for your local Ollama (I see you got the hosts one already):
OLLAMA_ORIGINS=*
Yea i already have orgins set
[Service]
Environment=“OLLAMA_HOST=0.0.0.0”
Environment=“OLLAMA_ORIGINS=*”
Environment=“OLLAMA_FLASH_ATTENTION=1”
i stopped ollama and webui on my end and docker compose -f docker-compose-amd.yml up -d
But ollama does not pull any models
@ColeMedin did you test it out in the meantime or maybe see the problem here?
I dont have Linux to test it out. As shown on my video it worked for me in windows.