I set up oTToDev to run in a docker container & ollama to run on the host system. I can run oTToDev fine & it has an ollama dropdown, but it doesn’t list any models.
My guess is that the container can’t access the ollama server on the host. Google mainly turns up ways to access the container server, but little on how to access a server on the host.
Can anyone point me to how to do this?
Thanks, Beth
I am having the same issue now as well. I notice from the log file when running the docker container in foreground that if you just put “1+1” into the chat window it’s trying to run claude-3-5-sonnet-latest, I have no idea how it picked that since I don’t even have it installed in my Ollama instance.
I did log into my ottodev Docker container just to make sure that the container can reach my Ollama server and that networking within the container wasn’t an issue.
Most of the videos and tutorials online show that it should just work without fuss as long as you set the variable in .env.local (which was another issue):
OLLAMA_API_BASE_URL=http://yourserver.com:11434.
In my case my Ollama is not running on my localhost but on my workstation with my Nvidia card. Maybe not being on localhost has something to do with it?
I have a fix in a pull request here is the link: Ollama not respecting model selection by dustinwloring1988 · Pull Request #460 · coleam00/bolt.new-any-llm · GitHub
1 Like
The last thing I see is…
1 check passed Details
What does that mean? Has it been patched into a bugfix release or something and I just need to get the latest release? I’m sorry I’m not highly technical to know how to use these things. Do I apply some patch manually? What is the way forward?
Err… just to clarify I think I’m confused about whether this fix has already made it into (something) or is still going through phases for approval and will come in the future. Also how to detect it on my own? And, yeah, I just want to be able to play with OttoDev man. 
@blahboybaz No it did not get pulled in yet I was hoping to have some other try it first to make sure it dose not brake anything else on other OS’s or Environments than what I run.
I would love to but I would need to be instructed how to do it. I do have some familiarity with git and know how to do most operations with it - but not something like this. If you would be willing to tell me how to do it I would love to try it (and report back the results).