N8n/coolify/ollama

bobm67 · January 4, 2025, 12:23am

hi, I have an existing vps running coolify to manage some apps/containers.
I have an n8n container. I added an ollama container (on the same docker network) but I am not seeing the llms I pulled into ollama in n8n. Anyone have experience with running coolify that may give me a clue?

TIA

Bob

leex279 · January 4, 2025, 12:25am

Hi,

my guess => Ollama not bind to the correct address:

Ollama binds 127.0.0.1 port 11434 by default. Change the bind address with the OLLAMA_HOST environment variable.

=> so bind it to 0.0.0.0 or to the containername “ollama:11434” or what you have

github.com

ollama/ollama/blob/main/docs/faq.md

# FAQ

## How can I upgrade Ollama?

Ollama on macOS and Windows will automatically download updates. Click on the taskbar or menubar item and then click "Restart to update" to apply the update. Updates can also be installed by downloading the latest version [manually](https://ollama.com/download/).

On Linux, re-run the install script:

```shell
curl -fsSL https://ollama.com/install.sh | sh
```

## How can I view the logs?

Review the [Troubleshooting](./troubleshooting.md) docs for more about using logs.

## Is my GPU compatible with Ollama?

Please refer to the [GPU docs](./gpu.md).

This file has been truncated. show original

bobm67 · January 4, 2025, 12:38am

thanks will give it a try. What about having ollama pull the models I want when it starts up? I have to do it manually every time

leex279 · January 4, 2025, 9:15am

bolt does list all available models within ollama (“ollama list”). When they not running it will spinn them up, what can then take some time.
So not to be done manually.

You just need to pull the models you need one time, so they are available.

bobm67 · January 13, 2025, 10:53pm

I tried that but it didnt work

leex279 · January 14, 2025, 8:00am

@aliasfox maybe you can help better, as I am not that deep into n8n yet