Pull Request: Issues with oTToDev, Ollama & Docker/Docker Compose

mahoney · November 18, 2024, 9:53pm

Docker development profile fixes: Ollama

coleam00:main ← chrismahoney:fix/envlocal-docker

opened 09:49PM - 18 Nov 24 UTC

Docker 'development' profile has not been working well or at all for folks runni…ng Ollama. Here's the situation: **Setup** - Your .env.local must specify a base URL for Ollama; http://localhost:11434 if you're running oTToDev alongside Ollama locally, http://host.docker.internal:11434 if you're running oTToDev in a container with Ollama locally. If both are in a container, they should both be on the same virtual network and you would use http://[docker vnet host for ollama]:11434. I feel that this is out of scope in terms of us providing technical support to run Ollama. **Docker development (Ollama running on local machine)** - OLLAMA_BASE_API_URL in .env.local MUST be set to http://host.docker.internal:11434 - Run under docker compose: `pnpm run dockerbuild && docker compose --profile development up` - Run via docker command: `pnpm run dockerrun` **Local development** - OLLAMA_BASE_API_URL in .env.local MUST be set to http://localhost:11434 - Run development environment locally: `pnpm install && pnpm run dev` **FIX** - .env.local is present in .dockerignore, ensuring it will not be available during build process or when running via Docker Compose. This PR removes that. - I would suggest that instead of running development with .env.local, we may want to have three tiers - .env.local: Fully local run via `pnpm run dev`, this is actually local - .env.dev: We would use this for Docker while using the `development` profile - .env: The real .env for actual production runs. I'd like to see if we can get some docker folks to test their environments with these changes, I know there are several solutions out there as existing Pull Requests but I feel like this one involves the least amount of future maintenance.

For those with issues running oTToDev in a container while Ollama is running locally, I would like to see if we can get some community members to test the changes within this pull request. Please see the description for more details, and provide any feedback or issues you receive within the comments for that pull request (especially if you can point to other PRs/issues about this problem).

I’ll review the PR later on this evening, after some initial testing I was able to run via pnpm run dev locally as well as via Docker Compose as mentioned in the README, so long as my Ollama base API URL was properly set in the .env.local file

Feedback is more useful in the Github PR in order to consolidate any changes that need to be made, versus replies here. Thanks y’all.