Help getting local AI working on Mac Mini M2Pro

Local AI
1

Hi all, and Cole. I love your videos, thanks for putting in the effort.
I am stuck installing the package described in this video.

First, I had an issue with my OpenWebUI secret key because I already had used OpenWebUI on my system. That was solved by uninstalling it then reinstalling it without logging in.

Now, for some reason my Ollama container in Docker is in a constant ‘restart’ state, with the error "unknown command “ollama serve” for “ollama”. I have downloaded llama 3.2 and modified the Docker-compose.yml file to reflect this, but it still won’t restart.

I am not a coder, so am relying on Perplexity to help me here. Even that has given up on me!

I need help, and ongoing support with this project as it’s for my business in Automotive education. My clients require confidentiality, so I need a local LLM to help me develop training materials. For the moment I’m testing this on my Mac Mini M2 Pro, but as time progresses I’d like to eventually scale up to a model that is stand-alone, and can be taught to provide educationally sound output based on the confidential data I pump into it.

I’m waaaaaaay down in New Zealand, so if anyone is interesting in helping me with this and doesn’t mind video calls to weird time zones, please let me know!

Thanks.

1 Like
2

Please ignore this, I was using the wrong installation process… :upside_down_face:

However, I still want a collaborator if you’re interested.

2 Likes
3

Glad you figured it out Steve!

Replying here to bump this in case anyone is interested in collaborating with you. Sounds like an awesome project :slight_smile:

4

I just started afresh but now I’m encountering the following issue.

When I try to import the n8n pipe function into OpenWebUI, the function ‘saves’ successfully, but it’s not visible on the Tools tab. It just disappears! I’ve tried downloading it and importing, same result. No errors.

Possibly a question for the OpenWebUI community?

I’ve learned a lot over the past week. That changing from Google Drive to MS OneDrive is complicated, so I gave up. That trying to replace that with a local drive is complicate, almost impossible on a Mac, so I gave up. Now I have a clean install and I’m having this function issue. Darn!