Yes, I think for most people it makes no sense to use local llms. there are so much cheap and free providers out. I dont see the usecase at the moment for hosting it locally. Maybe if you haven confidental docs / special training models you need to use etc… but yeah, I dont see it (my opinion on this).
I dont use ollama. Just testet it out because of I am interested how it works.
If I win the lottery and can spent 50k on hardware, then maybe I do 
2 Likes
I can’t wait for someone to build a local LLM on one of these mni-PCs that interacts with something like Home Assistant.
@chopomatic think this is something you can already do with llama-models wiht 1B oder 3B params.
But yes, its also on my list to integrate it in my smart home to provide me analysis etc.
TBH, I’m so weak at coding that I’ll wait until someone much more capable than me creates and shares it. I’d love to bring all my smart home functionality in house and it would be sweet to have AI incorporated.
1 Like
Hey Jerry
I’d say if you find some time and stay curious here. You’ll actually learn a lot about coding. Understand what you’re trying to achieve, make changes, watch while files are being updated and read the details on why. Get an understanding at that level. You will pick up the detail very quickly.
I can code but object oriented is just one layer. There’s situations here where Bolt will advise it’s rejigging the code to be more efficient and follow best practices. It’s not always the case. Sometimes it will get uneccessarily complicated and you find next thing stuff stops working.
But. Watch, play around and learn. Even read through a lot of other peoples issues and challenges. You’ll learn a lot through that also.
I remember programming on a Vic20 and C64. Then Cobol and Fotran on a mini-computer. Yeah even used punch-cards and ribbon tape. LOL. I remember having the patience only a kid of the early 80’s could have had. It’s similar now - the more you do, the better you get.
1 Like
I will close this topic now, as we mixed up too much things here. It fails the initial topic 
=> @chopomatic would be happy to discuss this in a new topic within Local AI. Even if you dont want to code, you could write down and share thoughts on what usecases you see and could be implemented. Also share some infos what you are using in your smart home at the moment (nodered, home assistant, etc.)
2 Likes