Best local LLM for web coding

General
1

Hi there,

Truly love what’s happening here with the oTToDev, i never thought of running a LLM local on my pc. Right now i’m experimenting with local LLMs to see what is best for building websites.

I hope that i can use this to build fast demo websites based on the idealization of clients. But i notice a BIG difference in outputs.

So i wonder what is for you the best LLM specific for web development (HTML5/CSS3/Java)

Thanks in advance!

Mike

1 Like
2

Fantastic question @SiteWizards! My favorite LLMs for coding recently have been the ones in the Qwen-2.5-Coder family. There is a 7b, 14b, and 32b parameter version, so I’d recommend using the one that your machine can run well!

1 Like
3

@ColeMedin

Thanks alot for the answer, i was indeed experimenting with Qwen, sadly i thought my computer could handle the 16b version, but it’s having a hard time… Might need to look for a guide to optimize my pc for it (unless there is one here?)

Because i see people with less specs running the 16b easy, so there might be something wrong with my system haha. (6900 XT, 7700X, 64GB Ram)

Might be a good video btw, how to optimize you pc for local LLMs (checklist), next to the setup of the system :slight_smile:

Mike

4

I appreciate the suggestion Mike! I would look into “model quantizing” as well, basically in Ollama you can download smaller versions of models that run almost as well as the base version.