Looking for advice on which best recommended laptop/desktop on a budget to run bolt.diy locally ?
1 Like
Great question! Though it depends a lot on which LLMs you want to run locally. If you want to run the more impressive models like Qwen 2.5 Coder 32b, I’d recommend picking up a used 3090 graphics card and building a PC around that.
1 Like
As Cole suggests, building a system around a 3090 is currently the best budget route when wanting to run mid-sized models locally. This is what I use in a custom built PC. If you want a laptop, I’d suggest looking at MacBook Pro with M4 chip.
Just the 5070 that will be available in a few weeks is a beast that will run qwen 32b with ease with out a doubt
But they also are going to be doing laptops with integrated 50 series chips might be worth holding out for and save up to get a little extra power when they do drop