3 Likes
Good one yeah it’s too bad that a lot of PCs can’t run it, but you could always try the 7b or 14b parameter versions! They still kick butt!
nah
i’ve been trying for 3 weeks to finish my app but free models can’t do any changes for files they didn’t create, they just erase my app and break the whole code
so i’ll wait for import function
Ha! Yeah, this is about how mine went with the 90b model, about 1 token per second.
32b model is running great