Adding new llms from together.ai or deepinfra

I’m not sure I had it enabled in my testing, so I likely didn’t see it in the model list. And I only added the one’s I could confirm were working. That and it’s been discussed just to name the provider “GitHub”.

And @thecodacus has a PR that may conflict with this, which is restructuring how Providers are added, which should make it easier to add them.

So while I would like this now, I’ll update the PR once the new changes are made. I also did the same for testing Cerebras as well. It’s not bad adding new providers (I’ve been testing a bit), but there are a lot of files to update and room for making mistakes.

1 Like