Adding new llms from together.ai or deepinfra

I made the changes and Created a Pull Request:

@MotionNinja For an API Key, visit the Azure OpenAI Service - Model Page and click the “Get API key” button. It’ll step you through the process (see screenshot):

Note: I’ve been told you don’t need to choose any permissions when creating the key, but I gave read access to all the “CoPilot” options. And it doesn’t matter if you use Fine-Grained (Beta) or Classic Tokens.

Hope that helps!

1 Like