I would love if aws bedrock integration is implemented. So I will be able to use credits directly from aws to use claude 3.5 sonnete and claude 3 opus without paying anthropic.
Please add this.
3 Likes
If you take a look at this open source project, there is a serverless OpenAI compatible wrapper to bedrock. You can point OttoDev to this as an alternate openai API and access bedrock behind that.
I havenāt tested yet but Iāll try to find time today
2 Likes
This is perfect @erikdj!
Iām using the bedrock proxy with OpenAILike and use the sonnet 3.5 v2 model it works a treat
1 Like
I have created a PR to update Readme file. I have added āAWS Bedrock integrationā as one of the todo items.
This will help with tracking feature request.
3 Likes
You can use it through OpenRouter which is available in the list.
Can you guide me how can I use it? I am not that kind of a developer.
You can sign up for a free account, but I just tested and couldnāt get any of the models to work. I just added $25 in credits to get started myself. Just signup and create an API KEY: https://openrouter.ai/settings/keys
Additionally, sign up for a free Hugging Face account:
Create an API: Hugging Face ā The AI community building the future.
And use one of the HuggingFace options from the dropdown list for Free.
Namely Qwen2.5-Coder-32B-Instruct, Qwen2.5-72B-Instruct, and LLama-3.1-70B-Instruct.
You can add more, like the new Llama3.3, QwQ, and other models but that would require modifying some code.
You can also get Free access to the Google Gemini Experiment 1206, through Google AI Studio. Itās pretty good. Use āGoogleā from the dropdown.
And if you donāt want to set things up yourself, you can use the version hosted by @wonderwhy.er at https://ottodev-bolt.myaibuilt.app/
Hope that helps.
hello, have you ever encountered the problem that OpenAILike dev can run, but the display after start is missing and the API key is missing