I take the below back. Worked super fine for a full 10 prompts and now the same error appears again.
For anybody facing the following issues below, moving to Google Canary fixed it:
I’m having issues when prompting. Sometimes the prompt works, sometimes I get an error. See image. This happens independent of LLM but Im predominantly using Claude Sonnet and have enough credits. It seems to be random. I prompt now and it works, the 2-10th prompt gives an error, then suddenly prompt 11 works and 12 gives an error. I cant find any hint at what is happening either. Please help!
3 Likes
Could be context size issue. We need a way to know what is size of current context and what is size of current model context.
What I seen is that OpenRouter does not return reason for error sometimes. Just empty response…
So I don’t even know what was the reason.
It is on my radar to try and improve what is reported in UI about these issues. After one of my previous updates it should now show in UI that there are API Key issues for example.
1 Like
thank you man for hardworking
i hope its getting fixed because sonnet 3.5 is amazing
I just got my dev environment setup, set the openapi key (only) and get this error as well
