Hi all,
Really enjoying bolt.diy.
I was using bolt.diy, having started a new chat and working for a few hours, and I ended up with bolt.diy telling me my most recent reply was so-and-so large:
Tokens: 31919 (prompt: 30619, completion: 1300)
I am using Anthropic Claude 3.5 (directly via Anthropic API) in my bolt.diy session.
Anyway, now on my next prompts I Get the Custom Error: Overloaded.
The only other interesting detail is that this bolt.diy deployment is via a CF Worker (as the general discussion instructions have).
Anyone have an insight into what’s going on? Why am I getting an Overloaded error on a 30,000 token prompt on a 200,000 context size model (Official Anthropic Claude 3.5)?
Anyone else running into this error when building up a project in bolt.diy?
P.S. if anyone knows another way I can remotely host bolt.diy than CF Worker please direct me there; I tried just uploading bolt.diy to Vercel & Heroku and of course that didn’t work. I think a dedicated server may be more similar to the localhost environment than the CF Worker is similar to the bolt.diy’s native design for a ‘full uptime server’ versus CF Worker ‘edge function’ server.
This topic is also available @ the stackblitz/bolt.diy git Issues page for reference Understanding error Custom Error: Overloaded · Issue #1359 · stackblitz-labs/bolt.diy · GitHub