Hi everyone,
I’m a fan of Bolt.diy and have been exploring it with my own custom model. While the model supports a maximum of 35,000 tokens, I often encounter token overflow issues when uploading folders and querying the model.
Does anyone have suggestions or strategies for:
Reducing token usage when working with large inputs?