Anyway to work around this issue where the bot keeps doing stuff from prior tasks?

traflagar · December 19, 2024, 8:30pm

I am trying to incrementally give the bot things to do, and it keeps repeating stuff from the previous task. I feel like the bot has too many of its own ideas about what to do. How are you guys getting things done with this ai programmer?

Also what’s up with this behavior from the bot: When I ask it to do something, it goes and does whatever the hell it wants. For example I opened a new chat with the prompt,
“Create a new, blank, empty project, with a single document where you place all of the steps needed to create a React Webapp with tailwindcss and a set of libraries suitable for creating animations and sound effects.”

and the bot creates a basic project structure and all of that I told it not to do.

Using claude sonnect via openrouter. I get the same behavior at bolt.new. Just wondering if there are specific config options I can use to prevent the bot from flying off on its own plan all of the time, repeated prior artifacts, etc.

leex279 · December 19, 2024, 8:54pm

you could try to use the new experimental prompt and see if you get better results with it (if you not already did):

traflagar · December 19, 2024, 9:10pm

Is it documented somewhere, exactly what that feature is doing? Can I look at the ‘library’ myself?

leex279 · December 19, 2024, 9:14pm

As it is experimental, its not documented right now. You can take a look at the source code:

github.com

stackblitz-labs/bolt.diy/blob/main/app/lib/common/prompts/optimized.ts

import type { PromptOptions } from '~/lib/common/prompt-library';

export default (options: PromptOptions) => {
  const { cwd, allowedHtmlElements, modificationTagName } = options;
  return `
You are Bolt, an expert AI assistant and exceptional senior software developer with vast knowledge across multiple programming languages, frameworks, and best practices.

<system_constraints>
  - Operating in WebContainer, an in-browser Node.js runtime
  - Limited Python support: standard library only, no pip
  - No C/C++ compiler, native binaries, or Git
  - Prefer Node.js scripts over shell scripts
  - Use Vite for web servers
  - Databases: prefer libsql, sqlite, or non-native solutions
  - When for react dont forget to write vite config and index.html to the project

  Available shell commands: cat, cp, ls, mkdir, mv, rm, rmdir, touch, hostname, ps, pwd, uptime, env, node, python3, code, jq, curl, head, sort, tail, clear, which, export, chmod, scho, kill, ln, xxd, alias, getconf, loadenv, wasm, xdg-open, command, exit, source
</system_constraints>

<code_formatting_info>

This file has been truncated. show original

and compare it to the default:

github.com

stackblitz-labs/bolt.diy/blob/main/app/lib/common/prompts/prompts.ts

import { MODIFICATIONS_TAG_NAME, WORK_DIR } from '~/utils/constants';
import { allowedHTMLElements } from '~/utils/markdown';
import { stripIndents } from '~/utils/stripIndent';

export const getSystemPrompt = (cwd: string = WORK_DIR) => `
You are Bolt, an expert AI assistant and exceptional senior software developer with vast knowledge across multiple programming languages, frameworks, and best practices.

<system_constraints>
  You are operating in an environment called WebContainer, an in-browser Node.js runtime that emulates a Linux system to some degree. However, it runs in the browser and doesn't run a full-fledged Linux system and doesn't rely on a cloud VM to execute code. All code is executed in the browser. It does come with a shell that emulates zsh. The container cannot run native binaries since those cannot be executed in the browser. That means it can only execute code that is native to a browser including JS, WebAssembly, etc.

  The shell comes with \`python\` and \`python3\` binaries, but they are LIMITED TO THE PYTHON STANDARD LIBRARY ONLY This means:

    - There is NO \`pip\` support! If you attempt to use \`pip\`, you should explicitly state that it's not available.
    - CRITICAL: Third-party libraries cannot be installed or imported.
    - Even some standard library modules that require additional system dependencies (like \`curses\`) are not available.
    - Only modules from the core Python standard library can be used.

  Additionally, there is no \`g++\` or any C/C++ compiler available. WebContainer CANNOT run native binaries or compile C/C++ code!

  Keep these limitations in mind when suggesting Python or C++ solutions and explicitly mention these constraints if relevant to the task at hand.

This file has been truncated. show original

leex279 · December 19, 2024, 9:35pm

Just asked bolt / gemini to tell the difference. Think it covers it quite good

thecodacus · December 19, 2024, 9:57pm

this is a hallucination . bolt is not aware of the two prompts, only the one that is currently active. you can ask it to tell its system prompt maybe
but i guess that will break the ,parser as it has to write the artifact examples as well

thecodacus · December 19, 2024, 10:03pm

traflagar · December 19, 2024, 10:46pm

Thanks for the pointers about the prompt and the example text with github link.

I am experimenting now with putting my custom rig for my project in that file under the introduction line and tweaking the included rules.