So we all use Archon to create Agent, but there is a limit thing is Archon doesnt have access to anytool to help agent comes with tool and we have to customize tool by using cursor + available docs.
My question is possible that we can let archon has the function that we can put any url or sitemap sheet of a tool then let it crawl and put it to knowledge base?
Then it will be much much easier to create an Agent.
Imagine, we have pydanticAI template + knowledge about tools that we wanna use. Using winsurf or cursor to call Archon mcp to create an AI Agent that using brave to search web (brave docs already crawled to db) and it will understand super easier and have well construction code. Once we have the code template with tool, the rest is much easier with Code ide to adjust project.
LangGraph is the hardest one, but if we crawl the LangGraph docs and let Archon create a template with LangGraph, I cant imagine life will much easier.
I like the idea of having a configurable list of URLs that Archon will crawl. Another example would be Notion. If I want to create an Agent that uses Notion I want Archon to have access to Notion API documentation.
Love your ideas here @elpacino and @dant3ch! As I continue to develop Archon I certainly want to make it more “generic” in the sense that you can feed it any documentation, not just a pre-defined list of frameworks you can scrape.
We are already heading in that direction with a PR out there right now which I am going to include as a part of V7 for Archon!