I have been loving your videos and find each one super informative and insightful.
Now, I’d like to build some agents and what I find where I am getting stuck is that I do not have a universal mental model or framework in my mind for how to decide which components are needed in my agentic system based on the needs of the project.
For example
Does the agent need memory (eg mem0) or not?
Does the agent need a RAG pipeline or not? If so, is it LightRAG or agentic RAG or something else?
Do I need to finetune a model or not?
My sense is that maybe you have a mental model here and perhaps you have baked it into Archon so that when folks use Archon to build their agents it breadcrumbs them with questions to help them build the right agent.
I wasn’t sure so I thought I’d ask you as this might be the basis for a good evergreen video for your channel that you can refer folks to so they can see how everything fits together.
Should I just run Archon and it will guide me by asking me the right questions before creating the agent or is there a video I should watch to give me a complete picture of all the parts to consider for an agentic system?
In my case I’d like to build a project manager AI to help my family member who cannot afford a chartered project manager to manage their house renovation project.
Great questions here! So I don’t have a video right now on something like a mental model as you are describing, but you’re certainly right that it would make a great video! Archon could certainly help walk you through it though I haven’t prompted it in a way to give better advice than just asking the LLM like Claude 3.7 Sonnet directly.
What exactly are you trying to build? I could provide my 2 cents here too!
The context is that I had been stuck after building a few demo agents looking for a real problem to solve with an AI agent to take my learning to the next stage.
Then I noticed a family member and actually a number of friends and peers are all in the process of purchasing an existing house and want to renovate it.
They are all managing it themselves and figuring out surveyors, architect, subcontractors and general contractors as well as vendors for materials.
This is usually done by a chartered project manager who takes your requirements and then manages your project for you from start to finish.
The challenge is that either their fees are too high for the budget of a small residential renovation or they are just too busy with larger commercial projects so they have no time for smaller ticket projects. So folks end up being DIY project managers for their own house renovation or they are fooled into thinking that’s their architect’s job.
So, I thought, what if they could go to a website, enter the address of the building and chat to an agent for a little bit and then that project manager agent could take that as its necessary input to start and manage the project?
I would feed it with a shortlist of pre-vetted vendors for both labour and materials.
Beyond data on vendors the agent would need to be able to communicate with stakeholders, schedule stakeholders, access data on planning/regs etc as well as data the user or vendors would provide like survey data or things like third party mapping data.
In a dream world, I would take something like Sesame’s open source voice model and create a Jarvis-like experience where you just press a button like Shazam and talk to your project manager and never have to talk to vendors etc.
It’s kind of crazy how much marital stress I see in people who do major home renovations. It would be great to do a small bit to alleviate that.