Hi,
With open-webui, I’m unable to perform RAG on documents. How can I solve this?
Thanks
Could you please provide more details on the issues you are facing? Hard to help with only a single sentence 
“I’ve installed the entire LocalAI suite on an M4 Mac Mini, following all instructions, and it’s working very well. However, I’m unable to perform RAG (Retrieval-Augmented Generation) with documents, both .pdf and .txt files. When I upload the document to open-webui and ask a question, the result is ‘no document found’.”
Which Workflow you are using? The V1 with Open-WebUI is not capable of extracting text. If you take a look at the Google Drive Folder Workflow in the same, you see that there is a text extract node:
can you please provide the workflow as json? then I can test.
1 Like
Sure,
V1_ocal_RAG_AI_Agent.json (14.3 KB)and this is open-webui error when with try RAG with a test1.txt
In this workflow there is no connect between the openwebui Webhook and the file extraction.
The file extraction (bottom flow, just works with “local filesystem”. So if you would put an file there, it would recognize it, and then trigger the workflow).
Did not try yet, but I think you need to connect the webhook to the "clear old vectors node).
Maybe there is more to do, but without these it cant work.
2 Likes
Hi,
I try this.
Thanks
Hi,
now I try with V3 , follow the video from youtube ( second part ) , but receive this error :
Problem in node ‘RAG AI Agent‘
Non string tool message content is not supported
in both webhook and chat.
Thanks
Looks like you did not configure the Ollama Chat Model Node. Either with OpenAI as shown mistakenly in the video, or with ollama as intended as written/corrected in my first pinned comment:
Ollama chat model is correct. If I start a normal conversation ( non RAG ) work fine.
So, I run on MAC , Is this a probs ?
I see some little probs during installation.
Thanks
p.s How to clear a Postgresql memory chat ?
p.s.2 I use ollama on host
But in the Screenshot of you, it shows that there is a problem with this node. There must be an error within this node when you open it:
This occur when system go to retrivial data from RAG.
When chat , like ‘hello’ o somethings that , work.
Ok but what is the errors it shows within the node when you open it? There must be a error description.
ah sry, now I understand.
The default workflows are not designed to work with txt, pdfs files from the chat. This is something you would need to build first.
They are just using files from the local folder to index them in a knowledgebase. There is no connection between openwebui upload and the indexing part.
Thats what I wrote here RAG with document (.pdf , .txt ) - #8 by leex279
Did you try this? Cause in your postet screenshot I dont see it.
Oh… what kind on document RAG work ? only .md ?
I try this RAG with document (.pdf , .txt ) - #8 by leex279 later .
Thanks
It doesnt work at all with files, until there is a connection / workflow step to deal with files from openwebui. Then it can work with everything, if you implemented it. In the V3 you see some nodes dealing with different file types:
Still need to dive deeper and make this work with openwebui. Will then make a video maybe, if there is interrest. So far not much people watching my n8n videos 
