Setup help: Pydantic AI Docs Chunks 0

Hey everyone im sorry if this is an idiot question… im able to get to the crawling portion of things, but it always ends up showing 0 Chunks… Can someone give me a hint as to what i’ve done wrong in the setup? Any help is hugely appreciated!

Hey @monkeyssj1,

take a look at my install video. maybe you find out with it where the problem is:

If not, come back here and try to provide more informations (logs, screenshots of supabase tables, etc., how you run it (python or docker))

1 Like


Hey everyone, the same URL errors with me. All setup in green, using Docker, OpenAI. Table created. After crawling always 2-4 errors and the table in Supabase remains blank. Let me know, what else could help to identify the error. Anyway, great work! Thank you.

Here is an example of the error part:

2025-03-10 14:49:29 INFO:httpx:HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"
2025-03-10 14:49:29 2025-03-10 13:49:29.604 Thread 'Thread-50 (run_crawl)': missing ScriptRunContext! This warning can be ignored when running in bare mode.
2025-03-10 14:49:19 Error inserting chunk: 'NoneType' object has no attribute 'table'
2025-03-10 14:49:19 Error inserting chunk: 'NoneType' object has no attribute 'table'
2025-03-10 14:49:19 Error inserting chunk: 'NoneType' object has no attribute 'table'
2025-03-10 14:49:19 Error inserting chunk: 'NoneType' object has no attribute 'table'
2025-03-10 14:49:19 Error inserting chunk: 'NoneType' object has no attribute 'table'
2025-03-10 14:49:19 Error inserting chunk: 'NoneType' object has no attribute 'table'
2025-03-10 14:49:19 Error inserting chunk: 'NoneType' object has no attribute 'table'
2025-03-10 14:49:19 Error inserting chunk: 'NoneType' object has no attribute 'table'
2025-03-10 14:49:19 Stored 8 chunks for https://ai.pydantic.dev/api/models/test/
2025-03-10 14:49:19 Crawling: https://ai.pydantic.dev/api/pydantic_graph/state/
2025-03-10 14:49:19 Fetching content from: https://ai.pydantic.dev/api/pydantic_graph/state/
1 Like

thank you ill check this out later this evening when i get a moment… really appreciate your help!

curious to see what is the issue

This happened to me, too. My issue was it was sending the wrong size: Embedding Dimensions for Ollama Incorrect - Need Clarification

great tutorial! I followed along and am pretty sure I followed every step as you did, but for some reason am still getting 0 chunks

@monkeyssj1 thanks. I think there must be a problem with Archon. I had this on my first try as well (when not recording), but I also dont know why it was the case.
Maybe @ColeMedin has more insights / infos in the meantime.

I unfortunately have not been able to reproduce it yet, but I’ll be keeping my eye on this.

If anyone has any more details to help me look into this I would appreciate it a lot!

Im just so new at all of this, its hard for me to know what step i may have gotten wrong or if its not of my doing :stuck_out_tongue:

I was getting the same thing, I rebuilt the database in supabase and now I am getting “Error Processing title in the Title field and “error processing summary” for the summary field. and all the vectors are all "


0”

Hey, have exact same issue as OP.
Initially my scraping jobs took aprox 2 mins to finish, after no data in database i decided to re-run the whole setup in new container, this time scraping jobs are only taking 3 sec (ofc still no data).

From the docker log it seems the actual write to supabase keeps getting 400. I am using ollama so I set the table dimensions to be 768, is the actual request 1536? It’s difficult to see if dimensions are correctly set in GUI.

2025-03-13 10:01:23 INFO:httpx:HTTP Request: POST https://ogezzwpofwzmchovpahk.supabase.co/rest/v1/site_pages "HTTP/2 400 Bad Request"
2025-03-13 10:01:23 Error inserting chunk: {'code': '22000', 'details': None, 'hint': None, 'message': 'expected 768 dimensions, not 1536'}
2025-03-13 10:01:23 Error inserting chunk: {'code': '22000', 'details': None, 'hint': None, 'message': 'expected 768 dimensions, not 1536'}
2025-03-13 10:01:23 INFO:httpx:HTTP Request: POST https://ogezzwpofwzmchovpahk.supabase.co/rest/v1/site_pages "HTTP/2 400 Bad Request"
2025-03-13 10:01:23 Error inserting chunk: {'code': '22000', 'details': None, 'hint': None, 'message': 'expected 768 dimensions, not 1536'}
2025-03-13 10:01:23 INFO:httpx:HTTP Request: POST https://ogezzwpofwzmchovpahk.supabase.co/rest/v1/site_pages "HTTP/2 400 Bad Request"
2025-03-13 10:01:23 INFO:httpx:HTTP Request: POST https://ogezzwpofwzmchovpahk.supabase.co/rest/v1/site_pages "HTTP/2 400 Bad Request"
2025-03-13 10:01:23 Error inserting chunk: {'code': '22000', 'details': None, 'hint': None, 'message': 'expected 768 dimensions, not 1536'}
2025-03-13 10:01:23 INFO:httpx:HTTP Request: POST https://ogezzwpofwzmchovpahk.supabase.co/rest/v1/site_pages "HTTP/2 400 Bad Request"
2025-03-13 10:01:23 Error inserting chunk: {'code': '22000', 'details': None, 'hint': None, 'message': 'expected 768 dimensions, not 1536'}
2025-03-13 10:01:23 INFO:httpx:HTTP Request: POST https://ogezzwpofwzmchovpahk.supabase.co/rest/v1/site_pages "HTTP/2 400 Bad Request"
2025-03-13 10:01:23 Error inserting chunk: {'code': '22000', 'details': None, 'hint': None, 'message': 'expected 768 dimensions, not 1536'}
2025-03-13 10:01:24 Error inserting chunk: {'code': '22000', 'details': None, 'hint': None, 'message': 'expected 768 dimensions, not 1536'}
2025-03-13 10:01:24 Stored 7 chunks for https://ai.pydantic.dev/examples/weather-agent/

Decided to run it outside the docker container and now i am getting this sort of logs:

2025-03-13 08:41:34.025 Thread 'Thread-9 (run_crawl)': missing ScriptRunContext! This warning can be ignored when running in bare mode.
2025-03-13 08:41:34.025 Thread 'Thread-9 (run_crawl)': missing ScriptRunContext! This warning can be ignored when running in bare mode.
2025-03-13 08:41:34.025 Thread 'Thread-9 (run_crawl)': missing ScriptRunContext! This warning can be ignored when running in bare mode.
2025-03-13 08:41:34.025 Thread 'Thread-9 (run_crawl)': missing ScriptRunContext! This warning can be ignored when running in bare mode.
Error getting title and summary: 'NoneType' object has no attribute 'chat'
Error getting embedding: 'NoneType' object has no attribute 'embeddings'
Error getting title and summary: 'NoneType' object has no attribute 'chat'
Error getting embedding: 'NoneType' object has no attribute 'embeddings'
Error getting title and summary: 'NoneType' object has no attribute 'chat'
Error getting embedding: 'NoneType' object has no attribute 'embeddings'
Processed 3 chunks for https://ai.pydantic.dev/examples/sql-gen/
2025-03-13 08:41:34.026 Thread 'Thread-9 (run_crawl)': missing ScriptRunContext! This warning can be ignored when running in bare mode.
2025-03-13 08:41:34.026 Thread 'Thread-9 (run_crawl)': missing ScriptRunContext! This warning can be ignored when running in bare mode.
2025-03-13 08:41:34.026 Thread 'Thread-9 (run_crawl)': missing ScriptRunContext! This warning can be ignored when running in bare mode.
2025-03-13 08:41:34.026 Thread 'Thread-9 (run_crawl)': missing ScriptRunContext! This warning can be ignored when running in bare mode.

@GEEKNOUTGAMING / @Hajkko / @teamolhuang Could you guys please share:

  • If you are using remote or self-hosted Supabase
  • Which embedding model you are using

And also I updated the environment variable section (quite an overhaul) and did some testing today and was able to scrape and chunk everything with no issues. Maybe one more retest quick too? I’d appreciate it a ton because I do want to get to the bottom of this if it happens for some people!

i am having same issue, i will try different debugs in meanwhile. The problem after seeing the log is openai api is hardcoded for embedding even when i selected other embedding method

I just posted about this in my other thread. I’m having the same issue. Using OpenRouter and Ollama, but errors related to OpenAI API.

@Dupre / @krrahulanand85 I appreciate you guys calling this out - it is fixed now! And then later on this week I’ll make an update so that the frontend doesn’t say the scraping is successful when it isn’t actually

@ColeMedin I reinstalled and cannot get Archon to load at all now:

1 Like