Running customer service demo based on instructuions - get an error

[jcooper212]

The process exits after hitting this ERROR abruptly....

[06/09/2025 07:21:39] {build_rag.py:75} INFO - crawled sources: ['https://www.richtechrobotics.com', 'https://www.richtechrobotics.com/company', 'https://www.richtechrobotics.com/contact', 'https://www.richtechrobotics.com/resources', 'https://www.richtechrobotics.com/resources/autonomous-mobile-robots', 'https://www.richtechrobotics.com/resources/first-humanoid-drink-robot-in-rockford-il', 'https://www.richtechrobotics.com/resources/how-tariffs-affect-robotics', 'https://www.richtechrobotics.com/resources/humanoid-bartender-at-mlb', 'https://www.richtechrobotics.com/resources/new-headquarters', 'https://www.richtechrobotics.com/resources/scorpion-at-jpm-health-conference', 'https://www.richtechrobotics.com/resources/unlocking-human-potential', 'https://www.richtechrobotics.com/robot-rentals', 'https://www.richtechrobotics.com/scorpion%5C', 'https://www.richtechrobotics.com/solutions', 'https://www.richtechrobotics.com/solutions?category=cleaning', 'https://www.richtechrobotics.com/solutions?category=delivery', 'https://www.richtechrobotics.com/solutions?category=production', 'https://www.richtechrobotics.com/technology', 'https://www.richtechrobotics.com/terms-and-conditions', 'https://www.richtechrobotics.com/titan']
[06/09/2025 07:21:39] {loader.py:577} ERROR - Skip source: https://www.richtechrobotics.com/resources/scorpion-at-jpm-health-conference because of error or no content

[sumansuhag]

Hey jcooper212,

Thanks for bringing this up. It's definitely annoying when the demo stops suddenly, especially with just a Skip source message.

You're spot on about the sudden exit. Normally, a Skip source means the system should deal with errors on its own and keep going. If it’s crashing, that might mean this ERROR message is just a sign of something else that’s causing it to stop.

Here’s what you can do:

1. Check the URL: Can you try opening https://www.richtechrobotics.com/resources/scorpion-at-jpm-health-conference in your browser? See if the page loads and has content. Sometimes, the page could be down, moved (404), or contains stuff that the crawler can't read, like images or complex scripts.

2. Look for a Stack Trace: Is there any other log output or a Python stack trace before or after this ERROR line? That might help pinpoint what’s making it crash.

3. Isolate the Problematic URL: Can you comment out or remove https://www.richtechrobotics.com/resources/scorpion-at-jpm-health-conference from your sources temporarily? Run the demo again and see if it gets past that point. If it does, then that URL is likely the issue.

4. Check loader.py Error Handling (if you can): If you have the loader.py code, take a look at line 577 and the try-except around it. That might show what exception is being caught (or missed) that leads to the crash.

Figuring out why that source is causing problems and why the process crashes is key to fixing this.

Let me know what you find!