Replies: 2 comments
-
| I think there should be a node that just saves the data scraped either to a vector store or to a local directory. Sometimes the need for the scraping is not just to generate answers. | 
Beta Was this translation helpful? Give feedback.
                  
                    0 replies
                  
                
            -
| There is the rag node | 
Beta Was this translation helpful? Give feedback.
                  
                    0 replies
                  
                
            
  
    Sign up for free
    to join this conversation on GitHub.
    Already have an account?
    Sign in to comment
  
        
    
Uh oh!
There was an error while loading. Please reload this page.
-
Currently, FetchNode uses the AsyncChromiumLoader to load the page and the returned content is used further.
I think it would be good if we invested more effort into getting more structured and detailed webpage content:
I mean getting a dict out of the page that includes
Beta Was this translation helpful? Give feedback.
All reactions