@@ -24,9 +24,21 @@ Just say which information you want to extract and the library will do it for yo
2424 <img src =" https://raw.githubusercontent.com/VinciGit00/Scrapegraph-ai/main/docs/assets/sgai-hero.png " alt =" ScrapeGraphAI Hero " style =" width : 100% ;" >
2525</p >
2626
27- ## News 📰
27+ ## 🔗 ScrapeGraph API & SDKs
28+ If you are looking for a quick solution to integrate ScrapeGraph in your system, check out our powerful API [ here!] ( https://dashboard.scrapegraphai.com/login )
2829
29- - ScrapegraphAI has now his APIs! Check it out [ here] ( https://scrapegraphai.com ) !
30+ <p align =" center " >
31+ <img src =" https://raw.githubusercontent.com/VinciGit00/Scrapegraph-ai/main/docs/assets/api-banner.png " alt =" ScrapeGraph API Banner " style =" width : 100% ;" >
32+ </p >
33+
34+ We offer SDKs in both Python and Node.js, making it easy to integrate into your projects. Check them out below:
35+
36+ | SDK | Language | GitHub Link |
37+ | -----------| ----------| -----------------------------------------------------------------------------|
38+ | Python SDK | Python | [ scrapegraph-py] ( https://github.com/ScrapeGraphAI/scrapegraph-sdk/tree/main/scrapegraph-py ) |
39+ | Node.js SDK | Node.js | [ scrapegraph-js] ( https://github.com/ScrapeGraphAI/scrapegraph-sdk/tree/main/scrapegraph-js ) |
40+
41+ The Official API Documentation can be found [ here] ( https://docs.scrapegraphai.com/ ) .
3042
3143## 🚀 Quick install
3244
@@ -87,8 +99,8 @@ graph_config = {
8799
88100# Create the SmartScraperGraph instance
89101smart_scraper_graph = SmartScraperGraph(
90- prompt = " Find some information about what does the company do, the name and a contact email. " ,
91- source = " https://scrapegraphai. com/ " ,
102+ prompt = " Extract me all the news from the website " ,
103+ source = " https://www.wired. com" ,
92104 config = graph_config
93105)
94106
@@ -100,10 +112,20 @@ print(json.dumps(result, indent=4))
100112The output will be a dictionary like the following:
101113
102114``` python
103- {
104- " company" : " ScrapeGraphAI" ,
105- " name" : " ScrapeGraphAI Extracting content from websites and local documents using LLM" ,
106- " contact_email" : " contact@scrapegraphai.com"
115+ " result" : {
116+ " news" : [
117+ {
118+ " title" : " The New Jersey Drone Mystery May Not Actually Be That Mysterious" ,
119+ " link" : " https://www.wired.com/story/new-jersey-drone-mystery-maybe-not-drones/" ,
120+ " author" : " Lily Hay Newman"
121+ },
122+ {
123+ " title" : " Former ByteDance Intern Accused of Sabotage Among Winners of Prestigious AI Award" ,
124+ " link" : " https://www.wired.com/story/bytedance-intern-best-paper-neurips/" ,
125+ " author" : " Louise Matsakis"
126+ },
127+ ...
128+ ]
107129}
108130```
109131There are other pipelines that can be used to extract information from multiple pages, generate Python scripts, or even generate audio files.
@@ -135,8 +157,7 @@ Try it directly on the web using Google Colab:
135157## 📖 Documentation
136158
137159The documentation for ScrapeGraphAI can be found [ here] ( https://scrapegraph-ai.readthedocs.io/en/latest/ ) .
138-
139- Check out also the Docusaurus [ here] ( https://scrapegraph-doc.onrender.com/ ) .
160+ Check out also the Docusaurus [ here] ( https://docs-oss.scrapegraphai.com/ ) .
140161
141162## 🏆 Sponsors
142163<div style =" text-align : center ;" >
@@ -204,4 +225,4 @@ ScrapeGraphAI is licensed under the MIT License. See the [LICENSE](https://githu
204225- We would like to thank all the contributors to the project and the open-source community for their support.
205226- ScrapeGraphAI is meant to be used for data exploration and research purposes only. We are not responsible for any misuse of the library.
206227
207- Made with ❤️ by [ ScrapeGraph AI] ( https://scrapegraphai.com )
228+ Made with ❤️ by [ ScrapeGraph AI] ( https://scrapegraphai.com )
0 commit comments