Skip to content

Website scrapper in C with a specific config file (see the sconf example) and without any external library except for cURL

License

Notifications You must be signed in to change notification settings

Daklyan/sCrapper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

34 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Website sCrapper in C


Example of a sconf file

=
{name -> My website} #Correspond to the name of your action
{url -> value} #Url of the website
+
{option1 -> value}
{option2 -> value}
{option3 -> value}

=
{name -> My second website} #Correspond to the name of your second action
{url -> https://wowSuchWebsite.com/veryIncredible}		    #URL of the website
+
{max-depth -> 12}
{versionning -> on}

==
{name -> My great task}
{second -> 10} #Start 2 HTTP request every 10s
+
(My website, My second website)

== #Start the HTTP request every 2min and 10s
{name -> My easy task}
{minute -> 2}
{second -> 10}
+
(My website)

==
#Start the HTTP request every 6 hours
{name -> My easy task}
{hour -> 6}
+
(My second website)

About

Website scrapper in C with a specific config file (see the sconf example) and without any external library except for cURL

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published