Edabit Scraper Note If you only want the output of the scrapping, you can get the json here, in the assets section. Steps I followed Here are the detailed steps of how I accomplished scraping the Edabit site. Step 1 - Get Indexes Step 2 - Process Raw Results Step 3 - Get Challenges Details Step 4 - Process Raw Challenge Data Response Step 5 - Upload Challenges To Mongo