Aug-26-2019, 05:49 AM
Your loop runs 30 times, once for each number between 10 and 40.
Every number 10-19 gets redirected to 10, 20-29 get redirected to 20, and 30-39 get redirected to 30.
This means you scrape each of those pages 10 times, geting 10 duplicates for each review.
Maybe you meant for your loop to be
Every number 10-19 gets redirected to 10, 20-29 get redirected to 20, and 30-39 get redirected to 30.
This means you scrape each of those pages 10 times, geting 10 duplicates for each review.
Maybe you meant for your loop to be
for offset in range(10, 40, 10): instead?