Oct-24-2018, 06:55 AM
Python 3.7.1
I will write program which connection to internet- resource for getting information. Scraping will take about 1 week, and I can create all tasks in beginning of scrapping (about 1 000 000 query). But I want limit quantity of parallel tasks that the internet- site does not ban me.
How I can use asyncio library with the possibility of restrictions on the number of competing coroutines?
I will write program which connection to internet- resource for getting information. Scraping will take about 1 week, and I can create all tasks in beginning of scrapping (about 1 000 000 query). But I want limit quantity of parallel tasks that the internet- site does not ban me.
How I can use asyncio library with the possibility of restrictions on the number of competing coroutines?