+- Python Forum (https://python-forum.io)
+-- Forum: General (https://python-forum.io/forum-1.html)
+--- Forum: News and Discussions (https://python-forum.io/forum-31.html)
+--- Thread: ubuntu packages in pip (/thread-9912.html)
Pages:
1
2
RE: ubuntu packages in pip - Skaperen - May-14-2018
(May-13-2018, 06:17 AM)wavic Wrote: You want one json file for all of them? I doubt that there is one somewhere. The packages info is constantly changing.yes, it it constantly changing. that's the major reason i want it in one download instead of 138622. i'm afraid that 138622 separate downloads could take longer than a day but one big download could take less than an hour depending on its size. i have about 20 Mbps. that way i might be able to download it every day or every week.
RE: ubuntu packages in pip - wavic - May-14-2018
This is a great opportunity to use asyncio or some other kind of concurrency. It'll be fun.
RE: ubuntu packages in pip - Skaperen - May-17-2018
even so, 138622 downloads is still going to take a long time as my 138622 async i/o descriptors spread over many threads and processes will likely bog down the server. and that's assuming my IP does not get banned.