sorry for my bad English or wrong forum,
because my PC power is too high just for a downloader,
I like to buy a device, probably [rasbery pi] for my downloader device,
the package I use:
from bs4 import BeautifulSoup
from selenium import webdriver
import re
import concurrent.futures
from tqdm import tqdm
import shutil
import requests
import glob
import os
import subprocess
and device requirements:
1. can run the above package,
2. can download files with sizes above than 4GB
3. have store 100+ GB of data(probably using an SD card or USB stick)
any clue what device I must use?
thank you for reading, have a nice day
Why you need Python for downloading stuff?
It is extra layer of complexity actually - and extra requirements on hardware. Of course Python is not as fat as Java, but still...
On the other hand, what is your goal? Why this "downloader" should be physical device at all?
(Jun-25-2024, 09:22 AM)kucingkembar Wrote: [ -> ]and device requirements:
1. can run the above package,
2. can download files with sizes above than 4GB
3. have store 100+ GB of data(probably using an SD card or USB stick)
any clue what device I must use?
An Intel Pentium I with 100 MHz could do this task with Python 3. If the machine does not have enough memory, you even could use Micropython. To be realistic, 128 MiB RAM should be available.
You could use a RPi0 W or a RPi0 W2 with an attached USB-SSD/HDD to do this task.
The maximum file size is defined by the file system which is used.
Use ext4 or something else. Avoid the use of FAT. The Fat file system single file site limit is 4 GiB.
(Jun-25-2024, 08:20 PM)rodiongork Wrote: [ -> ]Why you need Python for downloading stuff?
It is extra layer of complexity actually - and extra requirements on hardware. Of course Python is not as fat as Java, but still...
On the other hand, what is your goal? Why this "downloader" should be physical device at all?
i need to refresh download link, if you use software like
IDM
you know some link need to refresh to use
why i need this downloader?
in simple way : more power mean more electrical bills
(Jun-25-2024, 08:41 PM)DeaD_EyE Wrote: [ -> ] (Jun-25-2024, 09:22 AM)kucingkembar Wrote: [ -> ]and device requirements:
1. can run the above package,
2. can download files with sizes above than 4GB
3. have store 100+ GB of data(probably using an SD card or USB stick)
any clue what device I must use?
An Intel Pentium I with 100 MHz could do this task with Python 3. If the machine does not have enough memory, you even could use Micropython. To be realistic, 128 MiB RAM should be available.
You could use a RPi0 W or a RPi0 W2 with an attached USB-SSD/HDD to do this task.
The maximum file size is defined by the file system which is used.
Use ext4 or something else. Avoid the use of FAT. The Fat file system single file site limit is 4 GiB.
i don't think this "Micropython" will able to run selenium
can Raspberry Pi run selenium?
not i need selenium, the request.get(url) cant do
thank you for the reply
A Raspberry Pi can run selenium.
A RPi Pico of course not. It's too big, written in Java and there is no Port for Micropython.
(Jun-27-2024, 12:33 PM)DeaD_EyE Wrote: [ -> ]A Raspberry Pi can run selenium.
A RPi Pico of course not. It's too big, written in Java and there is no Port for Micropython.
thank you,
i will give you a reputation point