Mar-02-2023, 12:57 PM
In Cython you can release the GIL, but given the application (will be IO intensive rather than CPU intensive) I would agree with @deanhystad that the GIL is unlikely to get in your way. And, releasing the GIL means you have to do the GIL's work. There is no free lunch.
IMHO, your bottlenecks will be getting info from your long term storage and placing that info on the network, not CPU processing. Threads will be "happy" to yield the processor while waiting for those things to happen.
I don't know the details, but a quick Google search tells me that the following popular sites are done in Python:
Youtube
Instagram
Reddit
Spotify
and the list goes on
IMHO, your bottlenecks will be getting info from your long term storage and placing that info on the network, not CPU processing. Threads will be "happy" to yield the processor while waiting for those things to happen.
I don't know the details, but a quick Google search tells me that the following popular sites are done in Python:
Youtube
Spotify
and the list goes on