Python Forum

Full Version: Trying to install Scrapy but ...
You're currently viewing a stripped down version of our content. View the full version with proper formatting.
Pages: 1 2
I'm trying to import Scrapy but I am seeing an issue.

My os is Windows 10 Enterprise.

Here is the error
https://www.screencast.com/t/g3aJgIanN

Here you can see I have the right Microsoft Visual C++ 14.0
https://www.screencast.com/t/4p2Rx95XE00D

Any ideas?

Thanks

Buddy
Gohlke get Twisted wheel.
Eg if you have 64-bit Python.
pip install Twisted‑18.7.0‑cp37‑cp37m‑win_amd64.whl
Now again do:
pip install Scrapy
Hey snippsat,

Thanks for the quick reply.

Unfortunately it did not work.

https://www.screencast.com/t/KS9a9LOx2EqI

I did verify that I have the 64bit Python 3.7 installed.

Am I doing something wrong?

Buddy

Hey,

Now I'm seeing this

https://www.screencast.com/t/eDkwVMn0vDNS

BaaDaa BING!

I just tried all of the 64bit version after correcting the filenames and I got it installed with the very last 64bit file.

Now Scrapy is in installed

Thanks for your help!

Buddy
Hmm the first one is Unicode error in filename,don't know you manage to get this.
Do you use cmd?
When download wheel do not make changes/save or something.

In last error you try to install for 2.7.
cp27m means Python 2.7 and you have 3.7
Thanks!

I get the versioning in the naming now. Duh!

But hey ... it's installed now! ;)

Buddy
Dang it!

Just when I thought it would work.

I just tried to start "scrapy shell 'mywebsite'" and it fails with a
ImportError: DLL load failed: %1 is not a valid Win32 application.

Screenshot:
https://www.screencast.com/t/PNyFvDBltieo

Looks like it is related (I think) to an OpenSSL issue with Windows. :(

Buddy
Error:
DLL load failed: %1 is not a valid Win32 ...
Is always a mix in with 32-bit and 64-bit.

Your aware that you have switch to miniconda?
Miniconda is stand alone version and has nothing to with Python(64-bit) python.org,
that i think you installed to in first post.
Yep. Scrapy shell would not load in Py3.7.

So I download and installed miniconda for 3.7 and kept them separate. I did get Scrapy installed to miniconda with out any obvious errors until this one. I had read that it was self-contained so I was hoping that I could at least get the shell working in miniconda.

Buddy
So is anyone running Scrapy in a 64-bit Windows world?

I really would like to get this to work.

Thanks

Buddy
I have 64-bit python 3.7 (from python.org) and 64-bit scrapy on my windows system. Works without any issues.
IIRC, I installed using wheels from https://www.lfd.uci.edu/~gohlke/pythonlibs/
Pages: 1 2