Trying to install Scrapy but ...

[ubotbuddy]

I'm trying to import Scrapy but I am seeing an issue.

My os is Windows 10 Enterprise.

Here is the error
https://www.screencast.com/t/g3aJgIanN

Here you can see I have the right Microsoft Visual C++ 14.0
https://www.screencast.com/t/4p2Rx95XE00D

Any ideas?

Thanks

Buddy

[snippsat]

Gohlke get Twisted wheel.
Eg if you have 64-bit Python.

pip install Twisted‑18.7.0‑cp37‑cp37m‑win_amd64.whl

Now again do:

pip install Scrapy

[ubotbuddy]

Hey snippsat,

Thanks for the quick reply.

Unfortunately it did not work.

https://www.screencast.com/t/KS9a9LOx2EqI

I did verify that I have the 64bit Python 3.7 installed.

Am I doing something wrong?

Buddy

---

Hey,

Now I'm seeing this

https://www.screencast.com/t/eDkwVMn0vDNS

---

BaaDaa BING!

I just tried all of the 64bit version after correcting the filenames and I got it installed with the very last 64bit file.

Now Scrapy is in installed

Thanks for your help!

Buddy

[snippsat]

Hmm the first one is Unicode error in filename,don't know you manage to get this.
Do you use cmd?
When download wheel do not make changes/save or something.

In last error you try to install for 2.7.
cp27m means Python 2.7 and you have 3.7

[ubotbuddy]

Thanks!

I get the versioning in the naming now. Duh!

But hey ... it's installed now! ;)

Buddy

[ubotbuddy]

Dang it!

Just when I thought it would work.

I just tried to start "scrapy shell 'mywebsite'" and it fails with a
ImportError: DLL load failed: %1 is not a valid Win32 application.

Screenshot:
https://www.screencast.com/t/PNyFvDBltieo

Looks like it is related (I think) to an OpenSSL issue with Windows. :(

Buddy

[snippsat]

Error:
DLL load failed: %1 is not a valid Win32 ...

Is always a mix in with 32-bit and 64-bit.

Your aware that you have switch to miniconda?
Miniconda is stand alone version and has nothing to with Python(64-bit) python.org,
that i think you installed to in first post.

[ubotbuddy]

Yep. Scrapy shell would not load in Py3.7.

So I download and installed miniconda for 3.7 and kept them separate. I did get Scrapy installed to miniconda with out any obvious errors until this one. I had read that it was self-contained so I was hoping that I could at least get the shell working in miniconda.

Buddy

[ubotbuddy]

So is anyone running Scrapy in a 64-bit Windows world?

I really would like to get this to work.

Thanks

Buddy

[stranac]

I have 64-bit python 3.7 (from python.org) and 64-bit scrapy on my windows system. Works without any issues.
IIRC, I installed using wheels from https://www.lfd.uci.edu/~gohlke/pythonlibs/