Python Forum
Trying to install Scrapy but ... - Printable Version

+- Python Forum (https://python-forum.io)
+-- Forum: Python Coding (https://python-forum.io/forum-7.html)
+--- Forum: Web Scraping & Web Development (https://python-forum.io/forum-13.html)
+--- Thread: Trying to install Scrapy but ... (/thread-12861.html)

Pages: 1 2

Trying to install Scrapy but ... - ubotbuddy - Sep-16-2018

I'm trying to import Scrapy but I am seeing an issue.

My os is Windows 10 Enterprise.

Here is the error
https://www.screencast.com/t/g3aJgIanN

Here you can see I have the right Microsoft Visual C++ 14.0
https://www.screencast.com/t/4p2Rx95XE00D

Any ideas?

Thanks

Buddy

RE: Trying to install Scrapy but ... - snippsat - Sep-16-2018

Gohlke get Twisted wheel.
Eg if you have 64-bit Python.
pip install Twisted‑18.7.0‑cp37‑cp37m‑win_amd64.whl
Now again do:
pip install Scrapy


RE: Trying to install Scrapy but ... - ubotbuddy - Sep-16-2018

Hey snippsat,

Thanks for the quick reply.

Unfortunately it did not work.

https://www.screencast.com/t/KS9a9LOx2EqI

I did verify that I have the 64bit Python 3.7 installed.

Am I doing something wrong?

Buddy
Hey,

Now I'm seeing this

https://www.screencast.com/t/eDkwVMn0vDNS
BaaDaa BING!

I just tried all of the 64bit version after correcting the filenames and I got it installed with the very last 64bit file.

Now Scrapy is in installed

Thanks for your help!

Buddy

RE: Trying to install Scrapy but ... - snippsat - Sep-16-2018

Hmm the first one is Unicode error in filename,don't know you manage to get this.
Do you use cmd?
When download wheel do not make changes/save or something.

In last error you try to install for 2.7.
cp27m means Python 2.7 and you have 3.7

RE: Trying to install Scrapy but ... - ubotbuddy - Sep-16-2018

Thanks!

I get the versioning in the naming now. Duh!

But hey ... it's installed now! ;)

Buddy

RE: Trying to install Scrapy but ... - ubotbuddy - Sep-16-2018

Dang it!

Just when I thought it would work.

I just tried to start "scrapy shell 'mywebsite'" and it fails with a
ImportError: DLL load failed: %1 is not a valid Win32 application.

Screenshot:
https://www.screencast.com/t/PNyFvDBltieo

Looks like it is related (I think) to an OpenSSL issue with Windows. :(

Buddy

RE: Trying to install Scrapy but ... - snippsat - Sep-16-2018 

Error:
DLL load failed: %1 is not a valid Win32 ...
Is always a mix in with 32-bit and 64-bit.

Your aware that you have switch to miniconda?
Miniconda is stand alone version and has nothing to with Python(64-bit) python.org,
that i think you installed to in first post.

RE: Trying to install Scrapy but ... - ubotbuddy - Sep-16-2018

Yep. Scrapy shell would not load in Py3.7.

So I download and installed miniconda for 3.7 and kept them separate. I did get Scrapy installed to miniconda with out any obvious errors until this one. I had read that it was self-contained so I was hoping that I could at least get the shell working in miniconda.

Buddy

RE: Trying to install Scrapy but ... - ubotbuddy - Sep-19-2018

So is anyone running Scrapy in a 64-bit Windows world?

I really would like to get this to work.

Thanks

Buddy

RE: Trying to install Scrapy but ... - stranac - Sep-19-2018

I have 64-bit python 3.7 (from python.org) and 64-bit scrapy on my windows system. Works without any issues.
IIRC, I installed using wheels from https://www.lfd.uci.edu/~gohlke/pythonlibs/