如何在ubuntu上安装scrapy？
我知道所有的scrapy都应该先安装w3lib，所以我先安装了w3lib，但是当我在python ide中导入scrapy时，程序崩溃了。错误：
creating Twisted.egg-info
writing requirements to Twisted.egg-info\requires.txt
writing Twisted.egg-info\PKG-INFO
writing top-level names to Twisted.egg-info\top_level.txt
writing dependency_links to Twisted.egg-info\dependency_links.txt
writing manifest file 'Twisted.egg-info\SOURCES.txt'
warning: manifest_maker: standard file '-c' not found
reading manifest file 'Twisted.egg-info\SOURCES.txt'
writing manifest file 'Twisted.egg-info\SOURCES.txt'
copying twisted\internet\_sigchld.c -> build\lib.win-amd64-2.7\twisted\internet
creating build\lib.win-amd64-2.7\twisted\internet\iocpreactor\iocpsupport
copying twisted\internet/iocpreactor/iocpsupport\iocpsupport.c -> build\lib.win-amd64-2.7\twisted\internet/iocpreactor/i
ocpsupport
copying twisted\internet/iocpreactor/iocpsupport\winsock_pointers.c -> build\lib.win-amd64-2.7\twisted\internet/iocpreac
tor/iocpsupport
copying twisted\python\_epoll.c -> build\lib.win-amd64-2.7\twisted\python
copying twisted\python\_initgroups.c -> build\lib.win-amd64-2.7\twisted\python
copying twisted\python\sendmsg.c -> build\lib.win-amd64-2.7\twisted\python
copying twisted\runner\portmap.c -> build\lib.win-amd64-2.7\twisted\runner
copying twisted\test\raiser.c -> build\lib.win-amd64-2.7\twisted\test
running build_ext怎么了？
回答 3
Stack Overflow用户
发布于 2014-03-21 19:11:52
确保你已经安装了Twisted，pyOpenSSL和pycrypto。这些是我在ubuntu上安装scrapy的步骤。1.安装gcc和lxml：
sudo apt-get install python-dev
sudo apt-get install libevent-dev
sudo apt-get install libxml2 libxml2-dev
apt-get install libxml2-dev libxslt-dev
apt-get install python-lxml 2.安装twisted：
sudo apt-get install python-twisted python-libxml2 python-simplejson
sudo apt-get install build-essential libssl-dev libffi-dev python-dev3.安装pyOpenSSL：
wget http://pypi.python.org/packages/source/p/pyOpenSSL/pyOpenSSL-0.13.tar.gz
tar -zxvf pyOpenSSL-0.13.tar.gz
cd pyOpenSSL-0.13
sudo python setup.py install4.安装pycrypto
wget http://pypi.python.org/packages/source/p/pycrypto/pycrypto-2.5.tar.gz
tar -zxvf pycrypto-2.5.tar.gz
cd pycrypto-2.5
sudo python setup.py install5.安装easy_install：(如果您没有easy_install)
wget http://peak.telecommunity.com/dist/ez_setup.py
python ez_setup.py6.安装w3lib
sudo easy_install -U w3lib7.安装scrapy
sudo easy_install Scrapy如果你想知道更多，请去我的博客。
Stack Overflow用户
发布于 2016-02-25 01:09:44
这是我在ubuntu上安装scrapy的方式：
sudo apt-get update
sudo apt-get install python-pip build-essential python-dev libxslt-dev libxml2-dev
sudo -H pip install Scrapy
scrapy version解决我的问题的最重要的事情是sudo -H pip install Scrapy，特别是-H标志。
我还退出了终端并启动了一个新的终端，以确保所有环境变量都被正确设置
Stack Overflow用户
发布于 2016-01-30 16:13:59
首先安装系统依赖项sudo apt-get install -y \ python-dev python-pip python-setuptools \ libffi-dev libxml2-dev libxslt1-dev \ libtiff5-dev libjpeg62-turbo-dev zlib1g-dev libfreetype6-dev \ liblcms2-dev libwebp-dev tcl8.5-dev tk8.5-dev python-tk
然后在您的requirements.txt中添加以下内容
lxml
pyOpenSSL
Scrapy
Pillow最后，pip安装-r requirements.txt
您还可以查看gist.github.com，以解决最新的依赖关系问题。我正在使用docker在一个单独的容器中设置scrapy deps。我已经为我的需求here创建了一个
https://stackoverflow.com/questions/22556965
复制相似问题