通过单个页面中的刮痕下载多幅图像
通过单个页面中的刮痕下载多幅图像
提问于 2014-11-11 06:11:02
嗨，这是我的代码，以刮刮多个图像，但它唯一的残废一个图像。
你能告诉我我哪里错了吗？
def parse(self, response):
item = DmozItem()
image_urls = response.xpath('//div[@class="overhid"]//img/@src').extract()
item['image_urls'] = [ x for x in image_urls]
return item回答 1
Stack Overflow用户
回答已采纳
发布于 2014-11-11 06:32:37
问题是其他图像具有lazysrc属性，而不是src。获取这两个属性：
$ scrapy shell http://www.snapdeal.com/product/xolo-win-q900s-black/770747222
>>> for image in response.xpath('//div[@class="overhid"]//img'):
... print image.xpath('@src | @lazysrc').extract()[0]
...
http://n4.sdlcdn.com/imgs/a/k/9/small/Xolo-WIN-Q900s-Black-SDL051074306-1-9dbe9.jpg
http://n1.sdlcdn.com/imgs/a/k/9/small/Xolo-WIN-Q900s-Black-SDL051074306-2-1c8f7.jpg
http://n3.sdlcdn.com/imgs/a/k/9/small/Xolo-WIN-Q900s-Black-SDL051074306-3-09694.jpg
http://n4.sdlcdn.com/imgs/a/k/9/small/Xolo-WIN-Q900s-Black-SDL051074306-4-af867.jpg
http://n4.sdlcdn.com/imgs/a/k/9/small/Xolo-WIN-Q900s-Black-SDL051074306-5-73467.jpg
http://n2.sdlcdn.com/imgs/a/k/9/small/Xolo-WIN-Q900s-Black-SDL051074306-6-5c97f.jpg下面是您应该如何更改parse()回调：
def parse(self, response):
item = DmozItem()
images = response.xpath('//div[@class="overhid"]//img')
item['image_urls'] = [image.xpath('@src | @lazysrc').extract()[0]
for image in images]
return item页面原文内容由Stack Overflow提供。腾讯云小微IT领域专用引擎提供翻译支持
原文链接：
https://stackoverflow.com/questions/26858686
复制相关文章
相似问题
腾讯云开发者
