CsvItemExporter有一个默认为逗号(=','
)的选项join_multivalued
。
如何在我的scrapy项目中将其更改为另一个char?
发布于 2015-01-23 03:57:18
在您的自定义CSVItemExporter
中这样设置:
from scrapy.conf import settings
from scrapy.contrib.exporter import CsvItemExporter
class CSVkwItemExporter(CsvItemExporter):
def __init__(self, *args, **kwargs):
kwargs['fields_to_export'] = settings.getlist('EXPORT_FIELDS') or None
kwargs['encoding'] = settings.get('EXPORT_ENCODING', 'utf-8')
super(CSVkwItemExporter, self).__init__(*args, **kwargs)
self._join_multivalued = settings.get('MY_CSV_DELIMITER', ',')
其中,MY_CSV_DELIMITER
是分隔符的示例设置。
发布于 2018-08-06 06:15:59
Scrapy版本1.5.0
your_scrapy_project/exporters.py
from scrapy.conf import settings
from scrapy.exporters import CsvItemExporter
class MyCsvItemExporter(CsvItemExporter):
def __init__(self, *args, **kwargs):
delimiter = settings.get('CSV_DELIMITER', ';')
kwargs['delimiter'] = delimiter
super(MyCsvItemExporter, self).__init__(*args, **kwargs)
your_scrapy_project/settings.py
FEED_EXPORT_ENCODING = 'utf-8'
FEED_EXPORTERS = {
'csv': 'your_scrapy_project.exporters.MyCsvItemExporter',
}
CSV_DELIMITER = ';'
https://stackoverflow.com/questions/28089977
复制相似问题