发布时间:2021-04-23 17:14:35编辑:admin阅读(12121)
scrapy爬取的数据,需要保存到excel中,根据中文标题,将对应的数据写入。
pip3 install openpyxl
修改pipelines.py
# -*- coding: utf-8 -*- # Define your item pipelines here # # Don't forget to add your pipeline to the ITEM_PIPELINES setting # See: https://docs.scrapy.org/en/latest/topics/item-pipeline.html from openpyxl import Workbook class ExcelPipeline(object): def __init__(self): self.wb = Workbook() self.ws = self.wb.active self.ws.append(['姓名', '年龄', '地址') self.file_name = "test.xlsx" def process_item(self, item, spider): line = [item['name'], item['age'], item['address']] self.ws.append(line) self.wb.save(self.file_name) return item def close_spider(self, spider): # 关闭 self.wb.close()
本文参考链接:
https://blog.csdn.net/qq_42336560/article/details/80951401
上一篇: Fiddler的安装与使用
下一篇: Scrapy对接Pyppeteer
48922
48032
38789
35918
30338
27118
26123
20956
20778
19137
648°
728°
699°
691°
666°
632°
729°
814°
920°
1126°