前言
现在的招聘网站很多,比如:拉勾网、Boss直聘、智联招聘、前程无忧等。那么多的网站,如何才能在众多招聘信息中找到符合自己的,或者说工作的相关要求。
受难目标
地址
https://search.51job.com/list/010000%252c020000%252c030200%252c040000,000000,0000,00,9,99,python,2,{}.html
PS:如有需要Python学习资料的小伙伴可以加下方的群去找免费管理员领取
可以免费领取源码、项目实战视频、PDF文件等
部分爬虫代码
导入工具
import requests
import parsel
import re
import json
import time
请求网页,爬取数据
for page in range(1, 11):
url = 'https://search.51job.com/list/010000%252c020000%252c030200%252c040000,000000,0000,00,9,99,python,2,{}.html'.format(page)
params = {
'lang': 'c',
'postchannel': '0000',
'workyear': '99',
'cotype': '99',
'degreefrom': '99',
'jobterm': '99',
'companysize': '99',
'ord_field': '0',
'dibiaoid': '0',
'line': '',
'welfare': '',
}
cookies = {
'Cookie': 'guid=b672753be2ff4b5c3694a1ff805e8c1b; 51job=cenglish%3D0%26%7C%26; nsearch=jobarea%3D%26%7C%26ord_field%3D%26%7C%26recentSearch0%3D%26%7C%26recentSearch1%3D%26%7C%26recentSearch2%3D%26%7C%26recentSearch3%3D%26%7C%26recentSearch4%3D%26%7C%26collapse_expansion%3D; search=jobarea%7E%60190200%7C%21ord_field%7E%600%7C%21recentSearch0%7E%60190200%A1%FB%A1%FA000000%A1%FB%A1%FA0000%A1%FB%A1%FA00%A1%FB%A1%FA99%A1%FB%A1%FA%A1%FB%A1%FA99%A1%FB%A1%FA99%A1%FB%A1%FA99%A1%FB%A1%FA99%A1%FB%A1%FA9%A1%FB%A1%FA99%A1%FB%A1%FA%A1%FB%A1%FA0%A1%FB%A1%FApython%A1%FB%A1%FA2%A1%FB%A1%FA1%7C%21'
}
headers = {
'Accept': 'text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.9',
'Host': 'search.51job.com',
'Referer': 'https://search.51job.com/list/190200,000000,0000,00,9,99,python,2,1.html?lang=c&postchannel=0000&workyear=99&cotype=99°reefrom=99&jobterm=99&companysize=99&ord_field=0&dibiaoid=0&line=&welfare=',
'User-Agent': 'Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/84.0.4147.105 Safari/537.36',
}
response = requests.get(url=url, params=params, headers=headers, cookies=cookies)
response.encoding = response.apparent_encoding
# 想要完整源码的同学可以关注我的公众号:松鼠爱吃饼干
# 回复“51job”即可免费获取
运行代码,效果如下
TXT格式
CSV格式
我们还可以用词云图来现实招聘的需求
部分词云代码
import jieba
import wordcloud
import imageio
import re
py = imageio.imread("python.png")
f = open('python招聘信息.txt', encoding='utf-8')
re_txt = f.read()
# result = re.findall(r'[a-zA-Z]+', re_txt)
# txt = ' '.join(result)
# jiabe 分词 分割词汇
txt_list = jieba.lcut(re_txt)
string = ' '.join(txt_list)
# 给词云输入文字
wc.generate(string)
# 词云图保存图片地址
wc.to_file(r'python招聘信息.png')
# 想要完整源码的同学可以关注我的公众号:松鼠爱吃饼干
# 回复“51job词云”即可免费获取
从词云图看来,需求还蛮多的
下次想看爬什么网站,可以发在评论区(太难的就算了,我还是个小菜鸡)