用python爬了厦门人才网的.net岗位

为了看看.net的就业行情怎么样,用python爬取了厦门人才网.net岗位的信息,话不多说上代码,python没学多久,如果有什么不妥请指正

创新互联建站专注于企业网络营销推广、网站重做改版、和龙网站定制设计、自适应品牌网站建设、HTML5商城网站建设、集团公司官网建设、成都外贸网站建设、高端网站制作、响应式网页设计等建站业务,价格优惠性价比高,为和龙等各大城市提供网站开发制作服务。

import requests
from bs4 import BeautifulSoup
page = 1;
def loop(page):
    url = "https://www.xmrc.com.cn/net/info/resultg.aspx?a=a&g=g&jobtype=&releaseTime=365&searchtype=1&keyword=.net&sortby=updatetime&ascdesc=Desc&PageIndex=%s"%page;
    response = requests.get(url)
    soup = BeautifulSoup(response.text, 'html.parser')

    allJob = soup.select(".a4.js_companyName");

    companys = []
    Others = []
    for x in range(0,len(allJob)):
            job = allJob[x].get_text().strip()
            print(job);
            other = allJob[x].parent.findPrevious("td").get_text().strip() + ","+  allJob[x].parent.findNext("td").get_text().strip() + "," + allJob[x].parent.findNext("td").findNext("td").get_text().strip();
            print(other);
            companys.append(job)
            Others.append(other)
    return companys, Others;

for x in range(0,20):
    companys,Others = loop(x)
    with open('company.txt', 'a', encoding='utf-8') as f:
        for x in range(0,len(companys)):
            f.write(str(companys[x] + "," + Others[x]) + '\n')

分享标题:用python爬了厦门人才网的.net岗位
网站链接:http://pwwzsj.com/article/jeogpp.html