我正在使用以下代码从工作站点抓取数据并使用 BeautifulSoup 将其写入 csv 文件。我看到抓取代码有效,因为当我打印提取的文件时,它似乎没问题。但是,我无法将抓取的数据打印到 csv 文件中。创建了一个 csv 文件,但在每一列中,只有一些字母,如 a、b、c,而不是描述职位、薪水等的完整单词。谁能帮我解决这个问题?
import requests
import csv
r=requests.get("https://www.reed.co.uk/jobs/accountancy-jobs")
r.content
soup=BeautifulSoup(r.content)
#print(soup.prettify())
soup.find_all("article")
jobs=soup.find_all("article")
for job in jobs:
title=job.h3.text
posterline=job.find("div", attrs={"class":"posted-by"})
poster=posterline.find("a").text
postdate=job.find('div',{'class': 'posted-by'}).next_element
description=job.find("div", attrs={"class":"description"})
metadata=job.find("div", attrs={"class":"metadata"})
metadata=job.find("div", attrs={"class":"metadata"})
salary=metadata.find("li", attrs={"class": "salary"})
salary=salary.text
time=metadata.find("li", attrs={"class": "time"})
datas=(title, salary, time, postdate, poster)
with open('reeddata.csv', 'w', newline='') as file:
writer = csv.writer(file)
headers = ['Title','Salary','Time', 'Postdate','Poster']
writer.writerow(headers)
for data in datas:
writer.writerow(data)
尝试使用下面的脚本来获取所需的内容并相应地将其写入 csv 文件中:
import requests
from bs4 import BeautifulSoup
import csv
r = requests.get("https://www.reed.co.uk/jobs/accountancy-jobs")
soup = BeautifulSoup(r.content,"html.parser")
with open('reeddata.csv', 'w', newline='') as file:
writer = csv.writer(file)
writer.writerow(['Title','Salary','Time', 'Postdate','Poster'])
for job in soup.find_all("article"):
title = job.find("h3",class_="title").find("a",href=True).get_text(strip=True)
poster = job.find("div", class_="posted-by").find("a").get_text(strip=True)
postdate = job.find('div',class_='posted-by').next_element.strip()
salary = job.find("div",class_="metadata").find("li",class_="salary").get_text(strip=True)
time = job.find("div",class_="metadata").find("li",class_="time").get_text(strip=True)
writer.writerow([title, salary, time, postdate, poster])
本文收集自互联网,转载请注明来源。
如有侵权,请联系 [email protected] 删除。
我来说两句