我想抓取网站https://www.airvistara.com/fly/flightschedule网站表的第2列和第3列，我使用的代码是
import bs4 as bs
from urllib2 import urlopen
sauce=urlopen('https://www.airvistara.com/fly/flightschedule').read()
soup=bs.BeautifulSoup(sauce,'lxml')
table=soup.table
table_body=table.find('tbody')
table_rows=table_body.find_all('tr')
for tr in table_rows:
td=tr.find_all('td')
row=[i.text for i in td]
print row
但是我找不到想要的解决方案
您尝试解析的内容是通过加载的ajax，不适用于bs。
这是在python字典上获取出站航班的工作代码：
import json
import requests
post_fields = {"flightDate":"22/04/2017"}
headers = {'content-type': 'application/json'}
url = 'https://www.airvistara.com/fly/getFlightschedule'
json_response = requests.post(url, data=json.dumps(post_fields), headers=headers).text
decoded_json = json.loads(json_response)
print decoded_json
输出：
{u'flightSchedule': [{u'effectiveFrom': u'19-APR-2017', u'flightCode': u'UK 0946', u'baseFareL1': 0, u'flightDate': u'Saturday, 28 October 2017',...
要获取每个航班的详细信息，可以使用：
for flight in decoded_json['flightSchedule']:
print flight['effectiveFrom']
print flight['flightCode']
print flight['baseFareL1']
print flight['flightDate']
print flight['daysOfOperation']
print flight['arrivalStation']
print flight['departureStation']
print flight['via']
print flight['scheduledArrivalTime']
print flight['departureCityName']
print flight['effectiveTo']
print flight['arrivalCityName']
print flight['scheduledDepartureTime']
它将输出如下内容：
19-APR-2017
UK 0946
0
Saturday, 28 October 2017
Daily
DEL
AMD
-
10:25
Ahmedabad
28-OCT-2017
New Delhi
08:45
注意：
1-如果需要指定arrivalStation或departureStation，请使用：
post_fields = {"flightDate":"22/04/2017","arrivalStation":"AIRPORTCODE","departureStation":"AIRPORTCODE"}
本文收集自互联网，转载请注明来源。
如有侵权，请联系 [email protected] 删除。
我来说两句