我正在尝试获取这些脚本标签中的数据,但似乎无法将其转换为json,以便在阅读后可以对其进行解析。我感兴趣的数据是名称,图像,sku和价格。
HTML:
<script type="application/ld+json">
{
"@context": "http://schema.org/",
"@type": "Product",
"name": "Key Pouch",
"image": "https://us.louisvuitton.com/images/is/image/lv/1/PP_VP_L/louis-vuitton-key-pouch-monogram-gifts-for-women--M62650_PM2_Front view.jpg",
"description": "The Key Pouch in iconic Monogram canvas is a playful yet practical accessory that can carry coins, cards, folded bills and other small items, in addition to keys. Secured with an LV-engraved zip, it can be hooked onto the D-ring inside most Louis Vuitton bags, or used as a bag or belt charm.",
"sku": "M62650",
"brand": {
"@type": "Thing",
"name": "LOUIS VUITTON"
},
"offers": {
"@type": "Offer",
"url" : "https://us.louisvuitton.com/eng-us/products/key-pouch-monogram-000941",
"priceCurrency": "USD",
"price": "215.00",
"availability": "http://schema.org/OutOfStock",
"seller": {
"@type": "Organization",
"name": "LOUIS VUITTON"
}
}
}
</script>
码:
from bs4 import BeautifulSoup as soup
import requests
import json
HEADERS = {'User-Agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko)'}
req = Request("https://us.louisvuitton.com/eng-us/products/key-pouch-monogram-000941", headers= HEADERS)
webpage = urlopen(req).read()
page_soup = soup(webpage, "html.parser")
data = json.loads(page_soup.find('script', type='application/ld+json').text)
print(data)
输出量
raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)
任何帮助,将不胜感激。
从位于https://www.crummy.com/software/BeautifulSoup/bs4/doc/#get-text的文档中
从Beautiful Soup版本4.9.0开始,使用lxml或html.parser时,<script>,<style>和<template>标记的内容不被视为“文本”,因为这些标记不属于“文本”页面的可见内容。
因此,请使用html5lib。一个有效的解决方案如下:
from bs4 import BeautifulSoup as soup
import requests
import json
HEADERS = {'User-Agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko)'}
req = requests.get("https://us.louisvuitton.com/eng-us/products/key-pouch-monogram-000941", headers= HEADERS)
page_soup = soup(req.text, "html5lib")
data = json.loads(page_soup.find('script', type='application/ld+json').text)
print(data)
输出:
{'@context': 'http://schema.org/', '@type': 'Product', 'name': 'Key Pouch', 'image': 'https://us.louisvuitton.com/images/is/image/lv/1/PP_VP_L/louis-vuitton-key-pouch-monogram-gifts-for-women--M62650_PM2_Front view.jpg', 'description': 'The Key Pouch in iconic Monogram canvas is a playful yet practical accessory that can carry coins, cards, folded bills and other small items, in addition to keys. Secured with an LV-engraved zip, it can be hooked onto the D-ring inside most Louis Vuitton bags, or used as a bag or belt charm.', 'sku': 'M62650', 'brand': {'@type': 'Thing', 'name': 'LOUIS VUITTON'}, 'offers': {'@type': 'Offer', 'url': 'https://us.louisvuitton.com/eng-us/products/key-pouch-monogram-000941', 'priceCurrency': 'USD', 'price': '215.00', 'availability': 'http://schema.org/OutOfStock', 'seller': {'@type': 'Organization', 'name': 'LOUIS VUITTON'}}}
本文收集自互联网,转载请注明来源。
如有侵权,请联系 [email protected] 删除。
我来说两句