Scraping data - attributes from a web page
The_elevator
Hello i am new in web scraping and i have a problem. I want to scrape data from this html code: 
I want to have the data that belongs inside the
<tr> .. </tr>
tag.
My code is shown as below:
from bs4 import BeautifulSoup
import requests
html_text = requests.get('https://www.basketball-reference.com/leagues/').text
soup = BeautifulSoup(html_text, 'lxml')
rows = soup.select('tr[data-row]')
print(rows)
I am inspired by this thread, but it's returning a empty array. Can anyone help me with this
baduker
How about using pandas to make your web-scraping life (a bit) easier?
Here's how:
import pandas as pd
import requests
df = pd.read_html(requests.get('https://www.basketball-reference.com/leagues/').text, flavor="bs4")
df = pd.concat(df)
df.to_csv("basketball_table.csv", index=False)
Output:
Collected from the Internet
Please contact [email protected] to delete if infringement.
edited at
- Prev: Create ArrayList of arrays using Arrays.asList
- Next: How to get data from firebase and display on my google gauge chart
Related
TOP Ranking
- 1
pump.io port in URL
- 2
How to import an asset in swift using Bundle.main.path() in a react-native native module
- 3
Failed to listen on localhost:8000 (reason: Cannot assign requested address)
- 4
Double spacing in rmarkdown pdf
- 5
SQL Server : need add a dot before two last character
- 6
C++ 16 bit grayscale gradient image from 2D array
- 7
JMeter: Why get error when try to save test plan
- 8
JWT gives JsonWebTokenError "invalid token"
- 9
How to make thrown errors visible outside of a Promise?
- 10
How to tell if iOS Today Widget is being updated in the background?
- 11
Calling Doctrine clear() with an argument is deprecated
- 12
Capybara Selenium Chrome opens About Google Chrome
- 13
How to update azerothcore-wotlk docker container
- 14
Adding Ripple Effect to RecyclerView item
- 15
mysql.connector.errors.InterfaceError: 2003: Can't connect to MySQL server on '127.0.0.1:3306' (111 Connection refused)
- 16
Error while applying filter on dataframe - PySpark
- 17
Unable to add slack to bluemix project
- 18
MyPy fails dataclass argument with optional list of objects type
- 19
How can I validate and parse phone numbers to extract their country calling code and area code?
- 20
Single Sign-On in Spring by using SAML Extension and Shibboleth
- 21
python how to create many-to-many of lists inside one list
Comments