4. Using Regular Expressions, scrape the Gas Concentration Table that was scraped in question #2. The first step is to scrape the complete webpage using Beautifulsoup and then use regex to parse the Gas Concentration Table html page.
question 2:
import requests
from bs4 import BeautifulSoup
import pandas as pd
url = "https://en.wikipedia.org/wiki/Greenhouse_gas"
res = requests.get(url)
soup = BeautifulSoup(res.content, "html.parser")
# Find the table of interest
table = soup.find("table", {"class": "wikitable sortable"})
# Extract the header and data rows
header = [th.text.strip() for th in table.find("tr").find_all("th")]
data = [[td.text.strip() for td in tr.find_all("td")] for tr in table.find_all("tr")[1:]]
# Create the DataFrame
df = pd.DataFrame(data, columns=header)
import requests
from bs4 import BeautifulSoup
import pandas as pd
url = "https://en.wikipedia.org/wiki/Greenhouse_gas"
res = requests.get(url)
soup = BeautifulSoup(res.content, "html.parser")
# Find the table of interest
table = soup.find("table", {"class": "wikitable sortable"})
# Extract the header and data rows
header = [th.text.strip() for th in table.find("tr").find_all("th")]
data = [[td.text.strip() for td in tr.find_all("td")] for tr in table.find_all("tr")[1:]]
# Create the DataFrame
df = pd.DataFrame(data, columns=header)
Please refer to the following step for the complete solution to the problem above.
Trending now
This is a popular solution!
Step by step
Solved in 2 steps
