Question

Python

Create a simple Web Scraper python program that will extract the language tag from a web page like Amazon.com. Therefore, the output should be like:

Language of YouTube: en-us

Answer 1

Here is the completed code for this problem. Comments are included, go through it, learn how things work and let me know if you have any doubts or if you need anything to change. If you are satisfied with the solution, please rate the answer. Thanks

import urllib.request
from bs4 import BeautifulSoup

#replace with the page you want, make sure there is prefix 'http:'
page='http://youtube.com'

print('Please wait while loading the page')
#opening page, reading response
response=urllib.request.urlopen(page)
#extracting text from response
text=response.read().decode()
#creating BeautifulSoup object from html text
soup = BeautifulSoup(text,'html.parser')

#finding "html" tag
result=soup.find("html")
#below line will display the title and language of the website
#Note that this may not work with all sites. There are many reasons
#for this. If the site does not have a language mentioned, this will not work
#Sometimes the servers (Amazon,Youtube etc) will reject the requests
#from these web scrappers, so you may face server side error codes.
print("Language of {}: {}".format(soup.title.text,result["lang"]))