Jun-05-2018, 02:01 PM
Hello all,
The page I would like to scrape is a user videos page on youtube. All of the video titles in the page are nested under the same xpath which is: //*[@id='video-title'] What I would like my script to do is to create a list of titles on a loaded page and then print it, however it does not seem to work. Any advice?
The page I would like to scrape is a user videos page on youtube. All of the video titles in the page are nested under the same xpath which is: //*[@id='video-title'] What I would like my script to do is to create a list of titles on a loaded page and then print it, however it does not seem to work. Any advice?
from lxml import html
import requests
page = requests.get('https://www.youtube.com/user/numberphile/videos')
tree = html.fromstring(page.content)
title = tree.xpath("//*[@id='video-title']/text()")
titles = []
for f in title:
titles.append(f)
print(titles)