Just copying an xpath from your browser's developer tools is rarely gonna work, at least reliably.
I would recommend learning the basics of xpath, and writing xpath expressions yourself.
Here are a couple of ways you can get what you want (this is a scrapy shell session, but the same xpaths will work in lxml):
I would recommend learning the basics of xpath, and writing xpath expressions yourself.
Here are a couple of ways you can get what you want (this is a scrapy shell session, but the same xpaths will work in lxml):
>>> # the 6th cell of the 3rd row of the "snapshot-table2" >>> response.xpath('//table[@class="snapshot-table2"]//tr[3]/td[6]/b/text()').get() '0.95' >>> # the cell after the one containing the text "EPS next Q" >>> response.xpath('//td[.="EPS next Q"]/following-sibling::td[1]/b/text()').get()