Python Forum
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
web scraping HTML - :(
#11
And also move with open into the loop.
import requests

domains = ['https://webdesigner.dk', 'https://www.dk4.dk/item/4128-persondatapolitik']
for domain in domains:
    print(domain)
    response = requests.get(domain)
    print(f"Response data length: {len(response.text)}")
    # Remove # from line below to see source
    # print(response.text)

    with open('source.html', 'a', encoding='utf-8') as f:
        f.write(response.text.strip())
Reply


Messages In This Thread
web scraping HTML - :( - by Kingoman - Apr-04-2021, 10:14 PM
RE: web scraping HTML - :( - by Kingoman - Apr-04-2021, 11:00 PM
RE: web scraping HTML - :( - by snippsat - Apr-04-2021, 11:36 PM
RE: web scraping HTML - :( - by Kingoman - Apr-05-2021, 12:46 AM
RE: web scraping HTML - :( - by snippsat - Apr-05-2021, 12:58 AM
RE: web scraping HTML - :( - by Kingoman - Apr-05-2021, 01:30 AM
RE: web scraping HTML - :( - by snippsat - Apr-05-2021, 01:34 AM
RE: web scraping HTML - :( - by Kingoman - Apr-05-2021, 01:49 AM
RE: web scraping HTML - :( - by snippsat - Apr-05-2021, 02:06 AM
RE: web scraping HTML - :( - by Kingoman - Apr-05-2021, 02:12 AM
RE: web scraping HTML - :( - by snippsat - Apr-05-2021, 02:16 AM
RE: web scraping HTML - :( - by Kingoman - Apr-05-2021, 02:41 AM
RE: web scraping HTML - :( - by ndc85430 - Apr-05-2021, 03:37 AM
RE: web scraping HTML - :( - by Kingoman - Apr-05-2021, 03:43 AM
RE: web scraping HTML - :( - by supuflounder - Apr-05-2021, 04:16 AM
RE: web scraping HTML - :( - by ndc85430 - Apr-05-2021, 04:23 AM
RE: web scraping HTML - :( - by Kingoman - Apr-05-2021, 06:03 AM
RE: web scraping HTML - :( - by Kingoman - Apr-05-2021, 06:04 AM
RE: web scraping HTML - :( - by ndc85430 - Apr-05-2021, 06:35 AM
RE: web scraping HTML - :( - by Kingoman - Apr-05-2021, 06:45 AM
RE: web scraping HTML - :( - by ndc85430 - Apr-05-2021, 06:47 AM
RE: web scraping HTML - :( - by Kingoman - Apr-05-2021, 06:56 AM
RE: web scraping HTML - :( - by snippsat - Apr-05-2021, 09:50 AM

Possibly Related Threads…
Thread Author Replies Views Last Post
  Python Web Scraping can not getting all HTML content yqqwe123 0 1,656 Aug-02-2021, 08:56 AM
Last Post: yqqwe123
  HTML multi select HTML listbox with Flask/Python rfeyer 0 4,686 Mar-14-2021, 12:23 PM
Last Post: rfeyer
  Python3 + BeautifulSoup4 + lxml (HTML -> CSV) - How to loop to next HTML/new CSV Row BrandonKastning 0 2,392 Mar-22-2020, 06:10 AM
Last Post: BrandonKastning

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020