Thanks for the response, Metulburr. I really appreciate it. I could scrape the page.
I will take a look into Selenium and tutorials you have mentioned to get better.
I have one more question.
I typed in 'vr' in a search box from https://map.naver.com/ but the address doesn't get changed. I was expecting longer address instead of just https://map.naver.com/
So I clicked onto one of the names of the result and ctrl+shift+i > network tab > searched for a request including arcade information which is added to my code below.
My question is how I can scrape this page? I used the header but I've got an unexpected result.
I will take a look into Selenium and tutorials you have mentioned to get better.
I have one more question.
I typed in 'vr' in a search box from https://map.naver.com/ but the address doesn't get changed. I was expecting longer address instead of just https://map.naver.com/
So I clicked onto one of the names of the result and ctrl+shift+i > network tab > searched for a request including arcade information which is added to my code below.
My question is how I can scrape this page? I used the header but I've got an unexpected result.
import requests from bs4 import BeautifulSoup headers = { "User-Agent": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/71.0.3578.98 Safari/537.36" } url = 'https://map.naver.com/search2/local.nhn?sm=hty&searchCoord=127.1302174%3B37.4119829&isFirstSearch=true&query=vr&menu=location&mpx=02135620%3A37.4119829%2C127.1302174%3AZ11%3A0.0195464%2C0.0085920' req = requests.get(url, headers=headers) bs = BeautifulSoup(req.text, 'html.parser') print(bs)
Error:{
"error": {
"code": "HMAC_AUTH_FAILED",
"msg": "Hmac Authentication has failed.",
"extraInfo": null
}
}