Mar-17-2019, 08:16 AM
When I'm trying to scrape some data from an webpage, this error suddenly come up which never happened before. I did check my browser setting and cookies are enabled. I am in doubt about the server has blocked my access to the website.
Swapping requests for requests.session()
Adding useragent to the browser
ensuring same packages are installed
<html> <head> <script> Challenge=305158; ChallengeId=395740057; GenericErrorMessageCookies="Cookies must be enabled in order to view this page."; </script> <script> function test(var1) { var var_str=""+Challenge; var var_arr=var_str.split(""); var LastDig=var_arr.reverse()[0]; var minDig=var_arr.sort()[0]; var subvar1 = (2 * (var_arr[2]))+(var_arr[1]*1); var subvar2 = (2 * var_arr[2])+var_arr[1]; var my_pow=Math.pow(((var_arr[0]*1)+2),var_arr[1]); var x=(var1*3+subvar1)*1; var y=Math.cos(Math.PI*subvar2); var answer=x*y; answer-=my_pow*1; answer+=(minDig*1)-(LastDig*1); answer=answer+subvar2; return answer; } </script> <script> client = null; if (window.XMLHttpRequest) { var client=new XMLHttpRequest(); } else { if (window.ActiveXObject) { client = new ActiveXObject('MSXML2.XMLHTTP.3.0'); }; } if (!((!!client)&&(!!Math.pow)&&(!!Math.cos)&&(!![].sort)&&(!![].reverse))) { document.write("Not all needed JavaScript methods are supported.<BR>"); } else { client.onreadystatechange = function() { if(client.readyState == 4) { var MyCookie=client.getResponseHeader("X-AA-Cookie-Value"); if ((MyCookie == null) || (MyCookie=="")) { document.write(client.responseText); return; } var cookieName = MyCookie.split('=')[0]; if (document.cookie.indexOf(cookieName)==-1) { document.write(GenericErrorMessageCookies); return; } window.location.reload(true); } }; y=test(Challenge); client.open("POST",window.location,true); client.setRequestHeader('X-AA-Challenge-ID', ChallengeId); client.setRequestHeader('X-AA-Challenge-Result',y); client.setRequestHeader('X-AA-Challenge',Challenge); client.setRequestHeader('Content-Type' , 'text/plain'); client.send(); } </script> </head> <body> <noscript>JavaScript must be enabled in order to view this page.</noscript> </body> </html>Things I've tried:
Swapping requests for requests.session()
Adding useragent to the browser
ensuring same packages are installed