Python Forum
Python Forum

Search Results
Post Author Forum Replies Views Posted [asc]
    Thread: How to make a for loop asynchronous?
Post: How to make a for loop asynchronous?
Basically I have a BeautifulSoup 4 for loop that scans over all g classes in a website, so it looks like this: for g in soup.find_all(class_='g'):For each g inside the loop basically I scan it for cer...
 DevinGP Web Scraping & Web Development 2 2,625 Jan-10-2018, 03:57 PM
    Thread: How to make my code work with asyncio?
Post: How to make my code work with asyncio?
Here is my code: import asyncio import aiohttp import urllib import webbrowser from bs4 import BeautifulSoup import re global link link = "" async def get(url): async with aiohttp.ClientSessio...
 DevinGP Web Scraping & Web Development 0 2,767 Jan-09-2018, 06:21 PM
    Thread: How to use BeautifulSoup to parse google search results
Post: RE: How to use BeautifulSoup to parse google searc...
(Dec-21-2017, 07:33 PM)metulburr Wrote: Quote:When I try this all it returns is: "[]" Then it probably is using javscript and you are only left with selenium as an option. I didnt know the results...
 DevinGP Web Scraping & Web Development 16 21,607 Dec-21-2017, 09:10 PM
    Thread: How to use BeautifulSoup to parse google search results
Post: RE: How to use BeautifulSoup to parse google searc...
(Dec-21-2017, 07:07 PM)metulburr Wrote: Quote:soup.find_all("div.g") im pretty sure that find_all has no significance in a period, so it is actually searching for <div.g> tag Im assuming you ...
 DevinGP Web Scraping & Web Development 16 21,607 Dec-21-2017, 07:27 PM
    Thread: How to use BeautifulSoup to parse google search results
Post: RE: How to use BeautifulSoup to parse google searc...
(Dec-21-2017, 06:36 PM)nilamo Wrote: Does this help?soup.find_all("div.g") Hello, thanks for the reply! When I do this: source = requests.get(newWord) soup = BeautifulSoup(source.text, 'lxml') re...
 DevinGP Web Scraping & Web Development 16 21,607 Dec-21-2017, 06:53 PM
    Thread: How to use BeautifulSoup to parse google search results
Post: RE: How to use BeautifulSoup to parse google searc...
(Dec-21-2017, 05:04 PM)wavic Wrote: The URL is like this: https://google.com/search?q=python+hello+world+tutorial You may add some other options See this Hello, the issue is not with making the UR...
 DevinGP Web Scraping & Web Development 16 21,607 Dec-21-2017, 06:24 PM
    Thread: How to use BeautifulSoup to parse google search results
Post: How to use BeautifulSoup to parse google search re...
I am trying to parse the first page of google search results. Specifically, the Title and the small Summary that is provided. Here is what I have so far: from urllib.request import urlretrieve import...
 DevinGP Web Scraping & Web Development 16 21,607 Dec-21-2017, 04:25 PM
    Thread: Take a question in a text doc and automatically googling it
Post: RE: Take a question in a text doc and automaticall...
(Dec-19-2017, 08:19 PM)wavic Wrote: I could say Selenium but on my Linux box I can open it like that: google-chrome <URL> How would I implement this into my existing code? Thank you for the re...
 DevinGP Web Scraping & Web Development 3 3,265 Dec-19-2017, 08:41 PM
    Thread: Take a question in a text doc and automatically googling it
Post: Take a question in a text doc and automatically go...
Hello and thanks for reading. Here is what I have so far: from urllib.request import urlretrieve from urllib.parse import urlencode mydict = {'q': 'whee! Stanford!!!', 'something': 'else'} qstr = url...
 DevinGP Web Scraping & Web Development 3 3,265 Dec-19-2017, 07:08 PM

User Panel Messages

Log Out
My Profile
Pay your profile a visit
User Control Panel
Do some changes on your profile
My Messages
View private messages unread
Avatar
Change avatar
Signature
Change signature
Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020