|
Search Results
|
| Post |
Author |
Forum |
Replies |
Views |
Posted
[asc]
|
| |
|
Thread: HELP on Unwanted CSV Export Output | Using Selenium to Scrape
Post: HELP on Unwanted CSV Export Output | Using Seleniu...
| Hi guys,
It's been a long time since my last post.
Anyway, I'm having trouble with the CSV export result on a website I am trying to scrape data from.
====================================
Output P... |
|
soothsayerpg |
General Coding Help |
0 |
1,274 |
Jun-13-2021, 12:23 PM |
| |
|
Thread: Cannot Remove the Double Quotes on a Certain Word (String) Python BeautifulSoup
Post: RE: Cannot Remove the Double Quotes on a Certain W...
| Hi guys. Thanks for the response!
Did you tried it out? If you try it out and remove all the special chars, that double-quote is the one who'll remain.
I had gotten to a point, thinking, maybe I sho... |
|
soothsayerpg |
General Coding Help |
5 |
7,111 |
Oct-27-2019, 08:31 AM |
| |
|
Thread: Cannot Remove the Double Quotes on a Certain Word (String) Python BeautifulSoup
Post: Cannot Remove the Double Quotes on a Certain Word ...
| Hi guys,
How's it going?
I've been in weeks trying to remove a double-quote (") from a word (as I want to count the word in a certain text or webpage and what not).
Been going back and forth in cha... |
|
soothsayerpg |
General Coding Help |
5 |
7,111 |
Oct-22-2019, 01:43 PM |
| |
|
Thread: Help|CSV Writing on List with Inner Commas
Post: RE: Help|CSV Writing on List with Inner Commas
| Update: I see that writerow() than write() achieve the said goal. But now the problem is it writes in column. Yes, I was also wrong with the second image, I want the end result to be in rows. I achiev... |
|
soothsayerpg |
General Coding Help |
2 |
2,356 |
Jul-20-2019, 05:00 AM |
| |
|
Thread: Help|CSV Writing on List with Inner Commas
Post: Help|CSV Writing on List with Inner Commas
| Let's say I have:
l = ['Washington, 98373, USA', 'Arlington, WA, 98223, USA', 'Soap Lake, Washington, 98851, USA']What I'm doing is just typical writing
with open('results.csv', 'w', newline='') as f:... |
|
soothsayerpg |
General Coding Help |
2 |
2,356 |
Jul-20-2019, 02:18 AM |
| |
|
Thread: Help | How to make Dynamic Path/Address
Post: Help | How to make Dynamic Path/Address
| I often see tutorials (mostly) demo of OS Module and every IO module with static addresses/path(s). But how about if we send our script to our friend, when he/she run the script, it won't work since "... |
|
soothsayerpg |
General Coding Help |
3 |
7,513 |
Jul-13-2019, 03:11 AM |
| |
|
Thread: Help | Classes to use in real world
Post: RE: Help | Classes to use in real world
| Thanks @Gribouillis. That class example would definitely be helpful to me. Been a week thinking on how to make a script and remake it to a class.
Are we obligated to use each and every class section ... |
|
soothsayerpg |
General Coding Help |
9 |
4,178 |
Jul-06-2019, 09:27 AM |
| |
|
Thread: Help | Classes to use in real world
Post: RE: Help | Classes to use in real world
| Here's an example of a simple script I made using PyAutoGui
import pyautogui as pag
pag.FAILSAFE=True
#Call Chrome
pag.hotkey('command', 'space')
pag.typewrite('Chrome\n', 0.25)
pag.moveTo(412, 81,... |
|
soothsayerpg |
General Coding Help |
9 |
4,178 |
Jul-06-2019, 07:44 AM |
| |
|
Thread: Help | Classes to use in real world
Post: Help | Classes to use in real world
| Hi guys,
Tutorials and youtube videos often teach python classes using a person (and without real inputs). My question is, how can I take a module and write a program using classes? For example I wou... |
|
soothsayerpg |
General Coding Help |
9 |
4,178 |
Jul-06-2019, 04:07 AM |
| |
|
Thread: Scrapy Picking What to Output Href or Img
Post: RE: Scrapy Picking What to Output Href or Img
| It would be a very big help if anyone can help me out? |
|
soothsayerpg |
Web Scraping & Web Development |
1 |
2,712 |
Aug-02-2018, 10:59 AM |
| |
|
Thread: HTMLParser Reading even the Closing Tag
Post: RE: HTMLParser Reading even the Closing Tag
| I got you.
I'm confused with both, as a rookie, they both have some area of difficulties I encounter every now and then. At htmlparser or even on other with or without modules. It's easy to do a cond... |
|
soothsayerpg |
Web Scraping & Web Development |
6 |
3,512 |
Aug-02-2018, 07:34 AM |
| |
|
Thread: HTMLParser Reading even the Closing Tag
Post: RE: HTMLParser Reading even the Closing Tag
| Do you think that htmlparser can handle big crawls or would I go with Scrapy? |
|
soothsayerpg |
Web Scraping & Web Development |
6 |
3,512 |
Aug-02-2018, 07:14 AM |
| |
|
Thread: HTMLParser Reading even the Closing Tag
Post: RE: HTMLParser Reading even the Closing Tag
| Is it possible using only htmlparser or I can combine beautifulsoup with htmlparser on the same sheet? How about scrapy, can I call all of them inside my .py file? |
|
soothsayerpg |
Web Scraping & Web Development |
6 |
3,512 |
Jul-28-2018, 12:27 PM |
| |
|
Thread: HTMLParser Reading even the Closing Tag
Post: HTMLParser Reading even the Closing Tag
| Hi guys, since I didn't get any clear response to the scrapy thread. I shifted and trying my luck with HTMLparser.
Here's the problem. Whenever I call for 'a' it reads Quote:<a and also includes t... |
|
soothsayerpg |
Web Scraping & Web Development |
6 |
3,512 |
Jul-27-2018, 10:21 AM |
| |
|
Thread: Getting Correct 'a'-tag output
Post: RE: Getting Correct 'a'-tag output
|
for data in response.css('a'):
yield {
'url': data.css('a::attr(href)').extract(),
'text': data.css('a::text').extract(),
'rel': da... |
|
soothsayerpg |
Web Scraping & Web Development |
3 |
2,711 |
Jul-26-2018, 06:25 AM |
| |
|
Thread: Getting Correct 'a'-tag output
Post: RE: Getting Correct 'a'-tag output
| I'm green and didn't get what you are trying to say. Can you elaborate by making the script you are trying to tell? |
|
soothsayerpg |
Web Scraping & Web Development |
3 |
2,711 |
Jul-26-2018, 05:18 AM |
| |
|
Thread: Getting Correct 'a'-tag output
Post: Getting Correct 'a'-tag output
| I've been trying for almost a week getting the right output for the:
Quote:rel="nofollow"
Yes, I've been having success if the a-tag contains the said attribute, but if not, it output either: 'author'... |
|
soothsayerpg |
Web Scraping & Web Development |
3 |
2,711 |
Jul-25-2018, 10:21 AM |
| |
|
Thread: Scrapy Picking What to Output Href or Img
Post: Scrapy Picking What to Output Href or Img
| Hi again guys,
Actually two things I want to ask help for (All of this are just inside the 'a' tag):
First one is:
I want to have a few items that I would like to output on a csv file.
href
inner-te... |
|
soothsayerpg |
Web Scraping & Web Development |
1 |
2,712 |
Jul-23-2018, 12:22 PM |
| |
|
Thread: Extract Anchor Text (Scrapy)
Post: RE: Extract Anchor Text (Scrapy)
| (Jul-21-2018, 06:26 AM)buran Wrote: try
response.css('div.blog_next_page > a::text').extract_first()Scrapy Selectors docs
It works!
I was messing around with having 'text' inside the attr() or a... |
|
soothsayerpg |
Web Scraping & Web Development |
2 |
8,334 |
Jul-21-2018, 07:18 AM |
| |
|
Thread: Extract Anchor Text (Scrapy)
Post: Extract Anchor Text (Scrapy)
| Tried using the search box but didn't find any post that relates. Also tried Googling it but didn't find any answer.
How can I extract only the anchor text in a given hyperlink?
Quote:I.E. <a hre... |
|
soothsayerpg |
Web Scraping & Web Development |
2 |
8,334 |
Jul-21-2018, 06:15 AM |
