Python Forum
Search Results
Post Author Forum Replies Views Posted [asc]
    Thread: Python - Scrapy
Post: Python - Scrapy

Does any of you know how to loop for "Brand", "Model" & "Make/Year" from this website?, this web site using javascript for the "Options", am i able to crawl with scrapy this website? just for educ...
Baggelhsk95 Web Scraping & Web Development 0 2,262 Apr-24-2019, 01:07 PM
    Thread: Python Scrapy ebay API
Post: Python Scrapy ebay API

Hi everyone....im wondering if somebody know how to connect the api from the ebay into scrapy to get calls, i did this small code to make sure if the ebay work's without api, but i was wrong..., i di...
Baggelhsk95 Web Scraping & Web Development 0 3,175 Nov-21-2018, 11:22 AM
    Thread: Python scrapy scraped_items
Post: RE: Python scrapy scraped_items

Quote:If the third and forth callbacks are not being called to be honest i don't see any mistake with the third and forth functions....with my knowledge, i dont know...i might do something wrong, idk ...
Baggelhsk95 Web Scraping & Web Development 2 2,824 Nov-13-2018, 08:30 AM
    Thread: Python scrapy scraped_items
Post: Python scrapy scraped_items

i was testing the following code to see the results and on debugging i saw the scraped_items and it was like 4.777,....that wasnt the results i wanted to get....second i wanted to scrape each def func...
Baggelhsk95 Web Scraping & Web Development 2 2,824 Nov-12-2018, 12:39 PM
    Thread: Trying to install Scrapy but ...
Post: RE: Trying to install Scrapy but ...

use anacoda... :D
Baggelhsk95 Web Scraping & Web Development 10 6,044 Nov-07-2018, 01:59 PM
    Thread: Python - Scrapy - CSS selector
Post: Python - Scrapy - CSS selector

Hello everyone!, i was messing with the scrapy i did some examples....but my css selector in Car_Manufacturer, Manufacturer_Model, Model_Edition im getting empty brackets for some reason ... here i...
Baggelhsk95 Web Scraping & Web Development 1 5,513 Nov-07-2018, 01:57 PM
    Thread: Python - Scrapy - Contains
Post: RE: Python - Scrapy - Contains

dude....you are awesome....you have always to give the best possible answers to people.
Baggelhsk95 Web Scraping & Web Development 3 4,479 Oct-27-2018, 06:41 AM
    Thread: Python - Scrapy - Contains
Post: Python - Scrapy - Contains

Lets say we have this html, and we wanted to say if the tr in td contains EAN:, Print me the 2nd td in the same element response.xpath('//strong[contains( text(), "EAN:")]/text()').extract()<tr c...
Baggelhsk95 Web Scraping & Web Development 3 4,479 Oct-26-2018, 12:49 PM
    Thread: Python - Scrapy Login in
Post: RE: Python - Scrapy Login in

if ill run normal bot without login, im getting the data just fine....
Baggelhsk95 Web Scraping & Web Development 3 4,763 Oct-23-2018, 06:50 AM
    Thread: Python - Scrapy Login in
Post: Python - Scrapy Login in

Hello guys...i need your help...i was messing with the scrapy earlier, but for some reason my script doesnt work # -*- coding: utf-8 -*- import scrapy from scrapy.spiders.init import InitSpider clas...
Baggelhsk95 Web Scraping & Web Development 3 4,763 Oct-19-2018, 07:43 AM
    Thread: Python debugging local os
Post: Python debugging local os

Hello guys, quick question, does any of you know how can i make debugging when something has changed in specific solder in local folder?i wanted to get notifications
Baggelhsk95 General Coding Help 1 2,160 Oct-18-2018, 08:56 AM
    Thread: Python - Scrapy Login form
Post: RE: Python - Scrapy Login form

i was trying to do the same thing with different website, but seems doesn't work as i wanted to.... # -*- coding: utf-8 -*- import scrapy class TabotSpider(scrapy.Spider): name = 'TaBot' lo...
Baggelhsk95 Web Scraping & Web Development 4 10,699 Oct-16-2018, 08:01 AM
    Thread: Python - Scrapy Ebay Test
Post: RE: Python - Scrapy Ebay Test

im not getting any content from tr.bot, im getting empty brackets for some reason...
Baggelhsk95 Web Scraping & Web Development 4 4,281 Oct-16-2018, 06:46 AM
    Thread: Python - Scrapy Ebay Test
Post: Python - Scrapy Ebay Test

i made this quick script just for test, but im not getting any content for some reason..... here's the code quick code: # -*- coding: utf-8 -*- import scrapy class EbaybotSpider(scrapy.Spider): ...
Baggelhsk95 Web Scraping & Web Development 4 4,281 Oct-15-2018, 11:51 AM
    Thread: Python - Scrapy Login form
Post: RE: Python - Scrapy Login form

im getting the price in zl, we can use request for euro?
Baggelhsk95 Web Scraping & Web Development 4 10,699 Oct-13-2018, 06:34 AM
    Thread: Python - Scrapy Login form
Post: Python - Scrapy Login form

Hello guyes....i was messing with my script to login in this website but seems doesnt work....i'll like to login first to loggin_url and then request the rest urls to get data # -*- coding: utf-8 -*-...
Baggelhsk95 Web Scraping & Web Development 4 10,699 Oct-12-2018, 09:25 AM
    Thread: Python - Scrapy Javascript Pagination (next_page)
Post: RE: Python - Scrapy Javascript Pagination (next_pa...

(Oct-08-2018, 11:32 AM)stranac Wrote: The best way to do things like this is often to figure out what requests are being made using your browser's developer tools, and simply recreate those. For exa...
Baggelhsk95 Web Scraping & Web Development 3 9,919 Oct-08-2018, 12:22 PM
    Thread: Python - Scrapy Javascript Pagination (next_page)
Post: Python - Scrapy Javascript Pagination (next_page)

Hello guys...i made this script for this website....but my pagination doesn't work because its just javascript...and when you click nextpage the container loads new data.... i did found the urls for t...
Baggelhsk95 Web Scraping & Web Development 3 9,919 Oct-08-2018, 09:13 AM

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020