Bottom Page

Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
 Outputing the results of search machine
#1
Hello,

is it possible to make a programme that takes as arguments, a key word i.e q=help and the start and finish pages of the results of a search machine i.e page=0 to page=3(4 result pages) and output these result pages to 4 different html files?
Quote
#2
Sounds like a scraper. See this tutorial Web scraping with Scrapy
Quote
#3
Yes, that is possible.

For command line programs, check out sys.argv.
For web-based programs, you'll need to find out how your framework handles "url parameters". Most of them just use keyword arguments passed to the function assigned to the url path.
Quote
#4
(Nov-07-2016, 04:42 PM)nilamo Wrote: For command line programs, check out sys.argv.
the argparse module is better than using sys.argv
https://docs.python.org/3/library/argparse.html
Quote
#5
That's neat. I didn't know that was added.
Quote

Top Page

Possibly Related Threads...
Thread Author Replies Views Last Post
  How to use BeautifulSoup to parse google search results DevinGP 16 8,621 Dec-22-2017, 10:23 PM
Last Post: snippsat

Forum Jump:


Users browsing this thread: 1 Guest(s)