Python Forum
Securing King James Bible (KJV) + King James Bible 1611 (KJV1611) in MariaDB/MySQL
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Securing King James Bible (KJV) + King James Bible 1611 (KJV1611) in MariaDB/MySQL
#2
Part 1: Accomplished (Prepping my 1611 scrapes [folders & files]) files list; for parsing the HTML to Python and then Payload to MariaDB (Part 2)

Source/Tutorials:

https://unix.stackexchange.com/questions/47858/how-can-i-search-a-wild-card-name-in-all-subfolders


IRC Network - Libera.Chat - #linux:
  • Dan39: Keyed me into the find command w/ sample syntax
    Danilo82: Keyed me into an alternative to find command called "fzf" which I haven't explored yet.

My working directory for WGET with target folder (with over 160k files/folders - contents) "www.kingjamesbibleonline.org"

I executed the following command to create "1611_3.txt" which now has all the files and folders containing "1611".

/WGET-11.02.2021.www.kingjamesbibleonline.org$ find www.kingjamesbibleonline.org/ -name '*1611*' > 1611_3.txt
Now here is a sample output of the "1611_3.txt" file generated:

www.kingjamesbibleonline.org/Luke-Chapter-24_Original-1611-KJV
www.kingjamesbibleonline.org/Iohn_13_1611
www.kingjamesbibleonline.org/The-Epistle-to-the-Romanes_12_1611
www.kingjamesbibleonline.org/Reuelation_21_1611
www.kingjamesbibleonline.org/Prouerbs_22_1611
www.kingjamesbibleonline.org/Ecclesiastes_3_1611
www.kingjamesbibleonline.org/1-Corinthians_13_1611
www.kingjamesbibleonline.org/Psalmes_16_1611
www.kingjamesbibleonline.org/Ephesians_5_1611
www.kingjamesbibleonline.org/Discussion-Thread-101611
www.kingjamesbibleonline.org/John-Chapter-15_Original-1611-KJV
www.kingjamesbibleonline.org/Discussion-Thread-161149
www.kingjamesbibleonline.org/Revelation-Chapter-22_Original-1611-KJV
www.kingjamesbibleonline.org/2-Samuel-Chapter-22_Original-1611-KJV
www.kingjamesbibleonline.org/1-Chronicles-Chapter-16_Original-1611-KJV
www.kingjamesbibleonline.org/Job-Chapter-19_Original-1611-KJV
www.kingjamesbibleonline.org/Job-Chapter-22_Original-1611-KJV
www.kingjamesbibleonline.org/Psalms-Chapter-23_Original-1611-KJV
www.kingjamesbibleonline.org/Romans-Chapter-12_Original-1611-KJV
www.kingjamesbibleonline.org/Revelation-Chapter-21_Original-1611-KJV
www.kingjamesbibleonline.org/Galatians-Chapter-6_Original-1611-KJV
www.kingjamesbibleonline.org/Isaiah-Chapter-26_Original-1611-KJV
www.kingjamesbibleonline.org/Colossians-Chapter-3_Original-1611-KJV
www.kingjamesbibleonline.org/Lamentations-Chapter-3_Original-1611-KJV
www.kingjamesbibleonline.org/2-Corinthians-Chapter-3_Original-1611-KJV
Each folder has 1 "index.html" inside for parsing.

What is the best way to start a python script to loop through each directory listed in "1611_3.txt" and run bs4 against it?

Thank you everyone for this forum!

Best Regards,

Brandon Kastning
“And one of the elders saith unto me, Weep not: behold, the Lion of the tribe of Juda, the Root of David, hath prevailed to open the book,...” - Revelation 5:5 (KJV)

“And oppress not the widow, nor the fatherless, the stranger, nor the poor; and ...” - Zechariah 7:10 (KJV)

#LetHISPeopleGo

Reply


Messages In This Thread
RE: Securing King James Bible (KJV) + King James Bible 1611 (KJV1611) in MariaDB/MySQL - by BrandonKastning - Jan-17-2022, 09:16 PM

Possibly Related Threads…
Thread Author Replies Views Last Post
Question Python Obstacles | Jeet-Kune-Do | BS4 (Tags > MariaDB) [URL/Local HTML] BrandonKastning 0 1,495 Feb-08-2022, 08:55 PM
Last Post: BrandonKastning
Question Securing State Constitutions (USA) from University of Maryland > MariaDB .sql BrandonKastning 1 1,624 Jan-21-2022, 06:34 PM
Last Post: BrandonKastning
Exclamation Debian 10 Buster Environment - Python 3.x (MariaDB 10.4.21) | Working Connector? BrandonKastning 9 4,616 Jan-04-2022, 08:27 PM
Last Post: BrandonKastning
  Python Obstacles | Karate | HTML/Scrape Specific Tag and Store it in MariaDB BrandonKastning 8 3,377 Nov-22-2021, 01:38 AM
Last Post: BrandonKastning
  Build a simple Webapp with Python Flask and mariaDB newbie1 3 3,560 Jun-04-2020, 09:34 PM
Last Post: lmolter54
  Python3 + BeautifulSoup4 + lxml (HTML -> CSV) - How to write 3 Columns to MariaDB? BrandonKastning 21 7,493 Mar-23-2020, 05:51 PM
Last Post: ndc85430

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020