Beautifulsoup parsing

[zivoni]

I think that splitting on whitespaces is not enough, there are both longer titles and multiple authors. I tried dirty way with extracting <b> and splitting rest on "[" on your url.

from bs4 import BeautifulSoup as bs
import requests

url = "https://www.rfc-editor.org/rfc-index.html"
 
soup = bs(requests.get(url).text, 'html.parser')
for btag in soup.select("td b")[1:]:
    title = btag.text
    author = btag.parent.text[len(title)+1:].partition("[")[0].strip()
    print("Title: {}\nAuthor: {}\n".format(title, author))

gives

Output:
Title: Augmented BNF for Syntax Specifications: ABNF
Author: D. Crocker, P. Overell

Title: Host Software
Author: S. Crocker

Title: Host software
Author: B. Duvall

Title: Documentation conventions
Author: S.D. Crocker

...
...

Title: ARPA Network Functional Specifications
Author: G. Deloche

Title: Host Software
Author: G. Deloche