How to load all pages of the pdf file to the program

[alicenguyen]

I'm working with the code to summarize the text using BERT. I am stopped at the step "loading all pages of the pdf file to the program". My code below just loads only one page. Please help for the instruction. I am a new coder.

f= open('/content/Example.pdf', 'rb')
pdf = PdfFileReader(f)
page = pdf.getPage(6) 
text = page.extractText()

[snippsat]

You should tell what library you use,bye the look it's PyPDF2
It's a common task to do, so if you search you will find different solution.
If i do a quick test this works.

import PyPDF2

file_pdf = 'sample.pdf'
with open(file_pdf, mode='rb') as f:
    reader = PyPDF2.PdfFileReader(f)
    for page in range(reader.numPages):
        p = reader.getPage(page)
        print(p.extract_text())

[alicenguyen]

Yes. I use Pypdf2.
I will try with your recommend code. Thanks.

[alicenguyen]

It is successful now. But the output looks not the best. Could you review and give me your advice?

Output:
Streaming output truncated to the last 5000 lines.


o



i



n



t



 



t

..... ect

[snippsat]

Don't post the whole oput if it 100's of lines long.
I have shorting it out.
Are you using my code with with one pdf file?
Here is the file sample.pdf i test with.

[alicenguyen]

I used that code but with another file. Your file is OK.
See the attached file.

  test.pdf (Size: 272.01 KB / Downloads: 93)

[alicenguyen]

I used that code but with another file. Your file is OK.
See the attached file.

Could you help with the answer?

[Pedroski55]

I'm pretty sure this code is based on something snippsat wrote some time ago, too clever for me.

PyPDf2 is good, but can't get some text for reasons I don't know or understand

# importing required modules 
import pdfplumber

path2pdf = '/home/pedro/pdfExtractedPages/The_Knights_Tale_Modern_English.pdf'    
path2text = '/home/pedro/temp/The_Knights_Tale_Middle_English.txt'
"""
>>> test = enumerate(pages, 1) # 1 starts counting at 1, set 0 to count from zero
>>> test
<enumerate object at 0x7f586adb5880>
>>> for t in test:
	print(t)

	
(1, <Page:1>)
(2, <Page:2>)
(3, <Page:3>)
"""
text_pages = []

with pdfplumber.open(pdf_file) as pdf:
    pages = pdf.pages
    for pg in range(len(pages)):
        text = pdf.pages[pg].extract_text()
        text_pages.append(text)

print('text_pages is now', len(text_pages), 'long. Now joining tthe list to a string ... ')
textstring = ''.join(text_pages)

with open(path2text, 'w') as tf:
    tf.write(textstring)

Gets the bits other modules can't reach! Worked for me, thank you snippsat!

[buran]

You can try using https://pypi.org/project/camelot-py/

[alicenguyen]

I'm pretty sure this code is based on something snippsat wrote some time ago, too clever for me.

PyPDf2 is good, but can't get some text for reasons I don't know or understand

Thanks for supporting the code. The result is better now.