kalle07's picture
Update README.md
481110e verified
|
raw
history blame
2.18 kB
metadata
language:
  - en
  - de
tags:
  - parser
  - parsing
  - PDF
  - pdfplumber
  - txt
  - tables
  - python
  - windows
  - RAG

PDF to TXT converter ready to chunck for your RAG

ONLY WINDOWS
EXE and PY aviable (en and german)

give me a ❤️, if you like ;)

Most LLM applications only convert you PDF simple to txt, nothing more, its like you save your PDF as txt file. Often textblocks are mixed and tables not readable. therefore its bit better to convert it with some help of a parser.
I work with "pdfplumber/pdfminer" none OCR, so its very fast!

  • Works with single and multi pdf list, works with folder
  • Intelligent multiprocessing
  • Error tolerant, that means if your PDF is not convertible, it will be skipped
  • Instant view of the result
  • Converts some common tables as json to txt files
  • It adds the absolute PAGE number to each page
  • All txt files will be created in original folder of PDF

This I have created with my brain and the help of chatGPT, sorry so I will not fulfill any wishes unless there are real errors.
It is really hard for me with GUI and the Function and in addition to compile it.
For the python-file oc you need to import missing libraries.

I also have a "docling" parser with OCR, butit will only be the python-file, not comiled.
You have to download all libs, and if you start internal also OCR models are loaded. At the moment i have a kind of multi docling, the number depend on VRAM and if you use OCR only for tables or for all. I have set VRAM = 16GB and the multiple calls to docling are VRAM/1.3, so it uses ~12GB and processes 12 PDFs at once, only txt and tables, so no images no diagrams. For now alld PDFs must be same folder like the python file. if you cahnge the VRAM consum is rasing you hace to set 1.3 to 2 or more.

now have fun and leave a comment if you like ;)
on discord "sevenof9"


I am not responsible for any errors or crashes on your system. If you use it, you take full responsibility!