Research: PDF ingestion, OCR, and high-precision retrieval for large-scale document analysis #1

Merged

granat merged 1 commit from research/2026-08-12-pdf-ingestion-ocr-retrieval into main 2026-08-12 22:33:45 +02:00

Conversation 0 Commits 1 Files changed 1 +189

granat commented 2026-08-12 21:33:20 +02:00

Owner

Copy link

Dated research report (2026-08-12) for issue GRA-3: comparison of PDF parsing/OCR solutions (Docling, MinerU, Marker 2, olmOCR) and precision retrieval approaches (PageIndex, ColPali/ColQwen, RAGFlow) for massive technical/legal PDF corpora.

Recommendation — primary: custom Python pipeline: Docling (+ selective VLM OCR for scanned pages) → PageIndex-style tree retrieval, with a lexical/vector pre-filter at corpus scale.
Fallback: self-hosted RAGFlow with Docling/MinerU parsers.

Report file: docs/research/2026-08-12-pdf-ingestion-ocr-high-precision-retrieval.md — includes executive summary, comparison table, per-candidate analysis, freshness check, data gaps, and full source list.

Dated research report (2026-08-12) for issue GRA-3: comparison of PDF parsing/OCR solutions (Docling, MinerU, Marker 2, olmOCR) and precision retrieval approaches (PageIndex, ColPali/ColQwen, RAGFlow) for massive technical/legal PDF corpora. **Recommendation — primary**: custom Python pipeline: Docling (+ selective VLM OCR for scanned pages) → PageIndex-style tree retrieval, with a lexical/vector pre-filter at corpus scale. **Fallback**: self-hosted RAGFlow with Docling/MinerU parsers. Report file: `docs/research/2026-08-12-pdf-ingestion-ocr-high-precision-retrieval.md` — includes executive summary, comparison table, per-candidate analysis, freshness check, data gaps, and full source list.

granat added 1 commit 2026-08-12 21:33:20 +02:00

Add research report: PDF ingestion, OCR, and high-precision retrieval for large-scale document analysis ... ca15057f3c

Co-authored-by: multica-agent <github@multica.ai>

granat merged commit e36ea92736 into main 2026-08-12 22:33:45 +02:00

granat deleted branch research/2026-08-12-pdf-ingestion-ocr-retrieval 2026-08-12 22:33:45 +02:00

granat referenced this pull request from a commit 2026-08-12 22:33:47 +02:00

Merge pull request 'Research: PDF ingestion, OCR, and high-precision retrieval for large-scale document analysis' (#1) from research/2026-08-12-pdf-ingestion-ocr-retrieval into main

Sign in to join this conversation.

Reviewers

No reviewers

Labels

Clear labels

No items

No labels

Milestone

Clear milestone

No items

No milestone

Projects

Clear projects

No items

No project

Assignees

Clear assignees

No assignees

1 participant

Notifications

Subscribe

Due date

The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set

Reference

granat/prec_docs!1

No description provided.