視覚文書理解 - yuyan

視覚文書理解

画像処理論

マルチモーダルモデル

Vision Language Model

FACTOOL: Factuality Detection in Generative AI A Tool Augmented Framework for Multi-Task and Multi-Domain Scenarios

https://arxiv.org/pdf/2307.13528.pdf

VisFocus: Prompt-Guided Vision Encoders for OCR-Free Dense Document Understanding

https://speakerdeck.com/sansan_randd/visfocus-prompt-guided-vision-encoders-for-ocr-free-dense-document-understanding?slide=5

MatCha

https://huggingface.co/docs/transformers/main/model_doc/matcha

DePlot

https://huggingface.co/docs/transformers/main/model_doc/deplot

pix2struct

https://github.com/google-research/pix2struct

donut

https://github.com/clovaai/donut

DocLayout-YOLO

https://github.com/opendatalab/DocLayout-YOLO

docling

https://github.com/DS4SD/docling

Azure AI SearchでPDFをセクション毎に分割してインデックスに登録する

https://qiita.com/tmiyata25/items/13bf8321853e74f46c31

Table TransformerとGPT-4Vを用いたPDF内の表の解析

https://note.com/qunasys/n/nf9ee9a4e5d60?sub_rt=share_h