How do I extract information accurately from thousands of long documents with an LLM?

Use DocETL, our open-source system for LLM-powered document processing: you declare the pipeline, and LLM agents rewrite it, for example by breaking up the document or the task, and check candidate plans. On four document analysis tasks, DocETL found plans 25 to 80% more accurate than well-engineered baselines. Whatever tool you use, test the pipeline on a labeled sample.

Sources: DocETL; DocETL: Agentic Query Rewriting and Evaluation for Complex Document Processing (VLDB 2025)

Guide: How to Process Documents with LLMs Cheaply

More questions on this topic

All questions about using AI for data and knowledge work