Should an agent use regex or an LLM to pull values like dates out of free-text columns?

Regex works for a few fixed formats and breaks on varied natural language. In DAB, all three agents we tested defaulted to regex for text extraction. On the patents dataset, dates appear as "dated 5th March 2019" and "March the 18th, 2019"; no agent's regex covered them, and every agent scored 0%. A regex for MALE also matched inside FEMALE.

Sources: Can AI Agents Answer Your Data Questions? A Benchmark for Data Agents (Preprint)

More questions on this topic

All questions about using AI for data and knowledge work