Why is it so hard to find a good dataset for my project?
Keyword search sees only titles and tags, and you often can't tell whether a dataset fits your task until you inspect its rows and columns. In our survey of 89 data professionals, finding an initial dataset was still unsolved. We built DataScout to help: it suggests query rewrites, searches dataset contents, and shows relevance indicators for your task.
Sources: It Took Longer Than I Was Expecting: Why Is Dataset Search Still So Hard? (HILDA 2024 (Workshop on Human-in-the-Loop Data Analytics)); Rethinking Dataset Discovery with DataScout (UIST 2025)
Guide: Interfaces for Data Work with LLMs
More questions on this topic
- How do I make AI-generated summaries in a dashboard or table easy to skim?
- How do I get an LLM to write consistent one-line titles or summaries for many items?
- Is there a better way to iterate on prompts when an LLM pipeline runs over many documents?
- My RAG answers are wrong. How do I tell whether retrieval or generation is the problem?
- How do I find which cells in a messy Jupyter notebook actually produced this plot or model, so I can clean it up?
- When I change an earlier Jupyter cell, how do I know which later cells to rerun?