New paper: We’re building retrieval models for AI scientists (and human ones, too)—retrieval trained to directly support inspiration💡:
🫠Problem-solution latent links,
⏫Zooming out (abstraction),
⏬Zooming in (specification).
Cognitive theories of ideation suggests these are fundamental ways humans traverse idea spaces and reframe problems, while brainstorming and connecting different areas.
Our new work, RATIO, with my student
@maayansharon10, brings these operations into scientific retrieval. Given for example a query on “reward hacking in RL-trained LLMs,” the goal is to retrieve a direct solution (e.g., reward-model ensembles), broaden the problem (e.g., to Goodhart’s law), or specify that principle in a new setting (e.g., recommender systems).
Our focus here is on defining the task and creating a new automatic way for data collection from literature.
The overarching goal: retrieve not just according to standard notions of topical relevance, but according to more latent, abstract links that help scientists take the next ideation step. I've been exploring this line of work in multiple papers over the years, excited to take a first step toward training models for this, and for more upcoming work in this space. This is also related to the recent notion of oblique retrieval (
@lateinteraction): retrieving latent and implicit connections rather than relying only on surface similarity.