IdeaEval: Impact-Oriented Evaluation of Scientific Hypothesis Generation
This title was supposed to go on a paper. It belonged to a project we started in March this year, and the paper never came out. We spent those months trying to figure out how to evaluate research ideas, and for a handful of reasons the project stopped before we had an answer. We still wanted to write down what we learned: partly to leave a public record the work,…