What happens to research when the models can run so much of it? Anthropic researchers Neil Houlsby, Majd Al Merey, and Dan Alistarh sat down with professors Ana Klimovic and Thomas Hofmann at Kunsthaus Zürich to compare notes. Here are some of their words:
If you can try 20 ideas at once, why pick one?
"It's a bit like we got a more powerful telescope. You can map deeper or broader, but you’re still mapping an infinite space. You still need to know where to look."
— Dan Alistarh, Researcher, Anthropic
What does it mean to publish a paper now?
"Individually we feel empowered. We're at home and maybe we can develop ideas very quickly and it's satisfactory. But what does it do to the whole community? Because it accelerates everything. Who has time even to read it, to review it?"
— Thomas Hofmann, Professor, ETH Zurich
Where do we go from here?
"Just having more and more correct results is not enough. Human understanding is an output in its own right."
– Neil Houlsby, Researcher, Anthropic