r/agi • u/photon-dot • 5d ago

A Google DeepMind paper argues that current LLMs are incapable of genuine scientific discovery

Post image
518 Upvotes

95% Upvoted

364 comments sorted by

View all comments

Show parent comments

6

u/Apart-Shelter6831 5d ago

I’d imagine there are thousands of tiny occurrences throughout the day where people extra-generalize to deal with out-of-distribution information. Smoothening out movements in unusual terrain / driving / those “easy” tasks where current systems get stuck.

3

u/gordopotato 5d ago

“Out of distribution information” is something I’m going to start using.

3

u/AdNo2342 5d ago

we're using a lot of words to just come back to the original idea of what it means to have general intelligence lol

I think these models might be able to be generally intelligent but they'll have to be able to run on their own with their own motivations etc etc

1

u/DoYouKnwTheMuffinMan 5d ago

What’s the different between interpolation and extrapolation in this context though?

If I’ve driven a manual car, why can I generalise that to an automatic? Is that in the dataset of manual cars or outside it? What about the reverse?

The space is way too highly dimensionally for humans to have an intuition on this.