Richard Sutton
@RichardSSutton · 08/11 16:18
Brute force computation is not enough for intelligence. Clever new methods are needed. The science of AI is far from finished. IMHO
Qui l'a repris
Ce qu'ils en ont dit
Tommy
@Shaughnessy119
a cité
· 08/11 16:18
I’ve been actively on the hunt for non LLM based AI models and I’ve invested into one already
Looking for totally new designs
elvis
@omarsar0
a cité
· 08/11 01:26
1000% agree with Sutton here.
Having worked in AI for over a decade (pre-LLMs), it's clear we need smarter methods for intelligence to truly compound in the way some of us envision it.
To me, Transformers just scratched the surface.
This arc is coming to an end; a new
ℏεsam
@Hesamation
a cité
· 07/11 23:55
> “what happened to the bitter lesson?”
people are genuinely trying to explain the bitter lesson to the guy who wrote it.
it’s called the bitter lesson
not the dumb lesson.
the bitter lesson says general methods that scale with compute win in the long run. you still have to
Gary Marcus
@GaryMarcus
a cité
· 07/11 23:32
what i have been saying for years
maybe now people will listen?
cocktail peanut
@cocktailpeanut
a cité
· 07/11 21:29
Srini Pagidyala
@Srini_Pa
a cité
· 07/11 21:16
Human like learning does it.
Implies understanding, concept formation, metacognition, self-directed, goal-oriented, persistent memory, contextual awareness, belief revision, dynamic world models are all part of it.
That is Integrated Neuro Symbolic Architecture- INSA.