Richard Sutton
@RichardSSutton · 08/11 14:26
Brute force computation is not enough for intelligence. Clever new methods are needed. The science of AI is far from finished. IMHO
Qui l'a repris
chansungCe qu'ils en ont dit
elie
@eliebakouch
a cité
· 08/11 09:58
i disagree with the first point, there is nothing that says that scaling up current transformer recipe is not enough for "intelligence". you take kimi K3 or your favorite open arch + some stability fixes, you scale it to 50T parameters, you do classical training end to end, you
François Fleuret
@francoisfleuret
a cité
· 08/11 07:44
We need a model that learns *in spite* of its inductive bias, not thanks to it. We have to stop being cross-entropy fetishists.
M
M Saiful Bari (MARUF)
@sbmaruf
a cité
· 08/11 07:02
True! This is the era of the RL objective. The biggest economy on this earth (US stock market) runs on subscriptions. Subscriptions require vendor lock-in. Currently, the frontier is pushing “Variance” learning from customer data, like how Google won the search market.
But I
Denny Zhou
@denny_zhou
a cité
· 08/11 06:26
The Bitter Lesson 2.0
Satya Mallick
@LearnOpenCV
a cité
· 08/11 05:00
That’s what I call a bitter sense of humor.