AI High Signal

1 curation · 626 membres · fenêtre de 24 h, demi-vie 6 h, seuil 5 relayeurs

Fenêtre 6 h 12 h 24 h 2 j 3 j 7 j
Montrer Les deux Liens 0 Tweets 1
Seuil 2 relayeurs 3 relayeurs 4 relayeurs 5 relayeurs 6 relayeurs Tout remettre
0liens
1tweets
35268posts lus
528auteurs
3179liens en base
1454 hde recul

Les tweets 1

Axe indépendant : repris sans regarder les liens.

1
Richard Sutton @RichardSSutton · 04:43
Brute force computation is not enough for intelligence. Clever new methods are needed. The science of AI is far from finished. IMHO
incompleteideas.net https://incompleteideas.net/IncIdeas/BitterLesson.html
6 relayeurs à 14 · il y a 43 min Voir sur X
Qui l'a repris
Stanford NLP Group chansung elie” François Fleuret” M M Saiful Bari (MARUF)” Denny Zhou”
Ce qu'ils en ont dit
elie @eliebakouch a cité · 08/11 09:58
i disagree with the first point, there is nothing that says that scaling up current transformer recipe is not enough for "intelligence". you take kimi K3 or your favorite open arch + some stability fixes, you scale it to 50T parameters, you do classical training end to end, you
François Fleuret @francoisfleuret a cité · 08/11 07:44
We need a model that learns *in spite* of its inductive bias, not thanks to it. We have to stop being cross-entropy fetishists.
M
M Saiful Bari (MARUF) @sbmaruf a cité · 08/11 07:02
True! This is the era of the RL objective. The biggest economy on this earth (US stock market) runs on subscriptions. Subscriptions require vendor lock-in. Currently, the frontier is pushing “Variance” learning from customer data, like how Google won the search market. But I
Denny Zhou @denny_zhou a cité · 08/11 06:26
The Bitter Lesson 2.0