AI High Signal

1 curation · 626 membres · fenêtre de 24 h, demi-vie 6 h, seuil 5 relayeurs

Fenêtre 6 h 12 h 24 h 2 j 3 j 7 j
Montrer Les deux Liens 0 Tweets 1
Seuil 2 relayeurs 3 relayeurs 4 relayeurs 5 relayeurs 6 relayeurs Tout remettre
0liens
1tweets
35245posts lus
528auteurs
3178liens en base
1453 hde recul

Les tweets 1

Axe indépendant : repris sans regarder les liens.

1
Richard Sutton @RichardSSutton · 08/11 14:26
Brute force computation is not enough for intelligence. Clever new methods are needed. The science of AI is far from finished. IMHO
incompleteideas.net https://incompleteideas.net/IncIdeas/BitterLesson.html
6 relayeurs à 13 · il y a 14 h Voir sur X
Qui l'a repris
chansung elie” François Fleuret” M M Saiful Bari (MARUF)” Denny Zhou” Satya Mallick”
Ce qu'ils en ont dit
elie @eliebakouch a cité · 08/11 09:58
i disagree with the first point, there is nothing that says that scaling up current transformer recipe is not enough for "intelligence". you take kimi K3 or your favorite open arch + some stability fixes, you scale it to 50T parameters, you do classical training end to end, you
François Fleuret @francoisfleuret a cité · 08/11 07:44
We need a model that learns *in spite* of its inductive bias, not thanks to it. We have to stop being cross-entropy fetishists.
M
M Saiful Bari (MARUF) @sbmaruf a cité · 08/11 07:02
True! This is the era of the RL objective. The biggest economy on this earth (US stock market) runs on subscriptions. Subscriptions require vendor lock-in. Currently, the frontier is pushing “Variance” learning from customer data, like how Google won the search market. But I
Denny Zhou @denny_zhou a cité · 08/11 06:26
The Bitter Lesson 2.0
Satya Mallick @LearnOpenCV a cité · 08/11 05:00
That’s what I call a bitter sense of humor.