AI High Signal

Ce qui vient de franchir un palier de reprise, le plus récent en tête.

Depuis 2 h 6 h 24 h 3 j
À partir de Tous 2 relayeurs 3 relayeurs 4 relayeurs 5 relayeurs Tout remettre
  • 14
    il y a 12 min
    Richard Sutton @RichardSSutton
    Brute force computation is not enough for intelligence. Clever new methods are needed. The science of AI is far from finished. IMHO
    incompleteideas.net https://incompleteideas.net/IncIdeas/BitterLesson.html
    Qui l'a repris
    Stanford NLP Group chansung elie” François Fleuret” M M Saiful Bari (MARUF)” Denny Zhou”
    Ce qu'ils en ont dit
    elie @eliebakouch a cité · 08/11 09:58
    i disagree with the first point, there is nothing that says that scaling up current transformer recipe is not enough for "intelligence". you take kimi K3 or your favorite open arch + some stability fixes, you scale it to 50T parameters, you do classical training end to end, you
    François Fleuret @francoisfleuret a cité · 08/11 07:44
    We need a model that learns *in spite* of its inductive bias, not thanks to it. We have to stop being cross-entropy fetishists.
    M
    M Saiful Bari (MARUF) @sbmaruf a cité · 08/11 07:02
    True! This is the era of the RL objective. The biggest economy on this earth (US stock market) runs on subscriptions. Subscriptions require vendor lock-in. Currently, the frontier is pushing “Variance” learning from customer data, like how Google won the search market. But I
    Denny Zhou @denny_zhou a cité · 08/11 06:26
    The Bitter Lesson 2.0