AI High Signal

Ce qui vient de franchir un palier de reprise, le plus récent en tête.

  • 14
    il y a 23 min
    Richard Sutton @RichardSSutton
    Brute force computation is not enough for intelligence. Clever new methods are needed. The science of AI is far from finished. IMHO
    incompleteideas.net https://incompleteideas.net/IncIdeas/BitterLesson.html
    Qui l'a repris
    Ce qu'ils en ont dit
    elie @eliebakouch a cité · 08/11 09:58
    i disagree with the first point, there is nothing that says that scaling up current transformer recipe is not enough for "intelligence". you take kimi K3 or your favorite open arch + some stability fixes, you scale it to 50T parameters, you do classical training end to end, you
    François Fleuret @francoisfleuret a cité · 08/11 07:44
    We need a model that learns *in spite* of its inductive bias, not thanks to it. We have to stop being cross-entropy fetishists.
    M
    M Saiful Bari (MARUF) @sbmaruf a cité · 08/11 07:02
    True! This is the era of the RL objective. The biggest economy on this earth (US stock market) runs on subscriptions. Subscriptions require vendor lock-in. Currently, the frontier is pushing “Variance” learning from customer data, like how Google won the search market. But I
    Denny Zhou @denny_zhou a cité · 08/11 06:26
    The Bitter Lesson 2.0
  • 2
    il y a 23 min
    Patrick Collison @patrickc
    Two things I’ve been thinking about regarding AI: • People often highlight the risks involved in AI, which are surely very real. I’m struck, however, by how hard it is to understand the contours of the positive scenario. There are easy-to-perceive and frequently invoked
    Qui l'a repris
    Ce qu'ils en ont dit
    J
    Jeffrey Wang @jeffreygwang a cité · 04:47
    People describing their fears around AI often reanimate the sci-fi future (likely dystopia) they once read about. All of this makes it ever more critical for us to crystallize a coherent, grounded, and positive vision for the future of this technology.
  • 2
    il y a 2 h
    will brown @willcb
    2027 is gonna be about engines
    Qui l'a repris
    Ce qu'ils en ont dit
    swyx 🔜 aie.codes @swyx a cité · 03:00
    are you listening anon?
    Joanne Jang @joannejang a cité · 08/11 18:18
    vroomberg terminals
  • 2
    il y a 2 h
    H
    Hey, It's Erin! @TheTruestErin
    Watch Jesse’s smile fade micrometer by micrometer as he realizes that yes actually, that is indeed the plan. Watch him slowly realize that his party will never receive votes again. You can literally see his mouth straighten out if you watch the video
    Qui l'a repris
    Ce qu'ils en ont dit
    Teortaxes▶️ (DeepSeek 推特🐋铁粉 2023 – ∞) @teortaxesTex a cité · 02:41
    I didn’t realize that libs genuinely want One Billion Americans
  • 11
    il y a 4 h
    J
    Justin Lo @loresjpg
    Nice DeepSWE score! Does it survive a lowercase filename? Introducing MaxxBench: 89 DeepSWE tasks with small changes to the instructions or starting code. Same engineering problem, slightly different requirement. Models clustered around 74% on DeepSWE end up 23 pp apart. Good
    Qui l'a repris
    Ce qu'ils en ont dit
    J
    Julian Schrittwieser @Mononofu a cité · 01:37
    Making novel variations of evals is very useful, public evals tend to get memorized!
    Hamel Husain @HamelHusain a cité · 01:16
    I see some are drawing the wrong inference from this study: they are focusing on this meta benchmark as yet another benchmark for model picking, i.e. open vs closed models, model families etc. That’s too narrow of an interpretation! You need to do your own private evals on
    Teortaxes▶️ (DeepSeek 推特🐋铁粉 2023 – ∞) @teortaxesTex a cité · 08/11 22:00
    holy shit, an art form of scientific grift next METR/Epoch/AA employee right here you all need to work on your epistemic hygiene
    Ofir Press @OfirPress a cité · 08/11 21:26
    GPT-5.6 Sol and Luna were built by roughly the same people using roughly the same infra, I don't think we can blame the 20 point difference in Luna just on memorization. There's something else being tracked here in addition to memorization. Maybe MaxxBench questions are slightly
    Mat Velloso @matvelloso a cité · 07/11 21:20
    I'm both surprised and also not at all
  • 2
    il y a 4 h
    R
    Reflection @reflection_ai
    Beam’s model technical report is now available. Read the full report to learn about the methodology our team used to train Beam end-to-end in-house, here:
    reflection.ai https://reflection.ai/documents/beam-model-tech-report
  • 2
    il y a 4 h
    reflection.ai https://reflection.ai/documents/beam-model-tech-report
    Qui l'a relayé
    Yao Fu @Francis_YAO_ · 01:29 Prev. Grok 4.5/4.6 pretraining scaling @xAI; Gemini 3 perception and project Astra @GoogleDeepMind
    Beam’s model technical report is now available. Read the full report to learn about the methodology our team used to train Beam end-to-end in-house, here:
    M
    M Saiful Bari (MARUF) @sbmaruf · 07/11 19:19 MIT TR35 || RSI@aws, Nova, ALLaM, xCodeEval, UXLA, BLOOMZ, T0 || Scaling Maximalist
    Beam’s model technical report is now available. Read the full report to learn about the methodology our team used to train Beam end-to-end in-house, here: