AI High Signal

1 curation · 626 membres · fenêtre de 6 h, demi-vie 6 h, seuil 2 relayeurs

Fenêtre 6 h 12 h 24 h 2 j 3 j 7 j
Montrer Les deux Liens 0 Tweets 1
Seuil 2 relayeurs 3 relayeurs 4 relayeurs 5 relayeurs 6 relayeurs Tout remettre
0liens
1tweets
35263posts lus
528auteurs
3179liens en base
1454 hde recul

Les tweets 1

Axe indépendant : repris sans regarder les liens.

1
J
Justin Lo @loresjpg · 01:37
Nice DeepSWE score! Does it survive a lowercase filename? Introducing MaxxBench: 89 DeepSWE tasks with small changes to the instructions or starting code. Same engineering problem, slightly different requirement. Models clustered around 74% on DeepSWE end up 23 pp apart. Good
2 relayeurs à 11 · il y a 4 h Voir sur X
Qui l'a repris
J Julian Schrittwieser” Hamel Husain”
Ce qu'ils en ont dit
J
Julian Schrittwieser @Mononofu a cité · 01:37
Making novel variations of evals is very useful, public evals tend to get memorized!
Hamel Husain @HamelHusain a cité · 01:16
I see some are drawing the wrong inference from this study: they are focusing on this meta benchmark as yet another benchmark for model picking, i.e. open vs closed models, model families etc. That’s too narrow of an interpretation! You need to do your own private evals on