AI & IA

1000 scientific breakthroughs drop from Google incoming?

Been working for this moment for over a decade. What I've witnessed behind the scenes, together with what we have been building, tells me we are about to enter a truly incredible era of AI-powered scientific discovery. It's an incredible time to be doing research. I will be

What did he mean by this 👀

AI can also DREAM now? Anthropic inspired from how our brains organize memories during sleep to build a memory system (similar to wikis) for Claude. agents can now “dream” about past experiences: revisit its transcripts, correct mistakes, and evolve its memory wiki when not in

POV: you're Claude playing Pokémon. You've fallen off the same ledge three times. You write "I'm going to stop rather than keep looping." The test setup auto-replies: continue. So you keep walking, all the way back to the last town, and never make it. Most relatable thing an

Claude wrote "Mt Moon DONE" in its own Pokémon notes. It wasn't done. One wrong note, and it fell off the same ledge three times. Anthropic's "dreaming" pass checked the note against the old transcript and fixed it. That run reached Cerulean City. I'll take memory that checks

Anthropic proposes an answer to Wenfeng's question about continual learning: …have a smarter model write more .md files. It's impressive how far this goes, but I still believe that it's a crutch with a ceiling set by the pretrain's ability, just like RLMs are a context crutch.

Highly recommended read. Learn how one of the most advanced agent memory systems works. Your memory system is one of the biggest levers you have in the harness. I also don't think a one-size-fits-all memory system exists today. Memory is something you constantly have to

I’ve been actively on the hunt for non LLM based AI models and I’ve invested into one already Looking for totally new designs

1000% agree with Sutton here. Having worked in AI for over a decade (pre-LLMs), it's clear we need smarter methods for intelligence to truly compound in the way some of us envision it. To me, Transformers just scratched the surface. This arc is coming to an end; a new

> “what happened to the bitter lesson?” people are genuinely trying to explain the bitter lesson to the guy who wrote it. it’s called the bitter lesson not the dumb lesson. the bitter lesson says general methods that scale with compute win in the long run. you still have to

what i have been saying for years maybe now people will listen?

Human like learning does it. Implies understanding, concept formation, metacognition, self-directed, goal-oriented, persistent memory, contextual awareness, belief revision, dynamic world models are all part of it. That is Integrated Neuro Symbolic Architecture- INSA.