Machine Learning Street Talk — transcripts.

1ARC-AGI-3 winning team - Millennia of minds, compressed into words.But we have the benefit of millions of years of evolution. Right? And so it's almost a bit unfair that we're expecting AI algorithms to be able to do all of that. Exactly. I think… 2The Ex-Pentagon Chief Sounding the Alarm on AI Weapons — Brad CarsonSo I remember when I was first elected to Congress 20 years ago now. The Congressional Management Foundation gives you this book of kinda like, how to be a congressman, how to run… 3The AI Progress Chart Everyone Is Misreading — Beth Barnes & David Rein 4"You don't fine-tune your way to AGI" - Here's why. [Eiso Kant]You will never hear me argue against. Scale. The narrative at the time in the world was we're just going to scale up the next GPT model, make it ten x larger. This was such a… 5The Dangerous Illusion of AI Coding? - Jeremy HowardIt it it it literally disgusts me. Like, I literally think it's it's inhumane. My mission remains the same as it has been for, like, 20 years, which is to stop people working like… 6A Physicist Found the Hidden Phase Transitions in Society — Cristopher MooreYou say, "Oh, well, if we could solve the halting problem, we could ask it about itself and then halt if it doesn't." And and they're like, "That's it. That's what Touring is… 7Math vs AI: Who Decides What's True? [Dr. Paul Lessard]In pure mathematics, we have an incredibly brutal aesthetic/formal judgment for when something's true, right? We've got definition and proof. But here is a context where you don't… 8We Built Calculators Because We're STUPID! [Prof. David Krakauer]what is complexity if it's not life? What is life if it's not intelligent? I'm not sure these terms really are that different uh in what they're trying to capture. And so this is… 9Tensor Logic "Unifies" AI Paradigms [Pedro Domingos]Tensor logic unifies not just symbolic AI and and and deep learning. It also unifies things like kernel machines and graphical models. I'm Pedro Domingus. I'm a professor of… 10"AIs are strange new minds" [Prof. Christopher Summerfield / Oxford University]So memory is a terrible movie. But there's this wonderful scene. So I think this is a kind of giant computer that goes rogue in Superman three. And there's this wonderful scene… 11"We need AIs with PHYSICAL experience" (Jeff Beck)The problem with pattern for studying pattern formation is the patterns just keep repeating. But the brain is doing something that a pattern can't do, right? Which is it's… 12Intelligence is collective, not artificial — Prof. Michael I. Jordan (UC Berkeley / Inria)Nature said that you are the most influential computer scientist. It exists in the real world. This is a abstraction, but it's a it's a real thing. It's like f equals m a. It's a… 13Why AI Has a Plato Problem — Mazviita ChirimuutaWhat should we say as philosophers about the relationship between neuroscience and philosophy of mind? So, how much of our ideas about how the mind works can we read off from the… 14Why Scientists Can't Rebuild a Polaroid Camera [César Hidalgo]I'm Cesaralgo. I'm the director of the Center for Collective Learning and I recently completed this book, The Infinite Alphabet and the Loss of Knowledge. The book has two… 15Wild breakthrough on Math after 56 years... [Exclusive]We've had exclusive early access to the brand new Google Alpha Evolve paper which just got released one minute ago. We did a technical interview with the authors before… 16Why High Benchmark Scores Don’t Mean Better AI [SPONSORED]Formula 1 cars are the absolute pinnacle of engineering, right? Everything is perfect, huge top speed. If you used it as your daily commuting car, you'd have an absolute… 17Google Researcher Shows Life "Emerges From Code" [Blaise Agüera y Arcas]the new book. So, it's called What is intelligence? Uh, thank you for asking. Uh, it was just published by MIT Press, uh, you know, three or so weeks ago. So, it's it's very it's… 18Why Every Brain Metaphor in History Has Been Wrong [SPECIAL EDITION]Let me tell you a little story. 1960s in the summer, a little kid named Carl was playing around in the back of his garden and he noticed all of these wood lice crawling around.… 19Why Program Synthesis Is Next (Kevin Ellis and Zenna Tavares)You're building a model on the fly from uh very small amounts of data. Uh but you are not passively receiving the data. You have to go out there and um uh poke things and push… 20Why Every AI Model Is an Impostor — Kenneth Stanley2025 is fast becoming the dawn of a new age of artificial intelligence, an age of miracles. But what if I told you that the AI we know today might not be as good as it appears?… 21AI HAS A "BODY" PROBLEM... [Dr. Maxwell Ramstead]Why did you guys decide to create a physical AI company? And what's wrong with large language models? People are saying that all you need to do is hook large language models up to… 22Can Outsourcing Thinking Make Us Dumber? [Prof. David Krakauer]The brain is an organ like a muscle. If I outsource all of my thinking to something or someone else, it will atrophy just as your muscles do. There's nothing confusing about that.… 23Explosive AI Timeline Predictions [Gary Marcus, Daniel Kokotajlo, Dan Hendrycks]Okay, take one. All right, here we are saving humanity. Take one. Having, say, for instance, the United States disrupt China's ability to develop a super intelligence. The main… 24The Universal Hierarchy of Life - Prof. Chris Kempes [SFI]The eye is so complicated, maybe it only gets discovered once and then everything that has an eye has a common ancestor. Not true. Um, eyes evolve many times. There are… 25Type a Sentence, Get a Playable 3D World in 3 Seconds - Shlomi Fuchter & Jack Parker-HolderBy the way, look at this dog. This is amazing. This is insane. What was the prompt to create that? Today is a world exclusive of what is, in my opinion, the most mind-blowing… 26He won a Nobel here for AlphaFold. Then he left. - John JumperI don't really love the bitter lesson as people try and apply it. In fact, AlphaFold 2 is the opposite of that. Protein folding is 1 of these holy grail type problems in biology.… 27AI training data will never be fully synthetic [SPONSORED]totally independently of any prompting uh all the major frontier models um derived a solution that involved blackmail essentially models when knowing that they were being observed… 28The Weird ChatGPT Hack That Leaked Training Data [Dr. Yannic Kilcher / Prof. Florian Tramer]there was this investigation into why the word delve was used so often, right? And it turns out, okay, a lot of the training data comes from kind of Nigerian crowd workers, I… 29AI Agents can write 10,000 lines of hacking code in seconds [Dr. Ilia Shumailov]Big models today if we compare them to the big models five years ago they fail in very different ways. They get significantly better at following instructions when they follow… 30The Brain Is Just Specialized Agents Talking To Each Other — Dr. Jeff BeckGeometric deep learning is a big part of like is a big part of the stack if for no other reason than when we talk about like modeling the physical world that means like… 31Build Specialist LLMs Like It’s 2019 (Randall Balestriero)We just launched this experiment and then we are very surprised to see that the hugely overparameterized model and not only train out of the box like you have very nice training… 32Your Brain Doesn't Command Your Body. It Predicts It. [Max Bennett]What's really interesting about about this book, Max, is um you know, obviously I' I've read loads and loads of books in in the space and there's, you know, people like Hinton and… 33Why Humans Are Still Powering AI [Sponsored] - Phelim BradleyThere's a dirty secret, isn't there, in in Silicon Valley and in the tech world that there is, and I don't think people realize the extent to this, there is an absolutely huge… 34The Mathematical Foundations of Intelligence [Professor Yi Ma]In the past 10 years, I think the question about the intelligence or artificial intelligence has uh captured people's imagination. Uh I'm one of them, but it took me about 10… 35Your Brain Is a Prediction Machine, Not a Processor — Karl FristonKeith has been talking about this moment where we had a glass of cherry with Professor Friston for about the last four years and our dream has been realized today. Absolutely. So… 36Mutually Assured AI Malfunction [Dan Hendrycks]compared to nuclear weapons. I think it's harder to make cutting edge GPUs given a billion dollars. I mean certainly you can't you can't do it with a billion dollars. If it's $10… 37What If Intelligence Didn't Evolve? It "Was There" From the Start! - Blaise Agüera y ArcasAfter a few million interactions, magic happens, which is that you go from noise to programs. You start to see uh complex programs appear on these tables. This is the most… 38The Real Reason Huge AI Models Actually Work [Prof. Andrew Wilson]So when I say deep learning is not so mysterious or different, I'm not saying that deep learning is not mysterious or not different. I think it's actually both. It's rather that… 39AI Isn't Creative [Prof. Kenneth Stanley]So it goes back to these observations from Pickreeder um which is this picture breeding website where neural networks which were a special kind of neural network called… 40Every Definition of Intelligence Is Wrong. Here's Why — Michael BennettHow close are we to AGI? I mean, >> it's interesting how much it has stuck around. We have just replaced the pineal gland with a touring machine. >> You're a big fan of what I… 41AI companions which really hook your attention [Sponsored]Steve Jobs predicted the future of AI all the way back in 1985. And so my hope is someday when the next Aristotle is alive, we can capture the underlying world view of that… 42Is "Thermo" AI the future? [Guillaume Verdon aka "Beff Jezos"]That was the most technical podcast I've ever done. I think that was one of my favorite uh conversations for sure. Hey, I'm Guom Verdon. Growing up really I was pursuing theories… 4329.4% ARC-AGI-2 🤯 (TOP SCORE!) - Jeremy BermanYou can describe every single ARCV v2 task in 10 bullet points of plain English, most of them in five bullet points. And I think that this actually gets to the heart of ARC… 44When AI Discovers the Next Transformer — Robert LangeSo I think a lot of sort of analogies from evolution transfer to scientific research, right? In the sense that we traverse a tree of different ideas or different experiments and… 45He Co-Invented the Transformer. Now: Continuous Thought Machines [Llion Jones / Luke Darlow]despite the fact that I was involved in inventing the Transformer luckily um no one's been working on them as long as I have rights with maybe the exception of the other se seven… 46AutoGrad Changed Everything (Not Transformers) [Dr. Jeff Beck]So my PhD is in mathematics uh from Northwestern University. I studied pattern formation in complex systems in particular combustion synthesis which is all about burning things… 47New Research: LMArena is "rigged"We have a serious problem with chatbot arena. For those of you at the coal phase thinking about how good language models really are compared to each other, you've almost certainly… 48The Thermodynamic AI Chip · Thomas AhleYeah. So why not try and build a chip that's just inherently random? Meet Thomas Ahle. I caught up with him in Zurich, and he's 1 of these rare galaxy brain people who's… 49PhD Bodybuilder Predicts The Future of AI (97% Certain) [Dr. Mike Israetel]So if if you had a simulation of fire in a computer or of a stomach, it wouldn't digest. Fire wouldn't get hot. Water wouldn't get wet. It would digest. We we can't even I mean…