Resumen del episodio
With the GPT 4.5 rumours unceremoniously crushed, we are thankfully left with the real news. A potential 100T LLM, thanks to etched.ai (full breakdown of what we know), then the Mixtral price spiral revealing the decline in the cost of intelligence, a cameo appearance by Sebastien Bubeck to discuss phi-2 and a potential 13B phi-3, plus Bytedance meltdown and more.AI Insiders: https://www.patreon.com/AIExplainedRoon: https://twitter.com/tszzl/status/1736559508401615186Altman: https://twitter.com/sama/with_replies?ref_src=twsrc%5Egoogle%7Ctwcamp%5Eserp%7Ctwgr%5EauthorWill Depue: https://twitter.com/hokiepoke1/status/1736478901717680582Etched.AI: https://www.etched.ai/Article: https://www.eetimes.com/harvard-dropouts-raise-5-million-for-llm-accelerator/Mixtral: https://mistral.ai/news/mixtral-of-experts/OpenRouter: https://openrouter.ai/models/mistralai/mixtral-8x7b-instructMidjourney v6: https://twitter.com/nickfloats/status/1736141178855424097ByteDance:…
With the GPT 4.5 rumours unceremoniously crushed, we are thankfully left with the real news. A potential 100T LLM, thanks to etched.ai (full breakdown of what we know), then the Mixtral price spiral revealing the decline in the cost of intelligence, a cameo appearance by Sebastien Bubeck to discuss phi-2 and a potential 13B phi-3, plus Bytedance meltdown and more.AI Insiders: https://www.patreon.com/AIExplainedRoon: https://twitter.com/tszzl/status/1736559508401615186Altman: https://twitter.com/sama/with_replies?ref_src=twsrc%5Egoogle%7Ctwcamp%5Eserp%7Ctwgr%5EauthorWill Depue: https://twitter.com/hokiepoke1/status/1736478901717680582Etched.AI: https://www.etched.ai/Article: https://www.eetimes.com/harvard-dropouts-raise-5-million-for-llm-accelerator/Mixtral: https://mistral.ai/news/mixtral-of-experts/OpenRouter: https://openrouter.ai/models/mistralai/mixtral-8x7b-instructMidjourney v6: https://twitter.com/nickfloats/status/1736141178855424097ByteDance:…
Episodios
A 100T Transformer Model Coming? Plus ByteDance Saga and the Mixtral Price Drop
EscuchadoWith the GPT 4.5 rumours unceremoniously crushed, we are thankfully left with the real news. A potential 100T LLM, thanks to etched.ai (full breakdown of what we know), then the Mixtral price spiral revealing the decline in the cost of intelligence, a cameo appearance by Sebastien Bubeck to discuss phi-2 and a potential 13B phi-3, plus Bytedance meltdown and more.AI Insiders: https://www.patreon.com/AIExplainedRoon: https://twitter.com/tszzl/status/1736559508401615186Altman: https://twitter.com/sama/with_replies?ref_src=twsrc%5Egoogle%7Ctwcamp%5Eserp%7Ctwgr%5EauthorWill Depue: https://twitter.com/hokiepoke1/status/1736478901717680582Etched.AI: https://www.etched.ai/Article: https://www.eetimes.com/harvard-dropouts-raise-5-million-for-llm-accelerator/Mixtral: https://mistral.ai/news/mixtral-of-experts/OpenRouter: https://openrouter.ai/models/mistralai/mixtral-8x7b-instructMidjourney v6: https://twitter.com/nickfloats/status/1736141178855424097ByteDance:…
Nothing Much Happens in AI, Then Everything Does All At Once
EscuchadoWhen it rains, it pours. OpenAI Operator tested and reviewed, with full paper analysis. Perplexity Assistant is useful. Then Stargate, is it all smoke and mirrors? Strong rumours of an o3+ model from Anthropic. Then a full breakdown of Deepseek R1, and what it’s training method says about the state of AI. It’s not open source BTW. Plus Humanity’s Last Exam, and Hassabis Accelerates his AGI timeline.https://app.grayswan.ai/arena/chat/harmful-ai-assistanthttps://app.grayswan.ai/arenaAI Insiders ($9!): https://www.patreon.com/AIExplainedChapters:00:00 - Introduction00:54 - OpenAI Operator04:53 - Perplexity Assistant 05:15 - Stargate07:51 - Better than o3?08:25 - DeepSeek R1 Analysis12:12 - Training Secrets15:19 - No More Process Rewarding ?19:01 - Hassabis Timeline Accelerates21:22 - Humanity’s Last Examhttps://openai.com/index/computer-using-agent/System Prompt: https://github.com/wunderwuzzi23/scratch/blob/master/system_prompts/operator_system_prompt-2025-01-23.txtOpenAI Operator:…
Phi-2, Imagen-2, Optimus-Gen-2: Small New Models to Change the World?
EscuchadoPhi-2 is a tiny model that could fit on a phone, but it outperforms huge language models like Llama 2. I explain more about how it was made and what it means. Then we see Imagen-2, the most stunning text-to-image yet, at least according to Google' images. We then glimpse Optimus 2, smaller in the sense that it's 10kg lighter! With more degrees of freedom, it's movements look a lot more humanoid. And then the full launch of AI Insiders, plus a recap of why we shouldn't use the MMLU to 2 decimal places!https://www.patreon.com/AIExplainedphi2 now on HuggingFace: https://huggingface.co/microsoft/phi-2Bubeck Video, min 19: https://www.youtube.com/watch?v=24O1KcIO3FMPhi 2: https://www.microsoft.com/en-us/research/blog/phi-2-the-surprising-power-of-small-language-models/Shital Shah: https://twitter.com/sytelus/status/1734882570603753814Shoggoth: https://twitter.com/norabelrose/status/1702488701782352097Mamba 3B: https://www.together.ai/blog/mamba-3b-slimpjPhi 1.5B: https://arxiv.org/abs/2309.05463Phi 1:…
Gemini Full Breakdown + AlphaCode 2 Bombshell
EscuchadoGemini is here! All 60 pages of the technical report read, plus the AlphaCode 2 bombshell paper explained and analysed. Is that paper even more consequential than Gemini? Plus the launch of AI Insiders, Gemini demos, Hassabis hints and much, much more!AI Insiders: https://www.patreon.com/AIExplained/membershipRelease Page: https://deepmind.google/technologies/gemini/#introductionGemini Technical Report: https://storage.googleapis.com/deepmind-media/gemini/gemini_1_report.pdfMMLU SmartGPT Video:https://www.youtube.com/watch?v=hVade_8H8mEAvailability: https://blog.google/technology/ai/google-gemini-ai/#availabilityAlphaCode 2 Paper: https://storage.googleapis.com/deepmind-media/AlphaCode2/AlphaCode2_Tech_Report.pdfGoogle Clips: https://www.youtube.com/watch?v=K4pX1VAxaAIGoogle Credits: https://www.nytimes.com/2023/12/06/technology/google-ai-bard-chatbot-gemini.htmlHassabis Wired: https://www.wired.com/story/google-deepmind-demis-hassabis-gemini-ai/The Verge Hassabis:…
o3-mini and the “AI War”
Escuchadoo3-mini is here, and yes, I’ve read the paper in full - 2 hours after release, and even the post-launch Reddit AMA. Some epic details like a FrontierMath score that made me double-take, a likely new Cursor favorite, bio risk expertise and a cost-comparison with Deepseek R1., But does it perform on basic reasoning - let’s find out. Plus, arguably the bigger story - the increasingly frenetic rhetoric coming out of the West - and Dario Amodei and Alexandr Wang (CEOs of Anthropic and Scale AI respectively) in particular. The last thing we need is an “AI War”.https://wandb.me/simple-bench(Colab): https://colab.research.google.com/drive/1AVijcPnEkl8Gy_754XbRdG5m7Q5-9slg?usp=sharingAI Insiders ($9!): https://www.patreon.com/AIExplainedChapters: 00:00 - Introduction00:45 - o3 mini05:11 - First impressions vs Deepseek R107:22 - 10x Scale, o3-mini System Card, Amodei Essay, bitcoin wallets…12:40 - Simple Competition Finale13:03 - Clips and Final Thoughts on the “AI War”O3-mini:…