Building AI agents, exploring cognitive science, unraveling bioinformatics

AI-designed antibodies have achieved atomic-level structural accuracy and therapeutic-relevant binding affinities, compressing discovery timelines from years to weeks.

A comparative analysis of approaches to catastrophic forgetting in language models, from parameter regularization to sparse memory architectures that reduce forgetting from 89% to just 11%.

DeepMind's DiscoRL discovers reinforcement learning algorithms that outperform hand-designed methods like PPO and DQN. By treating algorithm design as a meta-learning problem, it found alternatives to value functions and bootstrapping through optimization alone.

Are large language models merely stochastic parrots, or do they develop genuine internal representations of the world? This investigation examines evidence from Othello-GPT, spatial encoding in LLMs, and the symbol grounding problem to explore what cognitive science reveals about AI understanding.

Mixtral uses 46.7B parameters but only activates 13B per token. This architectural trick called Mixture of Experts powers Gemini 1.5, DeepSeek V3, and more. Learn how MoE works, its hidden costs, and when to use it.

Pedro Domingos proposes that neural networks and symbolic AI are the same mathematical operation - a logical rule can be equivalently written as a tensor equation in Einstein summation notation. If true, we've been building separate tools for problems that share identical structure.

A machine trained on simple grid worlds beat every hand-designed RL algorithm on Atari. DeepMind's DiscoRL discovers algorithms through meta-learning that outperform DQN, PPO, and A3C - methods humans spent decades developing.

GPT-4's 128K context window? It only uses about 10% effectively. Google's TITANS architecture introduces test-time memory learning that outperforms GPT-4 on long-context tasks with 70x fewer parameters.

A landmark study across five continents reveals that all humans share a preference for mathematically simple rhythms, but the specific patterns we favor are shaped by the music we absorb growing up.

Why biological systems offer the ideal training ground for reinforcement learning: automated verification through physics, not human judgment. From protein design with AlphaFold to RNA folding with ViennaRNA, biology provides the verifiable inverse problems that RL needs at scale.

Machine learning is illuminating biology's hidden half: intrinsically disordered proteins and RNA structures that traditional methods could never capture. But can we trust what we're seeing?

World models enable AI agents to imagine futures and plan actions, achieving 10-100x better sample efficiency than traditional reinforcement learning. From DreamerV3 collecting diamonds in Minecraft to foundation models like Sora and Genie, world models represent AI's shift from pattern matching to simulating reality itself.

Smart people disagree dramatically about whether AGI is five years away or fifty. The evidence reveals why this definitional crisis matters more than the technology itself.

MIT researchers used generative AI to create novel antibiotics from scratch, not finding them, but designing them. The breakthrough matters less for what it creates than for what it proves.

Learn how DSPy transforms brittle prompt engineering into systematic, testable code with automatic optimization