The Two Spikes That Let LLaMA Shrink Without Loss

The scale of modern language models can feel like watching a glacier slide: immense, intricate, and almost impossibly heavy. These giants—open or closed—are built from billions of parameters, tuned to predict the next word with uncanny fluency. But there’s a catch that scientists have wrestled with for years: the bigger the model, the heavier the…

Read More

A Cold War of Quarks Sparks Gravitational Echoes

Framing the mystery: gravitational waves as fossils of the early cosmos In the quiet, the universe sometimes hums with echoes from its most dramatic events. Gravitational waves, ripples in spacetime, travel unimpeded through the cosmic fog, carrying messages from epochs we cannot reproduce in a lab. The Oxford group led by Prateek Agrawal and his…

Read More

Could light forge a crystal lattice of skyrmions?

Skyrmions are tiny magnetic whirlpools tucked into the spins of electrons inside certain materials. To the untrained eye they might look like curiosities, but to physicists they are a telling manifestation of topology — a kind of global wiring that makes these patterns extraordinarily robust. In practical terms, skyrmions behave like stable, mobile carries of…

Read More