I know that AI experts like Epoch AI have been projecting a continuation of the 5X per year increase in AI training compute but Grok 2 was released in August ...
Google Cloud's A4X VMs based on Nvidia's NVL72 machines with 72 B200 GPUs and 36 Grace CPUs are now available for rent.
A rather unexpected metric is perhaps the one from Morgan Stanley (via @Jukanlosreve) that counts the wafer consumption of AI ...
Frontier supercomputer simulates the universe at an unprecedented scale Advanced computing models dark matter, gas, and plasma interactions Exascale computing revolutionises cosmic, AI, and climate re ...