Moore's Law is flatlining on 2D chip surfaces, so the industry is building upward. High-bandwidth memory stacks memory directly on top of compute in the third dimension to feed the insatiable bandwidth demands of large transformer forward passes. Next stop: photonic computing, which could deliver a 1,000x clock speed-up from gigahertz to terahertz.