Google and Amazon now both offer native PyTorch backends that let code leave Nvidia GPUs.

Google just open-sourced TorchTPU that replaces PyTorch/XLA, letting developers debug TPU models step by step.

TorchTPU used up to 52% of peak TPU compute training Qwen 3 8B.

TPUs previously reached PyTorch through PyTorch/XLA, which queued operations for a compiler, so debugging differed from GPU work.

TorchTPU replaces that layer, running each operation as written for debugging, then switching to torch.compile for production speed.