Google open-sources TorchTPU, letting PyTorch apps run on its TPUs with a config change
Google has released TorchTPU as open source, a native PyTorch stack that lets AI apps written for Nvidia GPUs run on Google's TPUs — and therefore Google Cloud — with a simple configuration change and no rewrite.
Google has released TorchTPU, its long-awaited native PyTorch stack for its Tensor Processing Units, as an open-source project on GitHub — joining Amazon in a direct challenge to Nvidia’s grip on AI development (TechCrunch).
Announced on Tuesday at PyTorch Conference 2026, TorchTPU lets AI apps built with the popular PyTorch framework run on Google’s TPUs, and therefore on Google Cloud, with a simple configuration change and no rewriting of their apps (Google Cloud). The stack was co-developed with the PyTorch team at Meta, and Google says it worked directly with Meta, Hugging Face, Inferact (the maker of vLLM) and RadixArk (the maker of SGLang) so TorchTPU’s features work with the tools developers already use (TechCrunch; Google Cloud).
The move mirrors Amazon’s announcement a day earlier of TorchNeuron for its Trainium chips — also with no rewriting required — with Amazon going further by submitting code to the main PyTorch project that decouples its features from Nvidia’s chips (TechCrunch).
Google also launched a dedicated TPU agent suite, now in preview on GitHub, to help developers move their apps to its chips and cloud and fix errors along the way, and updated its LiteRT on-device AI tool to work better with PyTorch AI apps (TechCrunch; Google Cloud).
The framing from TechCrunch is blunt: most AI apps are written by default to run on Nvidia’s GPUs, and Amazon and Google are now “clearly working to end Nvidia’s advantage” — though neither expects developers to ditch Nvidia hardware en masse overnight (TechCrunch).
More on this topic: all Technology stories


