---
title: "Google open-sources TorchTPU so PyTorch models run natively on its TPU chips"
url: https://anawords.com/story/google-torchtpu-open-source-pytorch-on-tpus
published: 2026-10-22T18:14:16+05:30
updated: 2026-10-22T18:14:16+05:30
section: Chips & Compute
author: Mayank Sahu
checked: sources checked by AI, approved by editor
version: 1
---

# Google open-sources TorchTPU so PyTorch models run natively on its TPU chips

Built with Meta’s PyTorch team, TorchTPU supports eager mode and torch.compile, and Google says training scaled to 8,192 Ironwood TPUs. It arrives the same week as Amazon’s TorchNeuron.

**In short:** Google announced on 20 October 2026 that TorchTPU, a native PyTorch stack for its Tensor Processing Units, is now open source. Co-developed with Meta’s PyTorch team, it lets existing PyTorch workloads run on TPUs with minimal code changes, and Google says training scaled across up to 8,192 Ironwood TPUs.

## What Google released

Google Cloud executives Mark Lohmeyer and Bill Jia announced TorchTPU at PyTorch Conference 2026 on 20 October.[^1][^2] It is a native PyTorch stack for Google’s TPUs, co-developed with the PyTorch team at Meta and published on GitHub.[^1] Google says TPUs now join GPUs and CPUs as a native PyTorch option.[^1]

## How it works

- **Few code changes:** existing PyTorch workloads run on TPUs “with minimal code changes”, Google says; SiliconANGLE describes a few configuration changes.[^1][^2]
- **Eager and compiled:** developers can debug in eager mode, then use `torch.compile` for production speed.[^1]
- **Libraries:** Hugging Face Transformers can place a model on a TPU with `device_map="tpu"`, and there are backends for vLLM and SGLang.[^1]
- **Migration help:** a TPU agent suite, in early preview, helps move apps and fix errors automatically.[^1][^2]

## Scale results

Google says TorchTitan training was validated on up to 8,000 Ironwood (TPU v7x) chips, and a scaling test reached up to 52% model FLOPs utilisation on Qwen 3 8B across up to 8,192 Ironwood TPUs.[^1] These are Google’s own figures.

## Who is using it

Meta’s Jana van Greunen said TorchTPU lets Meta “deploy our PyTorch workloads to Google TPUs”.[^1] Hugging Face, Inferact (vLLM), RadixArk (SGLang), Anyscale and India’s Zenteiq.ai are quoted as partners.[^1] Zenteiq.ai’s founder reports more than four times higher inference throughput across 1,000 TPU v6e chips in its setup.[^1]

## What it means

Two cloud providers released native PyTorch backends for their own chips in the same week: Google’s TorchTPU and [Amazon’s TorchNeuron](/story/amazon-torchneuron-pytorch-backend-trainium-public-beta). Both aim at the same thing: making it cheap to try hardware other than Nvidia GPUs without rewriting code. Analyst Holger Mueller told SiliconANGLE it “remains to be seen” how much this changes Nvidia’s position.[^2]

For developers and startups, including in India where Zenteiq.ai is already a user, more real choices of hardware can mean better prices and availability. The practical test is simple: run your own model on each and compare cost per result.

## What to watch

- Independent benchmarks comparing TorchTPU, TorchNeuron and Nvidia GPUs on the same models.
- When components marked preview, such as the TPU agent suite, become generally available.

Related: [Intel’s GPU D270 inference card](/story/intel-gpu-d270-crescent-island-ai-inference-card) and [Meta’s Prometheus supercluster](/story/meta-prometheus-supercluster-ohio-1-million-gpus).

## Fact ledger

- [Confirmed] Google open-sourced TorchTPU on 20 October 2026, co-developed with Meta’s PyTorch team. (source 1)
- [Confirmed] PyTorch workloads run on TPUs with minimal code changes; eager mode and torch.compile are supported. (source 1)
- [Company claim] Google reports up to 52% MFU on Qwen 3 8B across up to 8,192 Ironwood TPUs. (source 1)
- [Reported] Partners include Meta, Hugging Face, Inferact and RadixArk. (source 1,2)
- [Company claim] Zenteiq.ai reports over 4x higher inference throughput on 1,000 TPU v6e chips. (source 1)
- [Not known] Licence terms.

## Sources

1. [Google Cloud: TorchTPU is now open source, run native PyTorch on TPUs](https://cloud.google.com/blog/topics/ai-infrastructure/torchtpu-is-now-open-source-run-native-pytorch-on-tpus) — official
2. [SiliconANGLE: Google unveils TorchTPU](https://siliconangle.com/2026/10/20/google-unveils-torchtpu-in-a-push-to-break-nvidias-stranglehold-on-ai-compute/)