News · Tech

OpenAI rebuilt its Git backend so Codex agents stop waiting on each other

OpenAI has detailed Pando, a Rust-based Git backend that now runs all development in its monorepo. Built with Codex in 10 weeks, it handles each branch independently and reuses packfiles across clients, cutting median push latency nearly 5x and serving close to a petabyte of Git data a day while engineers and agents keep using ordinary Git.

OpenAIGitCodexCoding agentsDeveloper toolsRustInfrastructure

OpenAI graphic reading Scaling Git at OpenAI, with a branch icon fanning out to three server icons on a blue grid
Image: OpenAI, official image from the Scaling Git at OpenAI post, used with attribution

OpenAI has published the design of Pando, a new backend for Git repositories that now powers all development in its monorepo[1]. The company says it cut median push latency by nearly 5x and now delivers nearly a petabyte of Git data per day, without changing how its engineers and agents use Git[1].

01 / 05

Coding agents broke the old setup

OpenAI says Codex has changed the pace of development inside the company: one engineer now has several changes ready for CI at once, and each push can set several jobs fetching the same commit[1]. From around the end of last year its monorepo systems struggled, with slow fetches and pushes, failed merges, and reliability at times below 90%[1]. The New Stack reports OpenAI expects quarterly commits to the monorepo to be up more than 2,400% by the end of this year compared with the first quarter of 2024[2].

02 / 05

What Pando does differently

Pando drops two assumptions most Git servers treat as requirements[1]:

  • No repository-wide snapshot. Each branch is updated independently, so pushes to unrelated branches don't wait on each other. The tradeoff is that a client reading several branches may see them at slightly different points in time, which OpenAI says users and agents don't depend on.
  • No custom packfile per client. Instead of compressing a fresh bundle of objects for every fetch, Pando stores each pushed packfile in blob storage and later hands the same packs to every client that needs them.

Pushes are validated while streaming into blob storage, with a small, constant amount of metadata work per push[1]. Fetches return download links through Git's packfile-uri feature, served by a regional cache service called Express with hit rates above 99%, and OpenAI says clones and fetches on standard cloud VMs can saturate 10 Gbps links[1]. Background compaction merges small packs into larger ones, much like a log-structured database, so a client that is far behind doesn't have to download tens of thousands of tiny files[1].

03 / 05

Built by agents in 10 weeks

OpenAI says Pando went from kickoff to production in 10 weeks: one engineer designed the core, teams of Codex agents implemented it in Rust, and it has served production traffic since April[1]. The team wrote a Git conformance test suite so agents could check their changes, used deterministic simulation testing to catch race conditions, and had agents using GPT-6 Astra write Lean and TLA+ specifications to find bugs and prove properties of the system[1].

04 / 05

What goes back to Git

Pando itself isn't being open-sourced[2]. But OpenAI says several of its client fixes, covering concurrent pack downloads, cleanup after interrupted transfers and resumed downloads, are already upstream, with more in its public Git build, including parallel pack indexing and a new "explicit haves" feature[1]. It is also exploring ways to share the underlying technology with its users[1].

05 / 05

Why it matters

Agentic coding multiplies branches, pushes and fetches, and source control is becoming a bottleneck well beyond OpenAI. The New Stack notes Anthropic has gone the other way with a new client and architecture, while OpenAI bet the problem was how Git is served rather than Git itself[2]. If that holds, teams scaling up coding agents may get relief without retraining anyone off git push.

FAQ

Frequently asked questions.

01

What is Pando?

Pando is a new server-side backend for Git repositories that OpenAI built for its monorepo. It keeps the standard Git client and protocol, so engineers and Codex agents still run normal git push and git fetch, but it changes how the server stores and hands out data.

02

Why did OpenAI need it?

OpenAI says Codex lets engineers do far more work in parallel, which means more branches, pushes, merges and fetches. From around the end of last year its old system suffered slow fetches, slow pushes and failed merges, with reliability at times below 90%.

03

What results does OpenAI report?

Median push latency fell nearly 5x (nearly 80%), merge reliability improved, and Pando delivers close to a petabyte of Git data per day. OpenAI says it once served more than 57 terabytes of packs in a single hour, with over 99% of those bytes coming from local disk cache.

04

Can other teams use Pando?

Not yet. OpenAI is not open-sourcing the backend, though it says it is exploring ways to share the technology with users. Several of its Git client fixes are already upstream, and others are in OpenAI's public Git repository and patch tracker.