10 to the 23 AI logo

Domain Atlas / Software engineering AI (coding assistants)

Case fileUnited States (large technology company; internal platform deployment)giant deployment

In-house code completion (one org owns every node)

Explore this deployment in the PAN Lab ↗

An in-house machine-learning code-completion system built, deployed, and measured by a company's own platform organization for more than 10,000 internal developers reported, against a control group, a 25 to 34 percent suggestion-acceptance rate, a 6 percent reduction in coding iteration time versus control, and 3 percent of new code characters coming from the model at the time of measurement. The measuring party, the building party, and the deploying party were the same organization, and the numbers were published as an engineering-blog self-report rather than a peer-reviewed or independent evaluation.[]

What happened

This case is the platform-team pole of the software-engineering domain: an in-house machine-learning code-completion system built, deployed, and measured by Google's own platform organization for more than 10,000 internal developers. Measured against a control group, it reported a 25 to 34 percent suggestion-acceptance rate, a 6 percent reduction in coding iteration time versus control, and 3 percent of new code characters coming from the model at the time of the published measurement.

The structural point is unification. One organization owns every node: the model is built in-house, the store is the shared monorepo whose code both trains and contextualizes the model, the gates are the company's code-review and testing culture that predates the assistant, and the telemetry is defined by the platform team. That is a genuine strength — governance and performance levers all sit inside one boundary, so the organization can in principle tune the whole loop end to end, something none of the vendor-tool deployments can do. It is also the risk. When the party that builds the model, the party that deploys it, and the party that measures it are the same organization, there is no external check at all, and the published numbers are an engineering-blog self-report rather than a peer-reviewed or independently reproduced evaluation.

The honest counterweight is supplied by the same company's cross-industry research program, which found that AI-assisted development amplifies an organization's existing strengths and weaknesses rather than substituting for them, and identified policy clarity and platform investment as the levers that decide whether adoption helps or hurts delivery. That is the composition bound in this deployment's own idiom: the individual acceptance and iteration-time gains do not become an organization-level outcome on their own; the existing gates and platform quality — which this organization happens to own outright — are what determine the result.

The sociotechnical reading

Every other case in this domain has a seam between parties — a vendor and a deployer, an academic team and a firm. This one has none, and that is exactly what makes it worth modeling. One organization owns the model, the repository, the review gates, and the telemetry. The upside is real and rare: the whole loop is inside one boundary, so the organization can tune the model, the corpus, the gates, and the measurement together, and it inherited a strong code-review culture that predates the assistant. If any deployment can make the individual gain compose to the organizational outcome, it is this one, because it controls every lever the composition bound names.

But the same unification removes the one thing every other case has by accident: an outside party. When the builder, the deployer, and the measurer are the same organization, the numbers are a self-report, and there is no external check that could find what an internal evaluation is not looking for. That is not an accusation of bad faith — the control group and the published methodology are more than most deployments offer — it is a structural fact about who can see the result. The governable move here is the one the organization cannot supply to itself: an external validation, a reproduction by a party with no stake, the check that unification designs out. And the composition bound still applies in the org's own research idiom: AI amplifies what the organization already is, so the gates and platform quality it owns are what decide whether the acceptance rate becomes better software or just more of it. The map's instruction is that owning every node is both the ideal governance position and the one where the missing check is hardest to notice, precisely because everything is already inside. The honest boundary throughout: no product outcome is modeled on the Lab diagram. The users of the software are boundary-only; acceptances, merges, and telemetry are institutional signals, and the acceptance rates and iteration-time figures live in the case file, never on any network.

The concepts used in this reading are defined in the Field Guide; the governance responses live in the Practice Library. The model organization for this case can be stress-tested in the PAN Lab.

Grounding sources for this case

The same sources that ground this model organization in the PAN library: evaluations, government documents, investigative reporting, and advocacy documentation, each labeled by tier.

tabachnyk2022GroundingVendorSave

Tabachnyk, M., & Nikolov, S. (2022). ML-Enhanced Code Completion Improves Developer Productivity. Google Research Blog. https://research.google/blog/ml-enhanced-code-completion-improves-developer-productivity/

https://research.google/blog/ml-enhanced-code-completion-improves-developer-productivity/

Appears in: PAN framework development

Grounds: domain grounding: software engineering AI (coding assistants, code review); model org: google_internal_code_completion

googleclouddora2025GroundingReferenceSave

Google Cloud DORA (2025). State of AI-assisted Software Development (2025 DORA Report). https://dora.dev/dora-report-2025/

https://dora.dev/dora-report-2025/

Appears in: PAN framework development

Grounds: domain grounding: software engineering AI (coding assistants, code review); model org: google_internal_code_completion

Seeing your organization in this case file?

The histories here are documented after the harm. Mapping a live deployment's pathways and pressures, before the incident report, is engagement work: intake, diagnosis, prescription, and monitoring, with every limitation stated.

Sources & Evidence

Claims made on this page and what supports them. The full registry lives in Evidence.

EmpiricalAn in-house machine-learning code-completion system built, deployed, and measured by a company's own platform …

An in-house machine-learning code-completion system built, deployed, and measured by a company's own platform organization for more than 10,000 internal developers reported, against a control group, a 25 to 34 percent suggestion-acceptance rate, a 6 percent reduction in coding iteration time versus control, and 3 percent of new code characters coming from the model at the time of measurement. The measuring party, the building party, and the deploying party were the same organization, and the numbers were published as an engineering-blog self-report rather than a peer-reviewed or independent evaluation.

tabachnyk2022GroundingVendorSave

Tabachnyk, M., & Nikolov, S. (2022). ML-Enhanced Code Completion Improves Developer Productivity. Google Research Blog. https://research.google/blog/ml-enhanced-code-completion-improves-developer-productivity/

https://research.google/blog/ml-enhanced-code-completion-improves-developer-productivity/

Appears in: PAN framework development

Grounds: domain grounding: software engineering AI (coding assistants, code review); model org: google_internal_code_completion

EmpiricalThe same company's cross-industry research program reported that AI-assisted software development amplifies an…

The same company's cross-industry research program reported that AI-assisted software development amplifies an organization's existing strengths and weaknesses rather than substituting for them, with policy clarity and platform investment identified as the levers that determine whether AI adoption improves or degrades delivery — evidence that the individual coding gains do not compose to organization-level outcomes on their own, and that the deploying organization's existing gates and platform quality are what decide the result.

googleclouddora2025GroundingReferenceSave

Google Cloud DORA (2025). State of AI-assisted Software Development (2025 DORA Report). https://dora.dev/dora-report-2025/

https://dora.dev/dora-report-2025/

Appears in: PAN framework development

Grounds: domain grounding: software engineering AI (coding assistants, code review); model org: google_internal_code_completion