Home/Blog/7 Localization KPIs Every Engineering Manager Should Track Weekly
Metrics

7 Localization KPIs Every Engineering Manager Should Track Weekly

Your last localization launch slipped by six weeks. Your team told you it was "just some translation issues". Your CFO asked what the return was. You did not have a number.

That is a measurement problem. Localization is not immune to metrics. It just needs the right seven.

Why should engineering managers track localization KPIs?

Because localization is a system that decays silently. New features ship in English on Monday. They are late to German by Friday. Nobody notices until the next launch review, when everyone realizes German is quietly 60 percent covered instead of 99. Support tickets ramp. A strategic customer complains. The problem has been compounding for a month, but the first signal reached you on the last day.

KPIs turn that lag into a live signal. The seven below are the smallest set that cover the failure modes engineering managers actually own: coverage, speed, quality, cost, and process health.

KPI 1: What is locale coverage percentage per surface?

Locale coverage is the share of source-language keys that have an approved translation in each target language, broken down by surface (billing, onboarding, product, help). Not the app-wide average. Surface-specific.

Track it weekly. Publish it as a dashboard.

  • Tier 1 languages, revenue surfaces. Target 99 percent. Anything less is a live incident.
  • Tier 2 languages, revenue surfaces. Target 95 percent.
  • Tier 3 languages, any surface. Target 70 percent, with a plan to raise as usage grows.
  • All languages, marketing surfaces. Track but do not gate releases on this.

The mistake is tracking a single app-wide coverage number. It hides the fact that your billing page is 100 percent German and your onboarding is 40 percent German.

KPI 2: What is translation latency?

Translation latency is the time between a source-string change landing on main and the corresponding translation reaching production in the target locale. Measure it end-to-end, not just the reviewer step.

Target ranges:

  • Tier 1 languages. Under 72 hours, 90th percentile.
  • Tier 2 languages. Under 5 business days, 90th percentile.
  • Tier 3 languages on MT. Under 24 hours, 90th percentile (MT is fast, so any slippage is pipeline lag).

The 90th percentile matters, not the median. Median hides the strings that block launches. If your median is 24 hours but your 90th percentile is two weeks, you have a serial reliability problem, not a translation problem.

KPI 3: What is the defect rate per 1000 strings?

Defect rate is the number of user-visible translation defects that reach production per 1000 strings, tagged by language and surface.

A defect is any of:

  • Placeholder mismatch that breaks rendering
  • Missing translation showing English fallback
  • Layout overflow that breaks the page
  • Terminology that violates the glossary
  • Translation that is factually or semantically wrong

Target ranges:

  • Mature pipeline with CI checks and screenshot review. Under 1 defect per 1000 strings.
  • New pipeline, first six months. Under 3 per 1000.
  • Spreadsheet workflow. Expect 4 to 8 per 1000. This is the baseline you are moving away from.

Measure quarterly, not weekly. Weekly noise dominates the signal on this one.

KPI 4: What is the cost per locale per quarter?

Break costs into three components: translation service fees, human reviewer time, and engineering time spent on localization plumbing. All three go in.

  • Mature pipeline. $3K to $10K per language per quarter, including reviewer time.
  • Spreadsheet workflow. $15K to $40K per language per quarter, mostly in hidden engineering time.
  • First language of the year. Add $30K to $80K for pipeline setup, then amortize.

If your cost per locale is not trending down over time, your pipeline is not scaling. Every new language should cost less to onboard than the previous one, because the marginal cost is translation only.

KPI 5: What is the CI failure rate on locale checks?

Percentage of pull requests that fail CI because of a locale check (missing translation, placeholder mismatch, plural coverage, layout overflow, glossary violation).

Track it weekly. Target range:

  • Healthy. 2 to 5 percent of PRs blocked by locale checks. This is friction working as intended.
  • Too high (over 10 percent). Either your checks are too strict or your developers do not know how to write locale-safe code. Add tooling or docs, do not weaken the checks.
  • Too low (under 1 percent). Your checks are not catching real defects. Increase strictness or add more check categories.

Zero percent is a warning sign, not a win. It means the checks are ornamental.

KPI 6: What is the reviewer queue depth?

Number of strings in each human reviewer's queue, per language, updated daily.

This is the leading indicator on the whole system. When queues grow for three consecutive days without draining, everything downstream degrades within a week. Track it aggressively.

Actions when the queue grows:

  • Queue over 500 strings, one reviewer. Add capacity or reroute lower-risk surfaces to MT.
  • Queue over 1500 strings. Halt non-critical string additions in that language until the queue is under 500.
  • Queue consistently under 50. Reviewer has excess capacity. Move them to a higher-risk language or expand the scope of what they review.

The failure mode is treating reviewers as infinite. They are not. The queue is your feedback loop.

KPI 7: What is the locale-tagged support ticket volume?

Number of support tickets per week that reference a specific locale, either explicitly ("the German page says...") or by user language preference.

This is your after-the-fact quality signal. Track by locale, by surface, by ticket category.

  • Baseline. Locale-tagged tickets should scale roughly linearly with locale user count.
  • Warning sign. A single locale has 3x the ticket rate of comparable locales. This usually means one specific surface is broken, not that the whole language is bad.
  • Bad sign. Locale-tagged ticket volume grows week over week without new locale launches. Your pipeline is drifting.

The strategic customer complaining is not a data point. The pattern of six unrelated customers complaining about the same surface is.

The mistake to avoid

Most engineering teams treat localization as unmeasurable because it feels qualitative. It is not. Every one of the seven KPIs is a hard number with a clear collection method and a defensible target range. The teams that treat localization quality as an engineering discipline, with dashboards and targets, ship faster with fewer defects and lower cost per language. The teams that treat it as a translator problem still think they cannot control the outcome. Track the seven. Publish them. Review them weekly. The rest is execution.

localization-kpisi18n-metricsengineering-managementtranslation-qualityrelease-management

Frequently asked questions

Why do most engineering teams not track localization KPIs?

Because localization is invisible until it breaks. There is no line item on the sprint board called 'German locale drift', and there is no dashboard by default. The team ships a language, moves on to the next feature, and only revisits localization when a customer complains or a launch slips. KPIs make the invisible visible, which is the entire point.

How often should we review these KPIs?

Weekly for latency, coverage, CI failure rate, and reviewer queue depth. Monthly for defect rate and support ticket volume. Quarterly for cost per locale, tied to your budgeting cycle. The cadence matches how quickly each metric can move: latency and queue depth change day to day, cost per locale barely moves inside a quarter.

What are healthy target ranges for these KPIs?

Coverage: 99 percent for tier-1 surfaces, 90 percent for tier-2, 70 percent for tier-3. Latency: under 72 hours from source change to production for tier-1 languages. Defect rate: under 1 per 1000 strings. Cost per locale: $3K to $10K per language per quarter for mature pipelines. CI failure rate: under 5 percent of PRs blocked by locale checks. These are healthy operating ranges, not stretch goals.

How do we measure translation latency in practice?

Timestamp every string at four events: source change on main, MT draft complete, human review complete, production deploy or over-the-air publish. The difference between the first and last timestamps is your end-to-end latency. Tag each timestamp with the language so you can slice the metric. Median latency matters less than the 90th percentile, because the long-tail strings are the ones that block launches.

Which of the 7 KPIs is the leading indicator of trouble?

Reviewer queue depth. It moves first, days before latency or coverage degrade. When a reviewer's queue grows for three consecutive days without draining, everything downstream will slip within a week. It is also the most actionable, because you can add reviewer capacity or reroute strings to MT with less friction than fixing coverage after the fact.

Ship every language the day you ship English

Thalarum syncs strings from your repo, drafts translations with your glossary, routes review, and blocks broken releases in CI.

Request early access