kobotoolbox / kpi / 27415076380

81%

master: 76%

Build Type

push

github

Committed by web-flow

Commit Message

feat(nlp): implement Google API US/EU region routing for Speech-to-Text and Translation DEV-2199 (#7128)

### 📣 Summary
This PR implements the server-wide Google ASR/MT location setting to
enforce strict EU data residency or utilize global US infrastructure for
Speech-to-Text (v2) and Translation (v3) APIs.

### 📖 Description
Following the parallel switch to Google Cloud Speech-to-Text v2 and
Translation v3, the previous ASR/MT region control setting (from
DEV-1943) was no longer functional. This PR re-establishes the
server-wide US/EU location toggle and ensures requests are routed to the
correct regional or global endpoints based on that configuration.

#### Speech-to-Text (ASR) Updates:
- The Google location is dynamically set to `us` or `eu` depending on
the server-wide `ASR_MT_GOOGLE_REGION` setting.

#### Translation (MT) Updates:
- EU traffic is explicitly routed through the dedicated
`translate-eu.googleapis.com` multi-regional gateway and processed in
`europe-west1`. This guarantees that TLS termination, processing, and
data-in-transit remain entirely within European borders.
- US traffic is routed through `translate-us.googleapis.com` +
`us-west1`.

#### Constance setting:
- Consolidated the legacy `ASR_MT_GOOGLE_TRANSLATION_LOCATION` setting
(which tracked granular locations like `us-central1` or `europe-west1`)
into a new `ASR_MT_GOOGLE_REGION` Constance setting that provides a
straightforward US or EU toggle.

#### Region code fallback fix (pre-existing bug):

- `TranscriptionService.get_language_code()` and `get_configuration()`
previously raised `LanguageNotSupported` for any region code not
explicitly listed in the database (e.g. `fr-BE`, `de-AT`). The check
`language_set.filter(code='fr-BE')` always returned false because
`fr-BE` is a region code, not a language code.
- Fixed: both methods now extract the parent language code (`fr` from
`fr-BE`) as a fallback. If the parent language is supported, the
original region code is passed thr... (continued)

Coverage Stats

9245 of 12483 branches covered (74.06%)

23 of 56 new or added lines in 5 files covered. (41.07%)

427 existing lines in 24 files now uncovered.

30548 of 37252 relevant lines covered (82.0%)

5.72 hits per line