We rolled out AI‑written button labels on iOS, and first‑day NPS fell 2 points while conversion stayed flat. The mobile keyboard seems to mis‑interpret certain verb‑noun combos. Should we train the model on platform‑specific tone or keep human‑crafted copy for touch devices?
I tried a hybrid: keep core verbs human, let model tweak adjectives. It improved NPS by 1 point.
Did you segment NPS by device? I saw iPad users drifted more; maybe layout changes affect wording.
The flat conversion suggests users don't care about wording; maybe focus on speed first.