A Series D tech company retained us to analyze their post-purchase email ecosystem:
On the surface, everything looked fine. The flagship flow to drive upsells had generated roughly $500K over ten months. Open rates were acceptable. Nobody was flagging it as a problem.
But… buried inside the flow was an A/B test that ran for months longer than it should have. There was a clear winner. Nobody had declared it.
By the time we flagged the losing variant, the undeclared test had cost them about $60K.
The flow wasn't broken. The messaging in the winning variant was right there, ready to go. The leak was invisible because the numbers looked acceptable. (And compared to their baseline, it was.)
This is what "set it and forget it" actually costs.
The A/B test is the obvious version of this problem. The harder version is messaging that's drifted out of alignment with where your market is. And that one doesn't show up in the dashboard at all.
Messaging needs a light refresh every 3–6 months. A full revisit annually. And some market shifts are big enough to trigger an immediate rethink (just think back to 2020).
"Performing" and "performing as well as it could be" aren't the same thing.
The gap between those two is where the damage accumulates, in pipeline, in revenue and in the targets nobody can explain why they're missing.
'Til next week,
Carolyn