Creator & Conversion

Conversion Rate Is a Terrible Bonus Target. I Pay for the Story Instead.

By Thomas Robinson · Oct 12, 2026 · 5 min read

Conversion chart beside a notebook — creator and conversion cover, DirectToGrowth Co.

A founder told me recently they had tied their CRO agency's bonus to site conversion rate. "Simple," they said. "If conversion goes up, they get paid."

I asked what happened in the month they ran a 30%-off sale. Conversion rate jumped. The agency got its bonus. Nobody had shipped a single test that month.

Conversion rate is one of the most important numbers in ecommerce and one of the worst numbers to pay people on. It moves for a dozen reasons the landing page team does not control, and it can go up while the business gets worse. I have watched the same thing run the other way on Meta: in-console ROAS got worse for a while, blended new-customer CAC fell and new-customer volume grew. A ratio is an input, not the scoreboard.

So I pay a landing page team for the story instead: revenue-per-visitor impact measured inside a test, what the test taught us about the customer, and whether that learning got used anywhere else.

If you pay for a number someone can't control, you'll get either luck or gaming. Usually both.

Everything that moves conversion rate that isn't the page

What changedWhat happens to conversion rateDid the page team do it?
A sitewide saleUp, often sharplyNo
More prospecting spend on cold audiencesDown — new visitors convert lowerNo
Retargeting budget increasedUp — warm visitors convert higherNo
Hero product goes out of stockDownNo
Influencer post sends a traffic spikeOften down on the day, then upNo
A new test on the product page winsUpYes

One row out of six. Pay on blended conversion rate and you are mostly paying for the media plan, the merchandising calendar and the weather.

It's also easy to game

There are three quick ways to raise conversion rate. Cut prospecting traffic. Push more discount codes. Take the higher-priced products off the landing page. Each of those lifts the ratio and can hurt revenue, average order value or margin, and a team bonused on the ratio is quietly rewarded for all three.

What I pay for instead: the story

When I set up incentives for a landing page or CRO team, in-house or agency, I pay for three things that together make up the story of the work.

1. Impact: a tested change made money

Measured inside a proper A/B test, against a control, on revenue per visitor rather than conversion rate alone. Revenue per visitor catches the tricks: if a change lifts conversion by pushing cheaper products, revenue per visitor tells on it. Only tests that reach the sample size agreed in advance count, and every test is judged on the same measure.

2. Learning: we know something we did not know before

Most tests lose. That is normal, and a team that is punished for losing tests stops running brave ones. So I reward clear learning: a written hypothesis before the test, a result after it, and a one-paragraph answer to "what does this tell us about our customer?" A well-documented loss that kills a bad idea for the whole company is worth paying for.

3. Follow-up: the learning got used

The best CRO programs compound. A winning headline angle gets carried into the ads, the emails and the next landing page. I pay the team when a learning gets rolled out beyond the page it was tested on, because that is where the money is. On the ad side, pointing every ad at one testing link lets the page change while the ad stays put; I walk through it in how I write Meta ad copy.

How I weight it, and what moves the weights

  • Half on impact: total revenue-per-visitor lift from shipped winners, measured in-test and checked again after rollout for long enough to see past launch noise. Two weeks has been my minimum.

  • A quarter on learning: a quarterly review of the test log. Hypotheses written up front, results recorded, insights stated plainly.

  • A quarter on follow-up: learnings that were rolled out to ads, email or other pages.

Those weights are a working split from programs I have run, not a formula. A new program on a low-traffic site rarely reaches sample size, so it earns more on learning and follow-up until it can. A mature one with a backlog of proven winners earns more on impact and on rolling them out.

Keep blended conversion rate on the dashboard. Watch it every week. Just don't put a bonus on it.

The monthly test report I ask for

  1. Tests launched, tests concluded and tests still running.

  2. For each concluded test: hypothesis, result on revenue per visitor and confidence.

  3. What we learned about the customer, in one sentence.

  4. Where that learning is being used next.

What I would tell a CEO: you do not want a team that makes a number go up. You want a team that makes your understanding of the customer go up, because that is what keeps paying after the test is over. Pay for the story, and judge the whole program the way finance will: revenue per visitor inside the tests, blended new-customer CAC outside them.

FAQ

Should a CRO agency's bonus be tied to conversion rate?

Not to blended site conversion rate. It moves with sales, traffic mix, stock and the merchandising calendar, none of which the agency controls, and a team paid on it is rewarded for cutting prospecting and pushing discounts. If you want a performance component, measure it inside A/B tests on revenue per visitor against a control.

What should a landing page team be measured on instead of conversion rate?

Inside the tests, revenue per visitor against a control, with the sample size agreed before the test starts. Outside them, the numbers finance already watches: blended new-customer CAC and new-customer volume. Conversion rate stays on the dashboard as an input; it just does not carry the bonus.

How do you structure a CRO bonus?

Impact from shipped winners, documented learning, and follow-up where a learning gets used in ads, email or other pages. The weights depend on the program: a low-traffic site that rarely reaches sample size earns more on learning and follow-up; once there is a backlog of proven winners, impact carries more.

Seeing this in your own numbers?

A free 20-minute intro call. Bring what you have and I’ll tell you where I’d look first.

Book an intro call