How do you measure whether a rep comp redesign actually improved deal quality vs just hitting revenue number through the same old discounting behavior?

Quick take: Measure deal quality with a four-metric scorecard tracked over 4-6 quarters post-redesign: (1) average discount %, (2) gross margin per deal, (3) 18-month logo churn for new deals, and (4) net dollar retention on the cohort. If revenue is up but discount % is also up, churn is rising, or NRR is declining on the new cohort, the comp redesign didn't change behavior — it just renamed the same outcome.

The Detail

The most common comp-redesign trap: the CRO announces a new plan, the rep team grumbles for 6 weeks, attainment looks identical after one quarter, the CRO declares victory. But underneath, the reps are still discounting at the same rate, still chasing the same low-quality logos, still closing what they would have closed anyway. Six quarters later, NRR drops and the board asks why. The answer: the new comp plan didn't actually shift incentives in a measurable way.

The Four-Metric Quality Scorecard

Track each one for the 4 quarters BEFORE the redesign and 4-6 quarters AFTER.

Metric 1: Discount % distribution (not average). Don't just track the mean. Track the 25th, 50th, 75th, and 90th percentile of discount % across new deals, by segment. A redesign that aims to tighten discount discipline should compress the upper tail — the 90th percentile should drop. If the mean drops but the 90th percentile is unchanged, your top discounters are unaffected.

Metric 2: Gross margin per deal (NEW logos only). Calculate fully-loaded GM: revenue minus COGS minus implementation cost minus customer success ramp. A healthy redesign moves median new-logo GM up by 3-7 points in the first 2 quarters and holds it.

Metric 3: 18-month logo churn on the new cohort. This is the lagged metric. Track every deal closed in the 12 months post-redesign and follow them through their 18-month mark. Compare logo churn rate to the cohort from the 12 months pre-redesign. Bad comp design that rewards "any logo" produces logo cohorts with 15-25 point higher churn at 18 months. This metric takes 2 years to fully resolve, but you'll see signal at 9-12 months.

Metric 4: NRR on the cohort. For each pre/post cohort, track 12-month NRR. A comp plan that incentivizes the wrong kind of expansion (e.g., one-time add-ons rather than seat growth) shows up here.

What the Scorecard Looks Like

If all five rows trend favorably, the comp redesign worked. If revenue/attainment is up but discount/GM/NRR is flat or worse, the rep team gamed the new plan.

The Diagnostic Flow

How Rep Behavior Gets Gamed

The classic patterns when the rep team finds a way around the new plan:

1. Over-rotating into low-friction segments. New plan tries to push enterprise; reps load up on SMB because the deals close faster, and the team hits attainment without changing motion.
2. Selling future commitments. Multi-year deals with backloaded ramps boost first-year ACV credit while hiding eventual churn.
3. Discounting via add-ons instead of subscription line. Reps preserve the subscription price (which the plan rewards) by deepening discount on services or implementation, which doesn't show in the dashboard.
4. Sandbagging the new quarter. Reps push deals across the fiscal boundary so the new plan starts with weak Q1 (forcing relief or accelerators).
5. Coaching customers to delay renewals to match new comp incentives. Especially common when comp shifts from booking to renewal credit.

The four-metric scorecard catches all five of these.

Vendors and Tooling

• CaptivateIQ or Xactly Incent — comp administration with pre/post scenario modeling.
• Salesforce CPQ + Reports — discount distribution and price realization data.
• Gainsight or ChurnZero — track logo churn and NRR on cohorted basis.
• Tableau, Looker, or Salesforce CRM Analytics — for the cohort comparison dashboards.
• Gong — pull rep call data to see if the rep's discovery and discounting language actually changed. This is a leading indicator of comp behavior change.

The Six-Quarter Patience Test

Boards and CFOs want answers in one quarter. Resist. Comp redesigns take 4-6 quarters to fully manifest because:

• Reps need 1-2 quarters to internalize the new plan.
• The lagged metrics (churn, NRR) require time to accumulate cohort data.
• New deal cohorts need their own renewal cycle to show retention dynamics.

Publish a 6-quarter dashboard to the board with monthly trend lines. Resist the urge to declare success early. Pavilion's 2025 GTM Comp data: 60% of comp redesigns that "worked" in quarter 2 had measurable behavioral regression by quarter 6 if they weren't tracked rigorously.

What the CRO and CFO Should Ask Together

Every quarter post-redesign, the CRO and CFO sit down with this dashboard. They ask:

• Did revenue come from the segments and motions we wanted to incentivize?
• Did the upper-tail discount compress, or just the mean?
• Is the new-logo cohort showing healthy renewal signals?
• What rep behavior changed (qualitatively, from Gong + 1:1 notes)?

If they can't answer all four with data, the comp redesign isn't measured rigorously enough.

Sources

• Pavilion 2025 GTM Compensation Report: https://www.joinpavilion.com/compensation-report
• OpenView SaaS Benchmarks (Comp): https://openviewpartners.com/blog/saas-benchmarks/
• Gartner Sales Research: https://www.gartner.com/en/sales/research
• Bridge Group — Sales Comp: https://www.bridgegroupinc.com/blog
• SaaStr — Comp Surveys: https://www.saastr.com/
• Bessemer Atlas — Sales Comp Memos: https://www.bessemerventurepartners.com/atlas

Comp redesigns that look like they worked at quarter 2 and didn't work at quarter 6 are the most expensive kind of org change — measure for six quarters, not one.

TAGS: comp-redesign, deal-quality, comp-effectiveness, nrr-tracking, comp-design