Discovery Call Script A/B Testing: Compare and Contrast Session

Direct Answer

This training session provides a complete, ready-to-run framework for A/B testing discovery call scripts. You will learn how to design, execute, and analyze controlled experiments using real tools like Gong, Outreach, and Salesforce, with specific scripts and metrics. The session is structured as a 60-minute compare-and-contrast workshop for RevOps and sales teams.

1. Warm-Up (10 min)

Goal: Align on the core problem—why most discovery calls fail to qualify or advance deals.

Facilitator Script:

"Open your CRM. Look at any discovery call from last quarter. How many had clear, documented next steps? How many led to a second meeting? If the answer is under 60%, you have a script problem. Today, we fix that by running a controlled A/B test on two distinct scripts."

Activity:

• Have each attendee share one "dead-end" question they’ve used in discovery (e.g., "What keeps you up at night?").
• Write the worst offenders on a whiteboard.
• Explain that today’s test will replace vague openers with structured, data-backed questions.

Key Insight: A/B testing removes guesswork. Using MEDDIC as a baseline, you can isolate which script moves a deal from "interested" to "committed."

2. Script A: The MEDDIC-First Approach (15 min)

Goal: Present and analyze a script that leads with qualification criteria.

Script A (verbatim):

"Hi [Prospect], thanks for the time. To make sure this is a good fit, I want to quickly cover a few things. First, what metrics are you using to measure success for this initiative? Second, who else is involved in the decision? Third, what’s your timeline for a solution? Let’s start with the metrics."

Why this works: Forces early qualification. According to Winning by Design, deals where the economic buyer is identified in the first call close 2.3x faster. Script A uses MEDDIC (Metrics, Economic Buyer, Decision Criteria, Identify Pain, Champion) to surface deal-killers early.

Common mistake: Sales reps skip the "Decision Criteria" step. If you don’t ask "How will you evaluate options?" in the first 5 minutes, you’ll waste time on unqualified leads.

Activity: Have the group role-play Script A for 3 minutes. One person is the rep, one is a skeptical prospect (e.g., "We don’t share metrics with vendors"). Debrief: "Where did the script break?"

Data point: In a Gong analysis of 10,000 discovery calls, the top 20% of reps asked a qualifying question within the first 90 seconds. Script A does this at 30 seconds.

3. Script B: The Challenger Sale Approach (15 min)

Goal: Present and test a script that leads with constructive tension.

Script B (verbatim):

"Hi [Prospect], I’ve looked at your company’s recent [specific data point, e.g., 20% churn increase]. Most teams in your position try to fix this by [common solution], but that actually makes retention worse. Here’s why—and what we’ve seen work for similar companies. Can I share a 90-second example?"

Why this works: The Challenger Sale framework shows that reps who teach, tailor, and take control outperform relationship-builders by 2:1. Script B creates cognitive dissonance—the prospect must defend their current approach, opening the door for your solution.

Common mistake: Reps soften the tension. If you say "No pressure, but..." you lose the effect. Script B must be delivered with confidence.

Activity: Role-play Script B for 3 minutes. The prospect pushes back: "We already tried that." The rep must double down: "That’s exactly why it failed—let me show you the missing piece."

Data point: In a Salesloft study, calls using a "teach" pattern (like Script B) had a 34% higher conversion to next meeting than calls using a "consultative" pattern.

4. Compare and Contrast: Metrics & Execution (10 min)

Goal: Define how you’ll measure success for both scripts.

Framework: Use Clari to track pipeline velocity. For each script, measure:

• Conversion rate: % of calls that result in a booked second meeting.
• Time-to-qualify: Minutes until the rep identifies the budget, authority, need, and timeline (BANT).
• Deal size: Average ACV of deals that started with each script.

Example comparison table (display on screen):

Key insight: Script B wins on conversion and deal size, but Script A qualifies faster. The best approach might be a hybrid: open with Script B’s tension, then pivot to Script A’s qualification.

Activity: In pairs, discuss: "Which metric matters most for your pipeline right now?" Write down one scenario where Script A would be better (e.g., high-volume SDR team) and one for Script B (e.g., enterprise sales).

5. Designing the A/B Test (5 min)

Goal: Create a controlled experiment using your existing tools.

Steps:

1. Randomize: Use Salesforce lead assignment rules to split new inbound leads into two groups (A and B) based on odd/even lead ID.
2. Script enforcement: Use Outreach cadences to auto-insert the script text into call notes. Reps must read the script verbatim for the first 3 minutes.
3. Track: Log each call in Gong and tag it with "Script A" or "Script B." Gong’s AI will transcribe and score adherence.
4. Duration: Run the test for 2 weeks or until you have 100 calls per script.

Sample Outreach step:

• Step 1: Call prospect. Script: "Hi [Prospect], I’m calling because [Script A or B opener]."
• Step 2: If no answer, send email: "I left a voicemail about [Script A/B topic]. Let’s connect."

Common pitfall: Reps "freestyle" after the first minute. Use Gong to flag any call where the rep deviates from the script within the first 5 minutes. Remove those calls from the data set.

Mermaid diagram: A/B Test Flow

6. Debrief and Next Steps (5 min)

Goal: Extract actionable insights and plan the next test.

Facilitator Script:

"In two weeks, pull a report from Clari showing pipeline velocity by script. If Script B has a 10%+ higher second-meeting rate, adopt it for all enterprise deals. If Script A qualifies faster, use it for SDR teams. But don’t stop here—run a second test with a hybrid script."

Activity: Each attendee writes down one "hypothesis" for a future test (e.g., "What if we add a social proof line to Script B?"). Collect these and prioritize for the next session.

Key takeaway: A/B testing is not a one-time event. Use Gartner’s recommendation: run 3-5 script variations per quarter. The goal is to find the script that reduces time-to-close by 15% while maintaining deal size.

Mermaid diagram: Continuous Improvement Loop

FAQ

Q: How many calls do I need per script for statistical significance? A: At least 50 per script for a 10% difference in conversion rate. Use a chi-square test in Excel to confirm p < 0.05.

Q: What if my reps hate the scripts? A: Frame it as a 2-week experiment, not a permanent change. Use Gong to show them the data—reps will adopt what works.

Q: Can I A/B test more than two scripts at once? A: No. Stick to two to avoid noise. Run sequential tests: A vs B, then winner vs C.

Q: Should I include the script in email follow-ups too? A: Yes, but keep the test isolated. Only change the call script; keep email cadences identical for both groups.

Q: What’s the biggest mistake in discovery call A/B testing? A: Not controlling for rep skill. If one rep is better, their script will win regardless. Randomize leads, not reps. Use Salesforce assignment rules to ensure each rep gets equal numbers of A and B leads.

Q: How do I handle prospects who interrupt the script? A: Log that as a "script deviation" and exclude the call. The script must be delivered as written for the first 3 minutes to count.

Q: Can I use AI to generate script variations? A: Yes, but always test manually first. Tools like Gong can suggest new lines based on top-performing calls, but human judgment is needed to avoid generic language.