What's the right way to interview an AE candidate when you don't have a pipeline they can role-play against?

The Problem\n\nYou're hiring but your pipeline is thin, your funnel is still forming, or you're a startup with 3 demos scheduled. Classic scenario: you can't ask "show us how you'd navigate our buyer journey" because *you don't have one yet*. So how do you assess sale ability without live material to work with?\n\n## The Assessment Framework\n\nSkip the fake role-play. Instead, test these 4 concrete dimensions:\n\n### 1. Historical Deal Anatomy (40 min)\nHave them walk you through their best closed deal in detail—not the happy path, the *actual deal*. Get them to map:\n\n- Deal size, sales cycle length, stakeholders involved\n- Their actual first message to the buyer (show email/call notes if available)\n- The turning point where it went from interest → commit\n- How they handled the longest stall\n- What they'd do differently\n\nThis reveals MEDDPICC rigor, discovery depth, and whether they get why deals close—not just tactics.\n\n### 2. Buyer Conversation Scripts (30 min)\nUse Bridge Group or Pavilion call frameworks. Hand them a scenario: "New prospect, first call, she's comparing us to two others." Ask them to:\n\n- Open the call (actual words, not summary)\n- Ask their first 3 discovery questions\n- Respond to an objection you throw in mid-way\n\nForce Management calls this the "role interview." You're listening for specificity, not charisma—do they probe for pain, or pitch features?\n\n### 3. Pipeline Qualification Logic (20 min)\nGive them 5 prospect profiles (brief, real-world flavors: early-stage founder, enterprise ops manager, skeptical CFO, booked-solid VP). Ask:\n\n- Who's your #1 bet to close in 90 days?\n- Who do you avoid?\n- How would you sequence outreach?\n\nOpenView research shows strong AEs qualify *out* as often as in. You're checking if they focus or spray.\n\n### 4. Topgrading Structured Interview (15 min)\nUse Topgrading's STAR format:\n\n- Situation: "Tell me about a deal you lost. Why?"\n- Task: "What were you trying to do?"\n- Action: "What did you actually do?"\n- Result: "What happened? What did you learn?"\n\nTransparency here beats polish. Real reps own losses; weak ones blame leads or marketing.\n\n## Scoring Rubric\n\n| Dimension | Strong Signal | Weak Signal |\n|-----------|---------------|-------------|\n| Deal Fluency | Recalls details, cites numbers, knows the stumbles | Glossy summary, avoids hard parts |\n| Discovery | Asks follow-ups, digs for problems | Pitches immediately, closes early |\n| Qualification | Clear ICP, says "no," prioritizes | Pursues all inbound equally |\n| Resilience | Names losses, extracts lessons | Blames org, repeats same playbook |\n\n## Why This Works Without Your Pipeline\n\nYou're not assessing "can sell to *our* buyer." You're assessing "can sell"—the fundamentals are portable. A strong AE shows up with deal architecture, buyer psychology, qualification discipline, and self-awareness. Weak signals are vague, over-polished, or externally attributed.\n\n## The Mermaid Diagram\n\n``mermaid\nflowchart TD\n A["New AE Candidate"] --> B{"Historical Deal\nConversation?"}\n B -->|Deep, specific| C["Strong Signal"]\n B -->|Vague, glossy| D["Red Flag"]\n A --> E{"Discovery Depth\nin Buyer Scenarios?"}\n E -->|Probes for pain| F["Strong Signal"]\n E -->|Pitches features| D\n A --> G{"Qualification\nLogic Clear?"}\n G -->|Focuses, says no| F\n G -->|Pursues all leads| D\n A --> H{"Owns Losses or\nBlames Org?"}\n H -->|Self-aware| F\n H -->|External blame| D\n C --> I["Hire"]\n D --> J["Pass"]\n F --> I\n``\n\n## Key Vendors\n\nBridge Group and Pavilion publish AE interview playbooks. Force Management trains your interview panel. Topgrading formalizes the reference process. SaaStr calls this "selling into the unknown"—proven AEs adapt fast because they understand process, not just your product.\n\n---\n\nTAGS: hiring,acrylics,interview-design,qualification,deal-architecture,buyer-psychology,topgrading,force-management,pavilion,bridge-group,openview
Anchor Citations
- CB Insights State of Venture / Sales Tech: https://www.cbinsights.com/research/
- Bessemer Cloud Index + State of the Cloud: https://www.bvp.com/atlas/state-of-the-cloud
- Crunchbase News (funding + M&A): https://news.crunchbase.com/
- SaaS Capital industry survey + valuation: https://www.saas-capital.com/research/
- PitchBook venture + private markets: https://pitchbook.com/news
- a16z Marketplace / SaaS frameworks: https://a16z.com/category/saas/
Operator Benchmarks (2025 Data)
| Metric | Verified figure | Source |
|---|---|---|
| Median SDR fully-loaded cost | $95K-$130K/yr | Pavilion + BLS |
| Median outbound SDR meetings/mo | 8-14 | Bridge Group 2025 |
| Median LinkedIn InMail response | 8-14% | LinkedIn Sales |
| Median cold email reply (warm list) | 6-11% | Outreach/Apollo |
| Median demo-to-close (mid-market) | 24-32% | OpenView |
| Median deal cycle ($25-100K ACV) | 45-90 days | Bridge Group |
| Median pipeline-to-quota coverage | 3.5-4.5x | Pavilion |
| Median CAC inbound-led SaaS | $8K-$15K | OpenView PLG |
| Median CAC outbound-led SaaS | $22K-$45K | Bridge + OpenView |
The Bear Case (Operational Concentration)
Three concentration risks:
- Customer concentration — any single >20% of revenue is asymmetric.
- Channel concentration — 60%+ from one channel is existential.
- Geographic concentration — NA-centric exposed to NA macro/regulatory.
Mitigation: customer top-1 < 20%, channel top-1 < 40%, geography top-region < 70%.
See Also (related library entries)
Cross-references for adjacent operator topics drawn from the current 10/10 library set, ranked by tag overlap with this entry:
- q1593 — Is Snowflake certification worth it in 2027?
- q1136 — How do you handle a discovery call where the buyer brings 6 stakeholders and you only planned for 1?
- q241 — How do you handle a buyer who insists on monthly contracts when your standard is annual?
- q164 — How do I scale from 5 reps to 25 without losing culture?
- q125 — What metrics tell me a sales manager isn't going to scale past 8 reps?
- q36 — How do I tell the difference between a stalled deal and a dead deal?
Follow the q-ID links to read each in full.
FAQ
What are the four dimensions to test when there's no pipeline to role-play against? Test historical deal anatomy (40 min), buyer conversation scripts (30 min), pipeline qualification logic (20 min), and a Topgrading structured interview (15 min). Skip the fake role-play entirely.
You are assessing whether the candidate can sell at all, since the fundamentals are portable across buyers.
How does the historical deal anatomy portion work? Have the candidate walk you through their best closed deal in real detail, not the happy-path summary. Get them to map deal size, cycle length, stakeholders, their actual first message to the buyer, the turning point from interest to commit, and how they handled the longest stall.
This reveals MEDDPICC rigor, discovery depth, and whether they understand why deals close.
What does the Topgrading STAR format ask? It uses Situation ("Tell me about a deal you lost. Why?"), Task ("What were you trying to do?"), Action ("What did you actually do?"), and Result ("What happened? What did you learn?"). Transparency here beats polish. Real reps own their losses, while weak ones blame leads or marketing.
Why give candidates five prospect profiles to qualify? You hand them five real-world profiles, like an early-stage founder, enterprise ops manager, skeptical CFO, and booked-solid VP, then ask who is their number-one bet to close in 90 days, who they avoid, and how they sequence outreach.
OpenView research shows strong AEs qualify out as often as in. You are checking whether they focus or spray.
Which vendors publish the interview frameworks referenced here? Bridge Group and Pavilion publish AE interview playbooks and call frameworks. Force Management trains your interview panel and runs what they call the "role interview." Topgrading formalizes the reference process, and SaaStr frames this as "selling into the unknown."
