How to Choose a Cold Email Agency

Most buyers evaluate cold email agencies the wrong way. They look at case studies, Google the agency name, check a few reviews, and make a decision. Then 90 days later they wonder why they are paying $5,000 a month for 2 meetings. This guide covers the 8 criteria that actually separate good agencies from bad ones -- and 10 specific questions to ask in the sales call that will tell you everything you need to know.

The 8 Evaluation Criteria

1. ICP Specificity

Ask the agency how they define your ICP. Vague answers -- 'B2B SaaS companies, 50-500 employees' -- signal template-based execution. Strong agencies define ICP with signals: companies that recently raised Series B, expanded their sales team in the last 90 days, and use Salesforce. That specificity gets 3-5x the reply rate of industry + headcount targeting.

2. Infrastructure Ownership

Who owns the domains and mailboxes? This is the highest-stakes question in any agency evaluation. There are two models. First: the agency builds dedicated infrastructure in your name -- domains you own, mailboxes connected to your systems. When you leave, you keep the assets. Second: the agency sends from their shared infrastructure, routing replies through forwarding setups. Your deliverability is tied to their other clients' behavior. One bad client in their pool damages your campaigns.

3. Copy Quality

Do not ask for case studies. Ask for real email examples sent to clients in your industry in the last 60 days. Case studies are curated. Real emails are not. Look for: specific personalization hooks (not 'I noticed you work at X'), a clear and credible value statement, one ask at the end (not a multi-question close), and no corporate language. If they cannot share examples without a lengthy NDA process, they are hiding generic copy.

4. Metrics They Report

Agencies that lead with open rates are hiding behind vanity metrics. Open rates measure deliverability, not campaign quality. The only metrics that matter: meetings booked, cost per qualified meeting, and show rate on booked meetings. If an agency cannot tell you their average cost per qualified meeting across clients, they either do not track it or the number is bad.

5. Technology Stack

Ask what tools they use for contact discovery, enrichment, and copy generation. Apollo export + mass send is a 2022 approach. Strong agencies use Clay or equivalent for signal-based targeting, AI enrichment to generate personalized copy at scale, and dedicated sequencing tools with deliverability monitoring. The stack signals how much they invest in doing the work well versus how much they rely on list purchasing.

6. Timeline to Live Campaigns

Domain warmup takes 2-3 weeks minimum. Any agency promising live campaign sends within 2 weeks of kickoff is either skipping warmup or sending from pre-warmed shared infrastructure. The right timeline: Week 1 (ICP workshop + account list), Week 2-3 (domain purchase + DNS + warmup starts), Week 3-4 (copy written + reviewed), Week 4-5 (first sends). That is 4-5 weeks from kickoff to first emails out.

7. Contract Terms

Check three things. First, lock-in length -- 3 months is reasonable; 6-12 months with no performance clause is a risk. Second, performance exit -- can you cancel with 30 days notice if the agency misses an agreed meeting threshold for two consecutive months? Third, data ownership on exit -- do you get your contact list, copy templates, and campaign data when you leave? Some agencies retain this as proprietary. That is unacceptable.

8. Team Structure

Ask who writes your copy and who manages your campaigns day-to-day. Agencies with 10 clients per account manager are running a volume business, not a quality business. The person who sold you the engagement should be able to name the specific copywriter and campaign manager assigned to your account. If those are different people from the ones on the sales call, ask to meet them before signing.

Red Flags

10 Questions to Ask in the Sales Call

1. 1Can you share 3 real email examples sent to clients in my industry in the last 60 days? (Not case studies -- actual emails.)
2. 2Do you purchase domains in our name, or do you send from your infrastructure?
3. 3How do you define a qualified meeting, and is that definition in the contract?
4. 4What is your average cost per qualified meeting across current clients?
5. 5What is your typical show rate on booked meetings?
6. 6Who specifically will write our copy and manage our campaigns? Can I meet them before we sign?
7. 7How many accounts does our campaign manager handle simultaneously?
8. 8What happens to our domain infrastructure, contact lists, and copy if we end the engagement?
9. 9What tools do you use for contact discovery and enrichment? Walk me through the process.
10. 10If we do not hit agreed meeting targets for two consecutive months, what is the exit process?

Pricing: What to Expect at Each Tier

Budget tier is less important than whether the agency can answer the 10 questions above. A $3,000/mo agency that owns your infrastructure, writes specific copy, and reports on meetings booked is worth more than a $7,000/mo agency that shares domains, sends generic templates, and reports on opens.

How to Evaluate a Proposal

A proposal tells you as much about an agency as their sales call does. Here is what to look for.

• Look for: a specific ICP definition with signals, not just industry and headcount. If the ICP section says '50-500 employee SaaS companies' and nothing else, the copy will be equally generic.
• Look for: a named team -- the actual people who will do the work, with their backgrounds.
• Look for: a defined meeting qualification criteria that you would be comfortable enforcing.
• Look for: explicit data ownership language. You own the domains, contacts, and copy.
• Be suspicious of: projected meeting numbers in the first month. No honest agency can predict Month 1 volume. Anyone who does is using numbers to close you.
• Be suspicious of: long case study sections with company logos but no actual email examples. Logos are easy to accumulate. Quality copy is harder.
• Be suspicious of: vague language about infrastructure -- 'enterprise-grade email infrastructure' without specifics means shared.

What to Expect During Onboarding

1. 1Week 1 -- ICP workshop: A structured session where the agency interviews your team to understand your product, best customers, and why deals are won or lost. Output: a defined ICP with specific targeting signals and an initial account list.
2. 2Weeks 2-3 -- Infrastructure: Domain purchasing, DNS configuration (SPF, DKIM, DMARC), mailbox provisioning, and warmup begins. You should receive DNS setup confirmation and see mailboxes added to the sequencing tool.
3. 3Week 3-4 -- Copy development: First draft of email sequences. Expect a review cycle -- the agency shares copy, you give feedback, they revise. A good agency will explain every copy decision, not just present a finished product.
4. 4Week 4-5 -- Launch: First sends go out. Expect daily or weekly reporting on sends, opens, and replies. The first two weeks of live sending are for calibration, not pipeline.