Cold Email Agency Red Flags: What to Watch For (From Someone Who Runs One)

We run a cold email agency. We manage 100+ sending domains, send 50,000+ emails per month across 8+ clients, and operate across six industries. We also regularly inherit clients who just left another agency. When that happens, we see everything: the infrastructure they were handed, the copy that was written on their behalf, and the reporting they received.

This is the guide we wish every buyer had before signing. Not because we are better than every other agency -- but because the patterns of bad agencies are consistent, visible in advance, and entirely avoidable if you know what to look for.

Red Flag #1: Do They Report Open Rates as a Primary KPI?

Open rates in cold email are broken. Apple Mail Privacy Protection, which launched in 2021 and now covers roughly 50% of business email, pre-fetches email content and registers a fake "open" even if the recipient never looked at it. Microsoft and Google run their own scanning that inflates opens further. When an agency leads with "67% open rate!" in their first report, they are either unaware of this or hoping you are.

What good agencies report: positive reply rate (replies that express interest, not just "unsubscribe me"), meetings booked, pipeline value generated, and cost per meeting. These are the metrics that connect outbound to revenue. If the first number in their report is open rate, ask why. If they cannot explain the Apple MPP problem, that tells you how closely they follow the space.

Red Flag #2: Do They Own the Sending Infrastructure or Do You?

Sending infrastructure means domains, mailboxes, DNS records, and warmup history. Who purchases the domains? Who owns the mailbox accounts? Whose credit card is on file? This matters more than most buyers realize, for two reasons.

First, if the agency sends cold email from your primary domain (you@yourcompany.com), a deliverability problem burns your real business email. Your support tickets, your client communication, your internal email -- all of it can be affected. Cold email should always run on dedicated alternate domains (tryourcompany.com, yourcompanyhq.com) that are isolated from your primary operations.

Second, if the agency uses shared infrastructure across multiple clients, your reputation is tied to their other clients' behavior. One client sending aggressive volume or bad copy can tank the shared IP reputation, and your campaigns suffer. Dedicated sending domains per client, purchased in the client's name, is the standard. Ask explicitly.

Red Flag #3: Do They Promise Specific Meeting Numbers in Month 1?

Here is the real timeline for a properly built outbound program. Week 1-2: onboarding, ICP definition, account list building. Week 2-3: domain purchase, DNS configuration, mailbox provisioning. Week 3-5: domain warmup (the mailboxes send and receive low-volume emails to build reputation). Week 5-6: first campaign sends go live, initial volume ramps. Week 6-8: replies start coming in, first meetings booked.

Any agency promising "20 meetings in your first month" is doing one of three things. Using pre-warmed infrastructure shared with other clients (risky). Skipping warmup entirely and sending from fresh domains at full volume (reckless). Or lying. Honest agencies set expectations: infrastructure takes 2-3 weeks, warmup takes 2-3 weeks, first meaningful results appear in month 2, and performance ramps from there.

Red Flag #4: Do They Show You Copy Before It Sends?

This should be obvious. An agency is sending emails on your behalf, from domains associated with your brand, to people you want as customers. You should see every word before it goes out. We show every client their copy rendered exactly as the recipient will see it -- subject lines, body text, variables filled in with real prospect data, follow-up threading, everything.

We have inherited clients who had no idea what their agency was sending. One client discovered their agency was using the phrase "I noticed your company" in every email for 6 months -- to every prospect, across every segment. No variation. No personalization beyond a first name and company name. The client was paying $6,000/mo for a mail merge.

Ask your agency: when do I see the emails? If the answer is anything other than "before they send," you have no quality control over your own brand voice. And ask to see them rendered with real data, not templates with placeholder brackets. {first_name} and {company_name} look fine in a template. "Hi there, " with a blank where the first name should be is what the prospect actually receives when data is missing.

Red Flag #5: Do They Verify Contact Data Before Sending?

Ask your agency what verification they run before sending to a contact. If the answer is "we use Apollo" or "we pull from ZoomInfo," that is sourcing, not verification. Those platforms find email addresses. They do not confirm the address actually works, the person still works at that company, or the email will not bounce.

Here is why this matters to you specifically: the bounces happen on domains associated with your brand. The reputation damage accrues to your domains, not the agency's. If the engagement ends and you want to run outbound yourself or with a different partner, those burned domains follow you. A good agency runs multi-source enrichment (finding emails from multiple data providers) plus deliverability verification (confirming each email will not bounce) before any contact enters a campaign.

A quick test: ask the agency what their average bounce rate is across all campaigns. If they do not know the number immediately, or if it is above 3%, their verification process has gaps. If they cannot explain the difference between a catch-all domain and a verified deliverable address, they are not running verification at all.

Red Flag #6: Is Every Email a Template With a Name Swapped In?

"Hi {first_name}, I noticed your company {company_name} is growing..." is not personalization. It is a mail merge. Real personalization ties to something specific about the prospect or their company: a recent hire that signals a pain point, a technology decision visible in their stack, a funding round that changes their priorities, a competitive dynamic in their market.

The test is simple. Ask your agency to show you 5 emails sent to 5 different prospects in the last 30 days. Read them side by side. If the structure, cadence, and arguments are identical with only names and company names swapped, you are looking at a template operation. If each email references something specific to that prospect's situation, the agency is doing real work.

Red Flag #7: Do They Lock You Into Long Contracts With No Performance Clause?

A 12-month contract with no performance minimums means the agency has already been paid regardless of whether you get a single meeting. They have zero financial incentive to fix something that is not working. Their downside is capped. Yours is not.

What confident agencies offer: month-to-month agreements, or a 3-month initial term with clearly defined performance benchmarks. At 90 days, both sides evaluate results against those benchmarks. If targets are missed, you can exit with 30 days notice. Some agencies (including us) use a hybrid model: a base retainer for infrastructure and operations, plus a per-meeting fee that aligns incentives directly with results.

One nuance: a 3-month minimum is reasonable. Outbound takes 4-6 weeks to produce meaningful data, and 90 days is the minimum to run two full optimization cycles. An agency asking for a 3-month commitment is being honest about how long it takes to prove the channel. An agency asking for 12 months with no outs is being cautious with their revenue, not yours.

What Are the Green Flags That Signal a Good Agency?

Red flags get the attention, but green flags are equally useful. Here is what to look for when evaluating agencies that have passed the red flag screen.

A few more green flags that are harder to spot but matter. They walk you through their infrastructure setup in detail during the sales process -- what domains they will buy, how many mailboxes, their warmup timeline. They proactively tell you when something is not working and suggest pivots instead of waiting for you to notice. They can name the specific person who writes your copy and manages your campaigns.

What Questions Should You Ask Before Signing?

Here are the 12 questions that separate a thorough evaluation from a cursory one. Any good agency will answer these without hesitation. If an agency deflects, generalizes, or gets defensive, that is your answer.

1. 1What is your average positive reply rate across all clients in the last 90 days? (Not open rate. Positive reply rate.)
2. 2How many sending domains and mailboxes will you set up for my account? Who owns them?
3. 3What is your domain warmup process and how long does it take before the first real sends?
4. 4When do I see the email copy? Before it sends or after?
5. 5What is your average bounce rate across all campaigns? How do you verify emails before sending?
6. 6Can you show me 5 real emails sent to 5 different prospects in the last 30 days?
7. 7What is your contract structure? What happens at 90 days if targets are not met?
8. 8Who specifically will write my copy and manage my campaigns? Can I meet them?
9. 9How do you define a qualified meeting? Is that definition in the contract?
10. 10What do your reports look like? Can you send me a sample report from a current client (anonymized)?
11. 11What happens to my infrastructure (domains, mailboxes, warmup history) if I leave?
12. 12What is your total send volume across all clients, and how do you prevent cross-client contamination?

Pay close attention to question 6. Asking to see real emails is the single most revealing request you can make. The copy quality, personalization depth, and strategic thinking all become immediately visible. An agency that hesitates to show real work is an agency that does not want you to see it.

How Much Should a Good Cold Email Agency Cost?

Pricing varies, but there are ranges that signal where an agency sits. Below $2,000/mo, the agency is either a solo operator with minimal infrastructure or cutting corners on data quality and verification. Between $2,000-5,000/mo is the typical range for a dedicated engagement with proper infrastructure, copy, and campaign management. Above $5,000/mo usually includes multi-channel (email + LinkedIn + phone) or high-volume enterprise campaigns.

The cheapest option is almost never the best value. An agency charging $1,500/mo that books zero meetings costs you $4,500 over 3 months plus the opportunity cost of three months without pipeline. An agency charging $4,000/mo that books 8 meetings per month costs you $500 per meeting. Price per meeting is the metric that matters, not monthly retainer.

What Should You Do If You Are Currently With a Bad Agency?

If you recognized multiple red flags in your current agency, here is the exit playbook. First, request ownership transfer of all sending domains and mailboxes. These should already be in your name -- if they are not, that is red flag #2 confirmed. Second, download all campaign data: contacts, send history, reply history. You need this for suppression lists regardless of what you do next.

Third, audit the damage. Check your domain reputation using Google Postmaster Tools and mail-tester.com. If domains are burned (spam rate above 1%), you may need to start fresh with new domains rather than trying to rehabilitate. Fourth, do not rush into a new agency. Run the evaluation checklist above. A 2-week gap between agencies is nothing compared to 6 months with the wrong partner.