How to Choose a B2B Newsletter Agency: The Evaluation Criteria That Actually Matter

Every agency pitch deck says roughly the same thing: strategic, full-service, results-focused. None of that tells you whether they'll actually grow your list or just fill your inbox with issues nobody opens.

The real evaluation criteria are more specific, and most buyers never ask about them until after they've already signed a contract.

Ask What They Actually Measure

A lot of agencies report open rate and call it a day. Open rate matters, but it's an easy number to inflate and a hard one to tie back to revenue.

Ask instead: how do you track replies? How do you connect newsletter activity to pipeline? We've written about the specific metrics that actually predict revenue here. If an agency can't answer that question with a specific process, they're probably not tracking it either. Watch for the word "engagement" used without a definition attached. It usually means the agency hasn't picked a real metric yet.

Ask for Real Before-and-After Numbers

Case studies with vague language, "significant growth," "improved engagement", usually mean the real numbers weren't good enough to print.

A newsletter we took over for a client in Boston was opening at 12%. Within four months of rebuilding the segmentation and rewriting the send cadence, it sat at 38%. A separate client based in Austin started with zero subscribers and no existing list; five months later they had 4,200 engaged subscribers and were closing deals sourced directly from newsletter replies.

Ask any agency you're considering for numbers like that. Actual percentages, actual timeframes, actual subscriber counts. If they can't give you specifics, assume the results behind the pitch aren't specific either.

Ask Who's Actually Writing It

Some agencies staff your account with a junior writer who's never worked in your industry. Others put a strategist on the account who understands your buyer and only hands off the writing once the strategy is locked.

Neither approach is automatically wrong, but you should know which one you're getting before you sign. Ask directly: who writes the first draft, and who approves it before it reaches you? Ask, too, how much of your own team's time the process requires. Some agencies need a founder on a call every week to source material. Others can run mostly on a monthly interview plus whatever's already public, a podcast appearance, a sales call recording, a LinkedIn post that did well.

Ask How They Grow the List

This is the question most buyers skip, and it's the one that determines whether the newsletter is worth running at all. A newsletter with strong content and no growth engine plateaus within a few months.

Get specific. Do they run LinkedIn organic campaigns? Lead magnets? Referral loops built into the newsletter itself? A vague answer here ("we focus on quality over quantity") usually means there isn't a real growth plan behind it. A good agency should be able to tell you, roughly, how many subscribers they expect to add in the first ninety days and which channel most of them will come from.

Ask What Happens When Something Breaks

Deliverability problems happen. Domains get flagged, emails land in spam, open rates drop without warning. What matters is whether the agency catches it fast and has a documented process for fixing it, or whether you find out three weeks later when someone on your team happens to check.

Ask what their monitoring actually looks like, and ask for an example of a time it worked. A specific story, this domain got flagged, here's what we did, here's how long it took to fix, tells you far more than a general assurance that they "monitor deliverability closely."

Listen for How They Talk About Your Industry

A short conversation usually reveals whether an agency understands your buyer or is treating your industry like any other account. Do they ask about your sales cycle? Do they already have a rough sense of who reads a newsletter like yours and why? Generic answers on a sales call tend to produce generic newsletters once the contract starts.

Compare Apples to Apples

Not every "newsletter agency" does the same job. Some are single freelancers. Some are broad marketing shops that added newsletters as a line item. The full breakdown of what to look for, and what a real newsletter agency actually actually includes.

Before comparing prices, make sure you're comparing the same scope of work. A $2,000-a-month retainer that only covers writing is a different purchase than a $2,000-a-month retainer that covers strategy, writing, growth, and deliverability.

What to Do Next

The fastest way to evaluate an agency honestly is to ask them these questions directly and see how specific the answers are. Vague answers are the tell.