How to measure an outbound campaign: reply rate, meetings and A/B tests

A campaign you cannot measure is a campaign you cannot improve. The good news is that outbound needs only a handful of numbers, as long as you compute them consistently and read them with care. This guide explains which ones matter, how to define them and how to test changes properly.

Think in a funnel

Outbound is a sequence of steps, and each step has its own rate. Measure each one separately, because the problem is rarely where you think it is.

• Contacted: the number of people who received at least one email.
• Delivered: emails that did not bounce.
• Replies: people who answered, whatever the answer.
• Positive replies: people who showed interest or asked a question that moves the conversation forward.
• Meetings booked: the outcome that matters most.

The metrics, with clear definitions

• Bounce rate = bounced emails / emails sent. It measures the quality of your list. A high rate harms your sender reputation; pause and clean your list when it rises.
• Reply rate = people who replied / people contacted (or delivered emails, but always the same denominator). It measures how relevant your message is.
• Positive reply rate = positive replies / people contacted. It is more useful than the raw reply rate, because "not interested" and "unsubscribe" are replies too.
• Meeting rate = meetings booked / people contacted. It measures the whole system, from target to offer.
• Unsubscribe and complaint rate = people who opted out or reported your message / people contacted. Keep it very low; it is an early warning for deliverability.

Pick one denominator for each rate and write it down, otherwise you will compare numbers that cannot be compared. Count a person once even if you sent them three emails.

Why open rates mislead

Open tracking works by loading a tiny hidden image. Some email apps and privacy features, such as Apple Mail Privacy Protection, load remote content in advance, which can register an open that no human made. Security scanners can do the same. As a result, an open rate is a weak signal. Treat it as a rough hint at best, and base your decisions on replies and meetings.

Read the numbers in context

• Segment before you conclude. A campaign can perform very differently by job title, company size or country. Look at each segment.
• Wait for enough data. Ten emails say almost nothing. Wait until a segment has received a meaningful number of messages and the follow-ups have had time to land.
• Be careful with benchmarks. Figures you read online depend on the sector, the offer and the list. Compare yourself with your own previous campaigns first.
• Separate the causes. Low replies with low bounces point to the message or the target; high bounces point to the list or the domain.

Running an A/B test properly

An A/B test compares two versions of one element to see which one performs better. It only teaches you something if you respect a few rules.

• Change one thing at a time: the subject line, or the opening line, or the call to action. If you change several, you will not know which one worked.
• Split randomly between the two versions, within the same segment, at the same time. Do not send A on Monday and B on Friday.
• Pick the metric before you start: for outbound, the positive reply rate or the meeting rate is usually better than opens.
• Keep the groups comparable in size and in quality of list.
• Do not stop at the first lead. Early differences are often noise. Let the test run until each version has received enough messages, then compare.
• Keep a log: what you tested, the result, and what you decided.

When a difference stays visible over a decent volume, adopt the winner and test the next element. Over a few rounds, small improvements add up.

A weekly routine

• Look at bounces first: they tell you whether the list and the domain are healthy.
• Read the replies yourself, especially the negative ones. They tell you what to change.
• Compare positive reply rate and meetings by segment and by variant.
• Decide one change for next week, and write it down.

In Outbly, replies are classified automatically (interested, question, not now, unsubscribe) and analytics show replies, positive rate, meetings and pipeline by campaign, variant and mailbox. Campaigns support A/B variants. Before measuring, make sure the basics are in place: how to start B2B outbound and SPF, DKIM, DMARC and gradual volume.