How are metrics normalized across ESPs?

Still have a question, spotted an error, or have a better explanation or a source we should cite?

If you move from one ESP to another and expect your open rate to look the same, you're likely to be disappointed. ESPs don't all define and count metrics the same way. The number you see in one platform's dashboard may not be directly comparable to the number in another's, even if they're both calling it "open rate."

Where the differences come from

What counts as "delivered." Some ESPs count a message as delivered if it wasn't hard-bounced. Others subtract soft bounces too. The denominator changes the rates.

Unique vs. total events. If the same person opens an email five times, some ESPs count that as one open (unique), others count it as five. Click rate has the same issue. Unique clicks and total clicks tell different stories.

How they handle Apple Mail Privacy Protection. Since 2021, Apple pre-loads tracking pixels for Apple Mail users, inflating opens. Some ESPs filter known Apple MPP signals from their open rate calculations. Others report them as opens. An ESP that filters them will show a lower open rate than one that doesn't, even from the same send.

Bot and machine-click filtering. Security gateways scan links in emails before the recipient sees them. That shows up as a click in raw event data. Better ESPs filter these out. Others don't, which inflates click rates.

How to normalize your own metrics

When comparing across ESPs or across time periods after a platform change, use click rate as your primary engagement metric. It's more consistently defined and harder to inflate than open rate. Click-to-open rate (CTOR) is even more useful for content effectiveness, because it compares clicks against opens from the same population.

If you're migrating between ESPs and want to make sure you're comparing apples to apples, ask each ESP directly: how do you define a delivered message, do you report unique or total opens, and how do you handle Apple MPP? The answers tell you how much adjustment to apply.

Contributors

Who worked on this answer

Every name links to their profile. Every company links to their site. Real people, real accountability.

Ask an AI · tailored to your setup

Help Me Normalize My Email Metrics

I just read the Email Almanac entry on normalizing metrics across ESPs. Help me figure out whether the metric differences between platforms are affecting how I read my performance data. Walk me through: 1. Whether my current ESP uses unique or total events for opens and clicks 2. How my ESP handles Apple Mail Privacy Protection open inflation 3. Whether I should adjust my benchmarks after an ESP migration 4. Which metric to use as my primary engagement indicator going forward --- My details (fill in what applies): - Current ESP: Mailchimp / Klaviyo / Brevo / SendGrid / other - Previous ESP (if migrated): name or "N/A" - When the migration happened: date or "N/A" - Whether my open rate changed after migration: increased / decreased / stayed the same / unsure - Current open rate: percentage - Current click rate: percentage - Whether Apple Mail is a significant share of my audience: yes / no / unsure

Edit the yellow boxes, then send to the AI of your choice.