What is engagement segmentation testing?

You've probably noticed that not all subscribers behave the same way. Some open almost everything. Others haven't clicked in months. Engagement segmentation testing is how you figure out whether those inactive subscribers are quietly dragging down your inbox placement for everyone else.

The idea is straightforward. Instead of sending to your full list and looking at blended results, you split your list by engagement history and send to each group separately. Then you compare inbox placement across those groups for the exact same email. If your highly engaged segment lands in the inbox 90% of the time and your disengaged segment lands there 40% of the time, that tells you something important.

Here's how to actually run one of these tests.

Step 1: Define your engagement tiers. A simple starting point that works across most ESPs looks like this. Highly engaged means anyone who opened or clicked in the last 30 to 60 days. Moderately engaged covers opens or clicks within the last 90 days. Disengaged is everyone who hasn't opened or clicked in over 90 days (some senders push this to 180 days). Adjust the windows based on your sending frequency. If you only send once a month, a 30-day window might only cover one send.

Step 2: Send identical campaigns to each tier separately. Same subject line, same content, same sender name. The only variable is who receives it. If you change anything else, you won't know what's causing the difference.

Step 3: Measure placement and performance per segment. Track open rates, click rates, and (if your ESP or a seed testing tool gives you placement data) actual inbox vs. spam folder rates for each group. You're looking for the gap. A wide gap between your engaged and disengaged segments is a strong signal that sending to inactive subscribers is costing you placement with your best contacts.

What the results actually tell you. If your engaged segment performs dramatically better, you have a few options. You can suppress the disengaged segment going forward, run a re-engagement campaign specifically for them, or simply accept that you're sending to cold contacts and watch your reputation closely. Most senders find that cutting disengaged contacts improves overall placement faster than any content tweak ever would.

One thing worth noting: this isn't a one-time test. Engagement patterns shift, and so does placement. Running this quarterly gives you a clear picture of whether your list health is improving or quietly slipping.

But if you're not sure how to slice your list in your specific ESP, or you want to check whether disengaged contacts are affecting your domain reputation right now, our SOS hotline is free and we'll walk you through it.