Email A/B Testing Plan

Note: Sidekick cannot run email A/B tests or manage Rollouts itself — there is no native email split-testing feature in Shopify. This plan is meant for you (or your team) to execute manually inside your own email platform.

Create an email A/B testing plan for my store:

Brand name: [YOUR BRAND NAME]
Email platform: [KLAVIYO/MAILCHIMP/SHOPIFY EMAIL/OMNISEND/OTHER]
Current list size: [SUBSCRIBER COUNT]
Emails sent per month: [APPROXIMATE NUMBER]
Current open rate: [PERCENTAGE OR “UNKNOWN”]
Current click rate: [PERCENTAGE OR “UNKNOWN”]
Biggest email challenge: [LOW OPENS/LOW CLICKS/LOW CONVERSIONS/UNSURE]

Create a 30-day A/B testing roadmap:

Week 1 - Subject Line Testing:

  Test element: Length (short vs. long), personalization (with name vs. without), curiosity vs. direct
  Sample size recommendation based on list size
  How to determine a winner (statistical significance basics)
  Two specific subject line pairs to test


Week 2 - Send Time Testing:

  Test morning vs. afternoon vs. evening
  Weekday vs. weekend comparison
  How to read the results correctly


Week 3 - Content and Layout Testing:

  Single CTA vs. multiple CTAs
  Image-heavy vs. text-focused
  Long copy vs. short copy
  Product grid vs. single product focus


Week 4 - CTA and Offer Testing:

  Button color and text variations
  Offer framing (percentage off vs. dollar amount vs. free shipping)
  Placement of CTA (above fold vs. after copy)


For each test provide:

  Hypothesis (what you expect and why)
  Exactly what to change (keep everything else identical)
  Minimum sample size needed
  How long to run the test
  What metric determines the winner
  How to implement the winning variation going forward


Include common A/B testing mistakes to avoid.
Explain how to read results when differences are small.