How do I AB test my Broadcast Emails in Numero?

The Numero Comms Center does not have an AB testing tool (it's on our roadmap!), but you can AB test content by using our limiting feature to split your email list into subsets in order to send different content to each set. You can then send any remaining audience size the "winning email content". 

Let's say you have a list of 10,000 emails that you want to AB test. If you use a test subject size of 50%, you can send 2,500 individual emails one version of your email and then send another 2,500 emails a different version of your email. Then, send the remaining 5,000 emails from that list can receive the version of the email that performs best. To execute this, you'd:

1. From your saved list of 10k contacts, add Limit Contacts with 2,500 contacts by either Default or Custom options. Update your Saved List and go to the Email Broadcast tab to build your audience and send your "A" email of the AB test.

2. The next day, go to your saved List in the CRM with the added Limit Contact of 2500 contacts and add an Email Broadcast filter for those contacts who have not received Email A. Save List to update.

3. Next, go through the flow again for sending a broadcast email. This will be your "B" email of the AB test. You can either build the email broadcast or duplicate the message from the previous day if you choose. 

4. Once you've sent both emails, you can compare the 2 emails' performance and decide on a winner. 

5. Once you choose a winner, you can duplicate the winning email and send it to the remaining 5k emails

6. To isolate the remaining 5k emails, go to your saved List in the CRM with the added Limit Contact of 5k contacts and add an Email Broadcast filter for those contacts who have not received email broadcast A or B. Save List to update, then use this list as your audience for your third email. 

Still need help? Contact Us Contact Us