Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
email-ab-testing [2017/06/29 13:16]
philip
email-ab-testing [2019/12/19 15:41] (current)
benc
Line 1: Line 1:
 ====== Email A/B Testing ====== ​ ====== Email A/B Testing ====== ​
  
-If there are competing opinions ​about the best way to make your email attractive to recipients or you are unsure ​of the approach to take with an email then you can make a Split Test’ or A/B Test+If there are competing opinions ​as to the best way to make your email attractive to recipientsor you are unsure ​about the best approach to takethen you can make a 'Split Test' ​or 'A/B Test'.
  
-Sentori will send each of the two emails ​to a sample of the audience. ​ Once interactions with these tests have begun Sentori will make an assessment of which one is best performing. ​ This best performing or winning’ email will then be sent to remainder of the selected ​audience.+You pick 2 Emails and Sentori will send each to a sample of your selected ​audience. ​ Once interactions with these tests have begun Sentori will make an assessment of which one is best performing. ​ This best performing or 'winning' ​email will then be sent to the remainder of the audience. 
 + 
 +===== What to Do===== 
 + 
 +==Prepare the Emails==
  
   * Create two versions of your email.   * Create two versions of your email.
-  * Test the emails in the normal way -   send a copy to your in-box and by run the automated tests+  * Do your usual checks to ensure they'​re both ready to send, e.g. send yourself ​test, run Sentori'​s Tests to check for broken links, etc. 
-  *  Take the Automation’ tab from the main navigation and select ​Email A/B Testing. + 
-  *  Create a new A/B Test.  You can give the test a name and add documentation ​if appropriate. +==Set up the A/B Test== 
-  *  You will be asked to select the two emails to be used.  ​The order in which the two emails ​are added has not effect on the test+ 
-  *  Select the contacts to receive the emails. ​ This is done in exactly the same way as you would for sending a single email+  * Take the 'Automation' ​tab from the main navigation and select ​'Email A/B Testing'
-  *  You now set the parameters for the test. These are the total sample size and the length of time to wait before analysing the results and sending the winner to the remaining contacts. +  * Create a new A/B Test.  You can give the test a name and add a description ​if appropriate. 
-  ​* You select the sample size using the slider. ​ Setting the slider to 20% will mean that each email will be sent to 10% of the total number of selected contacts. +  * You will be asked to select the two emails to be used.  ​In the event of a tie between ​the emails, email A will be considered ​the winner
-  ** Clearly Sentori has to wait a reasonable time before making the decision as to which has performed best.  We would recommend waiting at least 4 hours. +  * Select the contacts ​you wish to send to. 
-  *  Finally you queue the email and set the time that the test should start.+  * You now set the parameters for the test. These are the total sample size and the length of time to wait before analysing the results and sending the winner to the remaining contacts. 
 +  * You select the sample size using the slider. ​ Setting the slider to 20% will mean that each email will be sent to 10% of the total number of selected contacts. 
 +  * Clearly Sentori has to wait a reasonable time before making the decision as to which has performed best.  We would recommend waiting at least 4 hours. 
 +  * Finally you you set the time that the test should start. 
 + 
 +===== Frequently Asked Questions===== 
 + 
 +==How is the Winner Determined?​== 
 + 
 +The winning email is decided by looking at the number of emails opened and also the number of interactions with the email. The two emails are given a score. ​ One point is awarded for each contact that opens the email, one point for each person that clicks a link, and one point for each social share. 
 + 
 +If the score for each email is the same, email A is considered the winner. 
 + 
 +==Is the Test Group Randomly Selected?==
  
 +Yes, the two test groups are randomly selected.