Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
email-ab-testing [2017/07/26 08:24]
127.0.0.1 external edit
email-ab-testing [2019/12/19 15:41] (current)
benc
Line 5: Line 5:
 You pick 2 Emails and Sentori will send each to a sample of your selected audience. ​ Once interactions with these tests have begun Sentori will make an assessment of which one is best performing. ​ This best performing or '​winning'​ email will then be sent to the remainder of the audience. You pick 2 Emails and Sentori will send each to a sample of your selected audience. ​ Once interactions with these tests have begun Sentori will make an assessment of which one is best performing. ​ This best performing or '​winning'​ email will then be sent to the remainder of the audience.
  
-===== What To Do=====+===== What to Do=====
  
-==Prepare the emails==+==Prepare the Emails==
  
   * Create two versions of your email.   * Create two versions of your email.
-  * Test the emails in the normal way - by sending a copy to yourself ​and running the automated tests.+  * Do your usual checks ​to ensure they'​re both ready to send, e.g. send yourself ​a test, run Sentori'​s Tests to check for broken links, etc.
  
-==Set up the test==+==Set up the A/B Test==
  
-  *  Take the '​Automation'​ tab from the main navigation and select 'Email A/B Testing'​. +  * Take the '​Automation'​ tab from the main navigation and select 'Email A/B Testing'​. 
-  *  Create a new A/B Test.  You can give the test a name and add a description if appropriate. +  * Create a new A/B Test.  You can give the test a name and add a description if appropriate. 
-  *  You will be asked to select the two emails to be used.  In the event of a tie between the emails, email A will be considered the winner. +  * You will be asked to select the two emails to be used.  In the event of a tie between the emails, email A will be considered the winner. 
-  *  Select the contacts to receive the emails. ​ This is done in exactly the same way as you would for sending a single email+  * Select the contacts ​you wish to send to. 
-  *  You now set the parameters for the test. These are the total sample size and the length of time to wait before analysing the results and sending the winner to the remaining contacts. +  * You now set the parameters for the test. These are the total sample size and the length of time to wait before analysing the results and sending the winner to the remaining contacts. 
-  *  You select the sample size using the slider. ​ Setting the slider to 20% will mean that each email will be sent to 10% of the total number of selected contacts. +  * You select the sample size using the slider. ​ Setting the slider to 20% will mean that each email will be sent to 10% of the total number of selected contacts. 
-  *  Clearly Sentori has to wait a reasonable time before making the decision as to which has performed best.  We would recommend waiting at least 4 hours. +  * Clearly Sentori has to wait a reasonable time before making the decision as to which has performed best.  We would recommend waiting at least 4 hours. 
-  *  Finally you queue the email and set the time that the test should start.+  * Finally you you set the time that the test should start.
  
 ===== Frequently Asked Questions===== ===== Frequently Asked Questions=====
Line 27: Line 27:
 ==How is the Winner Determined?​== ==How is the Winner Determined?​==
  
-The winning email is decided by looking at the number of emails opened and also the number of interactions with the email. The two emails are given a score. ​ One point is awarded for each contact ​to email open the email, one point for each person ​to click a link, and one point for each social share.+The winning email is decided by looking at the number of emails opened and also the number of interactions with the email. The two emails are given a score. ​ One point is awarded for each contact ​that opens the email, one point for each person ​that clicks ​a link, and one point for each social share.
  
 If the score for each email is the same, email A is considered the winner. If the score for each email is the same, email A is considered the winner.