This shows you the differences between two versions of the page.
| Both sides previous revision Previous revision Next revision | Previous revision | ||
|
email-ab-testing [2017/06/29 13:41] philip [How We Decide the Winner] |
email-ab-testing [2019/12/19 15:41] (current) benc |
||
|---|---|---|---|
| Line 1: | Line 1: | ||
| ====== Email A/B Testing ====== | ====== Email A/B Testing ====== | ||
| - | If there are competing opinions as to the best way to make your email attractive to recipients, or you are unsure about the best approach to take then you can make a ‘Split Test’ or ‘A/B Test’. | + | If there are competing opinions as to the best way to make your email attractive to recipients, or you are unsure about the best approach to take, then you can make a 'Split Test' or 'A/B Test'. |
| - | Sentori will send each of the two emails to a sample of the audience. Once interactions with these tests have begun Sentori will make an assessment of which one is best performing. This best performing or ‘winning’ email will then be sent to remainder of the selected audience. | + | You pick 2 Emails and Sentori will send each to a sample of your selected audience. Once interactions with these tests have begun Sentori will make an assessment of which one is best performing. This best performing or 'winning' email will then be sent to the remainder of the audience. |
| - | ===== What To Do===== | + | ===== What to Do===== |
| + | |||
| + | ==Prepare the Emails== | ||
| - | ==Prepare the emails== | ||
| * Create two versions of your email. | * Create two versions of your email. | ||
| - | * Test the emails in the normal way -send a copy to your in-box and by run the automated tests. | + | * Do your usual checks to ensure they're both ready to send, e.g. send yourself a test, run Sentori's Tests to check for broken links, etc. |
| - | ==Set up the test== | + | |
| - | * Take the ‘Automation’ tab from the main navigation and select ‘Email A/B Testing. | + | ==Set up the A/B Test== |
| - | * Create a new A/B Test. You can give the test a name and add documentation if appropriate. | + | |
| - | * You will be asked to select the two emails to be used. The order in which the two emails are added has not effect on the test. | + | * Take the 'Automation' tab from the main navigation and select 'Email A/B Testing'. |
| - | * Select the contacts to receive the emails. This is done in exactly the same way as you would for sending a single email. | + | * Create a new A/B Test. You can give the test a name and add a description if appropriate. |
| - | * You now set the parameters for the test. These are the total sample size and the length of time to wait before analysing the results and sending the winner to the remaining contacts. | + | * You will be asked to select the two emails to be used. In the event of a tie between the emails, email A will be considered the winner. |
| - | * You select the sample size using the slider. Setting the slider to 20% will mean that each email will be sent to 10% of the total number of selected contacts. | + | * Select the contacts you wish to send to. |
| - | * Clearly Sentori has to wait a reasonable time before making the decision as to which has performed best. We would recommend waiting at least 4 hours. | + | * You now set the parameters for the test. These are the total sample size and the length of time to wait before analysing the results and sending the winner to the remaining contacts. |
| - | * Finally you queue the email and set the time that the test should start. | + | * You select the sample size using the slider. Setting the slider to 20% will mean that each email will be sent to 10% of the total number of selected contacts. |
| - | =How is the Winner Determined?== | + | * Clearly Sentori has to wait a reasonable time before making the decision as to which has performed best. We would recommend waiting at least 4 hours. |
| + | * Finally you you set the time that the test should start. | ||
| + | |||
| + | ===== Frequently Asked Questions===== | ||
| + | |||
| + | ==How is the Winner Determined?== | ||
| + | |||
| + | The winning email is decided by looking at the number of emails opened and also the number of interactions with the email. The two emails are given a score. One point is awarded for each contact that opens the email, one point for each person that clicks a link, and one point for each social share. | ||
| + | |||
| + | If the score for each email is the same, email A is considered the winner. | ||
| + | |||
| + | ==Is the Test Group Randomly Selected?== | ||
| - | The winning email is decided by looking at the number of emails opened and also the number of interations with the email. The two emails are given a score. One point is awarded for each email opened, and two points are awarded for each link click. | + | Yes, the two test groups are randomly selected. |