Split testing also known as A/B testing provides you a way to test different variants of your campaign to conclude which one performs better and should be sent to the contacts for improved results. All you would need to do is select to couple of variants of a campaign, define test criteria and save the split test to later send it to the contact list(s) of your choice.
Navigate to Split Test
Main Navigation -> Campaigns -> Split Test
When you first land on Split Test page, you will see an empty table without any record in it. To populate records in the View Split Tests table, you would first need to create a split test. Create your first test by clicking “Create Split Test” from the top of the table.
Creating split test is mix of mandatory and optional selections, but the optional selections are equally important to setup suitable test criteria. Let’s explore further.
Create Split Test
Split Test Name
Name assigns an identity to the test criteria you are about to create. It will help you identify specific split test later when you schedule it for sending.
It keeps list of campaigns along with the campaign groups to make a selection of required variants to test. One version of campaign may contain a different subject line and the other may be having a different call to action. It will eventually help in conclude which version of campaign is performing better and suitable to send to the majority recipients.
Define the criteria to run the test and evaluate the results based on one of the following.
- Open Rate- When selected, the variant or campaign that obtains the higher open rates will be evaluated as winner as a result.
- Unique CTR- A variant/campaign that secures higher percentage of unique click through rate will be held as winner as a result.
- Unique CTR on Specific Link- The variant or campaign that would acquire higher percentage of click through rate for a specific link will be evaluated as winner for the test.
Select Link- In case of selecting the option Unique CTR for Specific Link, the dropdown appears carry the list of all the links to select the desired one for test criteria.
Propose the percentage for the batch of contacts to receive the split test and evaluate the winning campaign based on set criteria. For example proposing 15% of contact list of 900 subscribers, will split 15 %( 135 Subscribers) of your list and will divide them on the number of variation you want to test, let’s say 3. Each group out of these 15% will then receive a test email campaign from the selected three. 45 out of 135 will receive 1st variant, next 45 will receive the second and final 45 will receive the 3rd variant of the campaign.
Action to Perform
After the evaluation of the test here are two actions that you can perform.
- Find Winner and Update Results- Selecting this option will run the test according to the set criteria, will evaluate the winner and show the results on the Statistics page to view.
- Send Winner Email to Remaining Contacts- When you select this option, system will run the test with the percentage proposed percentage of contacts, automatically evaluate the result based on the evaluation criteria and after concluding, it will automatically send the winner campaign/ variant to the remaining contacts in the list.
Send Remaining After
After how many minutes, hours, weeks or monthly would the system automatically start sending the winner campaign to the remaining contacts in the list? Select here.
Save or Cancel Details/Preference
You have the following options to complete the process, cancel or save your preferences.
Save & Add Another
Get the current details/preferences saved to complete this process, and automatically reopen the same process with empty field values/options to make a new entry.
Save & Exit
Complete the process, get your preferences/ details saved and exit from the process.
Return to the previous page without saving your preference
View Split Tests
As you have now created some tests, you can see them populating the View Split Test table. Like every view page, you can search specific split tests from the list by using the search box and can select the preferred number of records to appear on the first page. Following area discusses the information every column of the table provides and the actions you can perform.
Rows of the first column have checkboxes that would help selecting records of multiple rows. You can select one or multiple records by ticking the checkboxes.
Name that was given to the split test while filling setting the criteria to test, every row of the column represents one split test with its name and the rows next to it offer related information.
It shows campaigns or variants of a campaign that were being selected while setting up criteria for the test.
From the test it refers to the criteria defined for the test to evaluate the best performing variant. It can be based on open, unique CTR or unique CTR of a specific link.
The data and time when the split test was created and saved within the system
Following are the actions you can perform to manage the available tests
Clicking it will lead you to the Edit page where you will be able to edit the details of specific split test like evaluation criteria, variants, decision percentage and such.
Remove specific test from the list of available split tests.
Make a selection of multiple records that you want delete and reach delete under tools from the top of the table.