Frequently asked questions regarding A/B tests
How long is the customer visiting a shop assigned to a particular variant?
Customers visiting the site are randomly assigned to a particular variant unless they clear temporary data (i.e. cookies, history, cache, etc.), or the test is finished.
Can the second shop be running independently when the test is conducted?
The second shop can run independently when the A/B test is being conducted. It has no influence on the test's results.
If the customer is assigned to the variant B, will the visit be counted to the statistics of the shop B?
The statistics, i.e. Google Analytics, will always be generated for the shop conducting the test, regardless of the variant assigned. Only accessing the webpage of the second shop will generate the statistics for the shop B.
What is the difference between being assigned to the variant B and accessing the shop B?
When the A/B test is being conducted, a customer assigned to the variant B can see the layout of the shop which was chosen as the variant B. Depending on the shared settings also different composition of banners, buttons and adverts can be displayed. Therefore, the variant B can be displayed in the same way as the second shop.
Regardless of the selected variant user would still technically be in the first shop, therefore the elements such as the offer, Google Analaytics statistics, system reports, e-mail configuration, HTML and JavaScript addons are the same and unchangeable regardless of the variant.
What can be tested with A/B test?
A/B tests perfectly check the performance of the below listed items from the administration panel:
- shop's layout
- banners, buttons and adverts
- HTML and JavaScript addons
- Toplayers
- Widgets
Under ADMINISTRATION \ Installation, deinstallation and shop configuration you can manage which of the elements are to be the same in both variants and which should be set up individually. In order to proceed please use the configuration of settings sharing.