1. Knowledge Center
  2. Variants Testing
  3. How to Interpret Your Test Results?

How to Interpret Your Test Results?

You can easily analyze your test results in the item analytics page, where you can compare between the 2 variants of your item.

Once you published your test you can easily analyze the performance of each variants by going to your item analytics page. In this page, you will be able to compare between the 2 variants main metric performance such as engagements, Clicks or leads (if your item includes CTA or lead form).

Keep in mind, that the market recommendation is to keep the test running for at least 2 weeks in order to get to a high level of confidence (Statistical significance)
on which of the variants performs better. 

 

How to analyze the test performance

1. Go to 'My items' page and click on the item analytics icon

2. In the item analytics page, scroll down to the variants overview table to compare between the variants performance

Comparison table metrics:

  • Items loads - the amount of time each variant was loaded (page view) 
  • Engagements - The amount of user engagements with each one of the variants. Engagement is counted once the user interact with the item or spent more than 15 seconds on the item page.
  • Engagement rate - engagements divided by the amount of items loads. This metric is a good indicator on the amount of traction each variant is getting, higher engagement rates means that the item is getting more attention from your readers, thus, performs better.
  • Leads - the amount of leads collected from each one of the variants.  This metric is relevant only if your variant include a lead form element or a lead form in the experience result page. (read more about our lead form capabilities here)
  • CTA's - the amount of CTA clicks that each one of the variants generated. This metric is relevant only if your variant include a CTA element or a CTA in the experience result page. (read more about our CTA capabilities here)

 

Recommendations:

  • Leave the test running for at least 2 weeks to get to statistical significance in your results
  • Higher engagement rates usually indicate on a better item performance results
  • Check out how many leads or CTA clicks and calculate the conversion from items load to click or submission of a form to get more indicators on how your variants perform.

 

Read more about Variant test:

  • How to deactivate a test?

 

 

Contact us for more details