Docs
Smart CR is the metric we use to calculate which variation of a page is best.
Rather than the total Conversion Rate (CR), the Smart Conversion Rate (Smart CR) gives more weight to recent conversions. Say you have an experiment that has been running for 10 days, the smart CR gives more weight to data collected on the 10th day than that on the 9th, the 9th more than the 8th, the 8th more than the 7th, and so on.
If you would like to know more about Smart CR and how we calculate it, download our ebook about Hybrid Statistics.
During an experiment, Autopilot manages the proportion of traffic allocated to each variation (A or B). This maximises your conversions by reducing the traffic allocated to an underperforming page. To judge how a variation is performing, Autopilot calculates the Smart CR. That means the Autopilot can respond more quickly to sudden changes in a page’s performance.
Suppose an experiment starts with an even traffic split.
After a while, version B experiences a sharp drop in conversions. The Smart CR will show this dip immediately.
The Autopilot will adjust the traffic allocation automatically, sending fewer visitors to the underperforming variation.
If version B begins to convert more frequently, the traffic will be adjusted once again, returning to a more even traffic split.