Overview
A successful Conversion Rate Optimization experiment should not be evaluated through conversion rate alone
For this e-commerce brand, Mersad connected experiment performance with purchase behavior, average order value, customer segments, and projected revenue impact to understand the real commercial value of the winning variation
The experiment targeted returning customers and focused on improving the purchase journey at the cart and checkout stage
The Challenge
Many experimentation programs stop at reporting an uplift percentage
A variation may appear positive, but the business still needs to understand:
- How much additional revenue the change could generate
- Which customer segment created the uplift
- Whether average order value improved or declined
- Whether the result was commercially meaningful
- Whether the winning variation should be implemented permanently
The challenge was to move beyond a conversion result and translate the experiment into a clear business decision
Experiment Context
The test focused on returning customers and aimed to improve purchase completion through a clearer and more focused cart experience
Purchase was used as the primary outcome, while average order value was reviewed as an important secondary metric
The experiment ran for 11 days
Experiment Results
The winning variation generated:
- 17.06% uplift in purchases
- 7.47% uplift in average order value
- Returning customers as the target audience
- Purchase as the primary outcome
- 11-day experiment runtime
These results indicated that the variation improved both the likelihood of completing a purchase and the value generated from each order
Revenue Impact Analysis
To assess the commercial significance of the experiment, Mersad translated the uplift into a projected monthly revenue opportunity
Based on the experiment result and the available business performance data, the winning variation represented an estimated:
- 23,453 SAR in projected monthly revenue uplift
This projection helped the business evaluate the experiment through revenue impact rather than conversion rate alone
Why This Matters
A conversion uplift does not automatically mean a successful business outcome
For example:
- Conversion rate may increase while average order value decreases
- The uplift may come from a low-value customer segment
- Additional purchases may depend on aggressive discounts
- The projected revenue impact may be too small to justify implementation
- The result may not remain consistent across key segments
In this experiment, both purchase rate and average order value moved positively, which strengthened the commercial case for implementation
Decision Framework
The result was reviewed across:
- Purchase uplift
- Average order value
- Target audience
- Projected monthly revenue
- Experiment runtime
- Data quality
- Implementation feasibility
- Business significance
- Segment consistency
This allowed the decision to be based on the total commercial impact rather than one isolated metric
Key Learning
The value of CRO is not the uplift percentage alone
The real value comes from connecting user behavior and experiment performance to:
- Revenue
- Profitability
- Customer value
- Implementation decisions
- Business priorities
- Future experimentation opportunities
A strong experimentation program should help the business decide what to implement, what requires further validation, and where the next revenue opportunity exists
Conclusion
The experiment created a measurable improvement in purchase performance and average order value for returning customers
By translating the result into a projected monthly revenue opportunity, Mersad gave the business a clearer view of the financial value of the optimization
The estimated 23,453 SAR monthly revenue uplift demonstrated how focused CRO work can create commercially meaningful growth without increasing advertising spend
Turn Experiment Results Into Revenue Decisions
Mersad connects analytics, customer behavior, UX, experimentation, and business strategy to help e-commerce brands improve conversion efficiency and revenue performance