Lets say I’m running a test on mobile and desktop, the test ends up delivering a 10% lift, awesome right?
How do I know that my test is successful on both mobile and desktop? What if it’s only the desktop test that is a winner and in fact the mobile test has decreased my CR?
I wouldn’t know that unless I’m measuring conversions in say Google Analytics where I can separate by device.
There’s things I can do to fix this. 1 is only run a test on one device at the moment, but why would I want to do that? I’m trying to optimise my whole design, not just mobile and not just desktop.
The other is to use different urls for mobile and desktop, not the end of the world but definitely not ideal. But that means I have to use twice the amount of pages in unbounce, which if I’m operating at large scale costs me more money. Maybe you’ve done this by design?
The easiest way to fix this problem is to split the stats in unbounce. Instead of showing visitors, conversions and conversion rates as aggregate values. Why not show desktop visits, desktop conversions, mobile visits, mobile conversions etc.
Then I can easily run tests on both mobile and desktop at the same time without having to use twice the amount of pages or measure my conversions externally.