AB testing

As part of my role are create.net we are always testing new designs and content to increase engagement with our users, in particular, users on the free trial period.

This task involved changing the look of our ‘trial dashboard’, and implementing the changes as an A/B test using Optimizely

I was given the designs as a Sketch file from our visual designer Andy and decided that I would make the changes using CSS only and use Optimizely to switch out a class on the <body> that changes what CSS displays.

Here’s how it came out;


The trial dashboard shown with the original design


The 'variant' design trial dashboard, colours and layout have changed

The challenges

The results

To be honest, I’m not entirely sure a variant this big can be of any use. It’s hard to really tell which change had the biggest impact on conversions. Early results indicate that