Collaborating with the product manager and engineer, we set up an A/B/C test to inform which mobile design to move forward with. Specifically, we were monitoring potential impacts on SEO performance, click-through rates, and conversion rates of each option.
We anticipated option A to have the least negative SEO impact but potentially lower performance due to its page placement. Options B and C were used to test two different popup triggers. B activated the popup upon a content-switching event, when a user scrolled upward after having scrolled down on the page. While C employed a time-based trigger, activating the popup 5 seconds after the page load.
30 days post-release of the A/B/C test, the data revealed that the popups had a 55% conversion lift compared to the in-line design. And of the two popups, the time-based trigger outperformed the scroll-based trigger by about 15%. Consequently, we decided to proceed with option C.