Note: This is a guest article written by Sujan Patel, co-founder of Web Profits. Any and all opinions expressed in the post are Sujan’s.
“If you build it, they will come” only works in the movies. In the real world, if you’re serious about e-commerce success, it’s up to you to grab the CRO bull by the horns and make the changes needed to maximize your growth.
Implementing an e-commerce CRO program may seem complex, and it’s easy to get overwhelmed by the number of possible things to test. To simplify your path to proper CRO, we’ve compiled a list of ways to optimize your site by channel.
This list is by no means exclusive; every marketing channel supports as many opportunities for experimentation as you can dream up. Some of these, however, are the easiest to put into practice, especially for new e-commerce merchants. Begin with the tactics described here; and when you’re ready to take your campaigns to the next level, check out the following resources:
Your website’s individual pages represent one of the easiest opportunities for implementing a conversion optimization campaign, thanks to the breadth of technology tools and the number of established testing protocols that exist currently.
These pages can also be one of the fastest, thanks to the direct impact your changes can have on whether or not website visitors choose to buy.
A number of opportunities exist for making result-driven changes to your site’s home page. For example, you can test:
Increasing prominence and appeal of CTAs: If visitors don’t like what you’re offering as part of your call-to-action (or worse, if they can’t find your CTA at all), test new options to improve their appeal.
Testing featured offers: Even template e-commerce shops generally offer a spot for featuring specific products on your store’s home page. Test which products you place there, the price at which you offer them, and how you draw attention to them.
Testing store policies – Free shipping is known to reduce cart abandonment. Implement consumer-friendly policies and test the way you feature them on your site.
Trying the “five-second test” – Can visitors recall what your store is about in 5 seconds or less? Attention spans are short, and you might not have longer than that to convince a person to stick around. Tools like UsabilityHub can get you solid data.
Making this change led to an estimated $100,000 in increased sales per year.
Proper CRO doesn’t just happen on your site. It should be carried through to every channel you use, including email marketing. Give the following strategies a try to boost your odds of driving conversions, even when past visitors are no longer on your site.
Use an established email marketing program to take the steps below:
Build lead nurturing content for all stages of the funnel: Following Digital Marketer’s Email Machine structure will ensure you cover indoctrination, engagement, ascendency, segmentation and re-engagement.
“4x higher open rates and 5x higher click rates compared to other promotional emails. Keeping in mind that in e-commerce, average revenue per promotional email is $0.02, welcome emails on average result in 9x higher revenue — $0.18. And if it’s optimized effectively, revenue can be as high as $3.36 per email.”
LiveChat Inc.’s report on chat greeting efficiency shares the example of The Simply Group, which uses customized greetings to assist customers having problems at checkout. Implementing live chat has enabled them to convert every seventh greeting to a chat, potentially saving sales that would otherwise be lost.
Content marketing may be one of the most challenging channels to optimize for conversions, given the long latency periods between reading content pieces and converting. The following strategies can help:
Tie content pieces to business goals.
Incorporate content upgrades.
Use clear CTAs within content.
Test content copy, messaging, use of social proof, and so on.
Test different distribution channels and content formats.
ThinkGeek uses YouTube videos as a fun way to feature their products and funnel interested prospects back to their site. Their videos have been so successful that they’ve accumulated 180K+ subscribers who tune in regularly for their content.
According to Invesp, “It costs five times as much to attract a new customer, than to keep an existing one.” Continuing to market to past customers, either in the hopes of selling new items or encouraging referrals, is a great way to boost your overall performance.
Don’t let your CRO efforts stop after a sale has been made. Some of your past clients can be your best sources of new customers, if you take the time to engage them properly.
Lastly, make CRO an ongoing practice by prioritizing it internally, rather than relegating it to “something the marketing department does.”
Ask CRO experts, and they’ll tell you that beyond the kinds of tactics and strategies described above, having a culture of experimentation and testing is the most important step you can take to see results from any CRO effort.
It’s easy to get into the habit of robotically posting content to social media every day. However, how you post to social media is just as important as the content itself. You need people to click on your post to see your content. So, before you rush around doing your daily social media tasks, pause, take a step back and think about how you can improve what you’re doing. Study this infographic and use it as a cheat sheet the next time you post to social media. One last hint: It’s a good idea to measure your social media efforts…
Video marketing has been on the rise for more than a decade now. Consumers are getting more and more used to consuming video content wherever they go, be it on Facebook or on a product page. Which may make one think: Isn’t video content expected by now? Shouldn’t we produce a video every chance we get? However, the real question is: Will videos be a conversion ignitor or a conversion killer? Let’s find out! First, Some Tempting Stats… There are plenty of case studies and reports claiming that using a video on a landing page is a great idea for…
Who can know if a growth strategy will succeed or fail before investing in it.
Who makes confident decisions based on what she knows her users want.
Who puts proven ideas to work to cut spending and lift revenue.
Okay. Now stop imagining, because you can be that leader…right now. You just need the right tool. (And no, I’m not talking about a crystal ball.) I’m talking about testing.
Build a future-proof growth machine at your company
Get this free guide on how to build an optimization program that delivers continuous growth and insights for your business. Learn the in’s and out’s of the proven processes and frameworks used by brands like HP, ASICS, and 1-800 Flowers.
By entering your email, you’ll receive bi-weekly WiderFunnel Blog updates and other resources to help you become an optimization champion.
So many marketers approach “conversion optimization” and “A/B testing” with the wrong goals: they think too small. Their testing strategy is hyper focused on increasing conversions. Your Analytics team can A/B test button colors and copy tweaks and design changes until they are blue in the face. But if that’s all your company is doing, you are missing out on the true potential of conversion optimization.
Testing should not be a small piece of your overall growth strategy. It should not be relegated to your Analytics department, or shouldered by a single optimizer. Because you can use testing to interrogate and validate major business decisions.
“Unfortunately, most marketers get [conversion optimization] wrong by considering it to be a means for optimizing a single KPI (e.g – registrations, sales or downloads of an app). However conversion optimization testing is much much more than that. Done correctly with a real strategic process, CRO provides in-depth knowledge about our customers.
All this knowledge can then be translated into a better customer journey, optimized customer success and sales teams, we can even improve shipping and of course the actual product or service we provide. Every single aspect of our business can be optimized leading to higher conversion rates, more sales and higher retention rates. This is how you turn CRO from a “X%” increase in sign ups to complete growth of your business and company.
Once marketers and business owners follow a process, stop testing elements such as call to action buttons or titles for the sake of it and move onto testing more in-depth processes and strategies, only then will they see those uplifts and growth they strive for that scale and keep.” –Talia Wolf, CMO, Banana Splash
Testing and big picture decision making should be intertwined. And if you want to grow and scale your business, you must be open to testing the fundamentals of said business.
Imagine spearheading a future-proof growth strategy. That’s what A/B testing can do for you.
In this post, I’m going to look at three examples of using testing to make business decisions. Hopefully, these examples will inspire you to put conversion optimization to work as a truly influential determinant of your growth strategy.
Testing a big business decision before you make it
Often, marketers look to testing as a way to improve digital experiences that already exist. When your team tests elements on your page, they are testing what you have already invested in (and they may find those elements aren’t working…)
“If I improve the page UX, I can increase conversions”
“If I remove distracting links from near my call-to-action button, I can increase conversions”
“If I add a smiling person to my hero image, I can capture more leads”, etc.
But if you want to stay consistently ahead of the marketing curve, you should test big changes before you invest in them. You’ll save money, time, resources. And, as with any properly-structured test, you will learn something about your users.
A B2C Example
One WiderFunnel client is a company that provides an online consumer information service—visitors type in a question and get an Expert answer.
The marketing leaders at this company wanted to add some new payment options to the checkout page of their mobile experience. After all, it makes sense to offer alternative payment methods like Apple Pay and Amazon Payments to mobile users, right?
Fortunately, this company is of a test-first, implement-second mindset.
With the help of WiderFunnel’s Strategy team, this client ran a test to identify demand for new payment methods before actually putting any money or resources into implementing said alternative payment methods.
This test was not meant to lift conversion rates. Rather, it was designed to determine which alternative payment methods users preferred.
Note: This client did not actually support the new payment methods when we ran this test. When a user clicked on the Apple Pay method, for instance, they saw the following message:
“Apple Pay coming soon!
We apologize for any inconvenience.
Please choose an available deposit method:
Credit Card | PayPal”
Not only did this test provide the client with the insight they were looking for about which alternative payment methods their users prefer, but (BONUS!) it also produced significant increases in conversions, even though that was not our intention.
Because they tested first, this client can now invest in the alternative payment options that are most preferred by their users with confidence. Making a big business change doesn’t have to be a gamble.
We’re proving our assumptions with data. Testing allows me to say, ‘This is why we took this direction. We’re not just doing what our competitors do, it’s not just doing something that we saw on a site that sells used cars. This is something that’s been proven to work on our site and we’re going to move forward with it.’
Your company has put a lot of thought (research, resources, money) into determining what you should actually offer. It can be overwhelming to even ask the question, “Is our product line actually the best offering A) for our users and B) for our business?”
But asking the big scary questions is a must. Your users are evolving, how they shop is evolving, your competition is evolving. Your product offering must evolve as well.
Some companies bring in experienced product consultants to advise them, but why not take the question to the people (aka your users)…and test your offering.
An E-commerce Example
Big scary question: Have you ever considered reducing the number of products you offer?
One WiderFunnel client offers a huge variety of products. During a conversation between our Strategists and the marketing leaders at this company, the idea to test a reduced product line surfaced.
The thinking was that even if conversions stayed flat with a fewer-products variation, this test would be considered a winner if the reduction in products meant money saved on overhead costs, such as operations costs, shipping and logistics costs, manufacturing costs and so on.
Plus! There is a psychological motivator that backs up less-is-more thinking: The Paradox of Choice suggests that fewer options might mean less anxiety for visitors. If a visitor has less anxiety about which product is more suitable for them, they may have increased confidence in actually purchasing.
After working with this client’s team to cut down their product line to just the essential top 3 products, our Strategists created what they refer to as the ‘Minimalist’ variation. This variation will be tested against the original product page, which features many products.
If the ‘Minimalist’ variation is a clear winner, this client will be armed with the information they need to consider halting the manufacture of several older products—a potentially dramatic cost-saving initiative.
Even if the variation is a loser, the insights gained could be game-changing. If the ‘Minimalist’ variation results in a revenue loss of 10%, but the cost of manufacturing all of those other products is more than 10%, this client would experience a net revenue gain! Which means, they would want to seriously consider fewer products as an option.
Regardless of the outcome, an experiment like this one will give the marketing decision-maker evidence to make a more informed decision about a fundamental aspect of their business.
Cutting products is a huge business decision, but if you know how your users will respond ahead of time, you can make that decision without breaking a sweat.
Testing what you actually offer, part II
Experienced marketers often assume that they know best. They assume they know what their user wants and needs, because they have ‘been around’. They may assume that, because everybody else is offering something, it is the best offering―(the “our-competitors-are-emphasizing-this-so-it-must-be-the-most-important-offering” mentality).
Well, here’s another big scary question: Does your offering reflect what your users value most? Rather than guessing, push your team to dig into the data, find the gaps in your user experience, and test your offering.
“Most conversion optimization work happens behind the scenes: the research process to understand the user. From the research you form various hypotheses for what they want and how they want it.
This informs [what] you come up with, and with A/B/n testing you’re able to validate market response…before you go full in and spend all that money on a strategy that performs sub-optimally.” – Peep Laja, Founder, ConversionXL
A B2B Example
When we started working with SaaS company, Magento, they were offering a ‘Free Demo’ of the Enterprise Edition of their software. Offering a ‘Free Demo’ is a best practice for software companies—everybody does it and it was probably a no-brainer for Magento’s product team.
Looking at clickmap data, however, WiderFunnel’s Strategists noticed that Magento users were really engaged with the informational tabs lower down on the product page.
They had the option to try the ‘Free Demo’, but the data indicated that they were looking for more information. Unfortunately, once users had finished browsing tabs, there was nowhere else to go.
So, our Strategists decided to test a secondary ‘Talk to a specialist’ call-to-action.
This call-to-action hadn’t existed prior to this test, so the literal infinite conversion rate lift Magento saw in qualified sales calls was not surprising. What was surprising was the phone call we received 6 months later: Turns out the ‘Talk to a specialist’ leads were far more valuable than the ‘Get a free demo’ leads.
After several subsequent test rounds, “Talk to a specialist” became the main call-to-action on this page. Magento’s most valuable prospects value the opportunity to get more information from a specialist more than they value a free product demo. SaaS ‘best practices’ be damned.
Optimization is a way of doing business. It’s a strategy for embedding a test-and-learn culture within every fibre of your business.
– Chris Goward, Founder & CEO, WiderFunnel
You don’t need to be a mind-reader to know what your users want, and you don’t need to be a seer to know whether or not a big business change will succeed or flop. You simply need to test.
Leave your ego at the door and listen to what your users are telling you. Be the marketing leader with the answers, the leader who can see the future and can plan her growth strategy accordingly.
How do you use testing as a tool for making big business decisions? Let us know in the comments!
The benefits of UI design systems are now well known. They lead to more cohesive, consistent user experiences. They speed up your team’s workflow, allowing you to launch more stuff while saving huge amounts of time and money in the process. They establish a common vocabulary between disciplines, resulting in a more collaborative and constructive workflow.
They make browser, device, performance, and accessibility testing easier. And they serve as a solid foundation to build upon over time, helping your organization to more easily adapt to the ever-shifting web landscape. This article provides a detailed guide to building and maintaining atomic design systems with Pattern Lab 2.
A recent post published on the ConversionXL blog highlighted a study conducted to find out how different A/B testing tools affect site speed. VWO was among the tools compared and we feel the results of the study are not an accurate reflection of our technology.
In this post, we are going to highlight some aspects of the study that had a large impact on the results and also elaborate on how the VWO code affects your page load time.
Sub-optimal Test Configuration with ‘DOM Ready’ Event Conditions
The inclusion of the ‘DOM ready’ event made the VWO code wait for the entire page to load before it could display the changes made in the variation. The web page used in the study had a page load time of around 2.7 seconds.
Here’s a snapshot of the campaign code from VWO settings (while the code waits for ‘DOM ready’):
Here’s another snapshot of the campaign code (using the optimal way, without ‘DOM ready’):
Executing after the DOM ready event will invariably increase the experienced loading time. Here’s the general case for it.
To counter flicker and ensure a smooth loading experience for visitors, VWO hides all the relevant elements before they start loading on the page and only unhides them once the VWO code has swapped them with the variation changes. All this happens within a span of 110 milliseconds on average. If the campaign had been configured using the optimal manner, the flicker effect would have automatically been taken care of by our SmartCode.
Asynchronous v/s Synchronous Code
As clearly noted in the blog post, “Most A/B testing software create an additional step in loading and rendering a web page”. This happens because many A/B testing tools use synchronous code. VWO, with its asynchronous SmartCode is an exception to this.
With its unique asynchronous code, VWO ensures there is no delay in the load time of the page. VWO’s asynchronous code does not block the rendering of parts of the page and does not impact the page load time.
What is asynchronous code and why does VWO recommend it?
Simply put, asynchronous means that the code will contact VWO’s servers in the background, download and process the test package while the rest of your page continues to load and render in the browser normally.
With synchronous code, the browser has to wait for the package to download and then process it before loading the rest of the page. If for any reason the tracking code can’t contact its servers then the browser will wait, usually for 30 to 60 seconds, until the request times out. If your tracking code is in the tag, then your entire page won’t load and your visitor will be stuck with a blank page. Asynchronous code does not have this critical problem. If for any reason, the asynchronous VWO SmartCode can’t contact our servers your page will still download and render properly.
Private and Dynamic Content Delivery Network (CDN)
VWO has invested years of engineering effort to ensure that we build the best-in-class technology and infrastructure for our customers. An important part of this is setting up our own private CDN which uses Bare Metal Servers from IBM SoftLayer’s state-of-the-art global data centers. This ensures that we always have a server close to your visitor’s location and there is minimum latency, reducing critical download time.
VWO’s CDN is also dynamic which caches not just the static code required to run tests but also generates dynamic test variation data. This has an edge over regular CDNs since they only cache static data. By dynamically generating test packages only the relevant variation data is sent to each visitor depending on the URL they are on.
Small Size of VWO’s Test Packages
Another factor that significantly impacts page load time is the size of test packages, which determines how long it will take for the browser to download it. VWO ensures small package sizes through two methods: by intelligently understanding and recording only the precise changes that you make to your page, and individually packaging tests for a visitor to deliver only the relevant content for the URL they are on.
Let us suppose you edit the HTML of your product page template to make two changes; increase the font-size of your text and insert a ‘recommended’ icon. VWO compares your changes to the original code and detects the precise edits – the change made to the CSS property “font-size” and the insertion of a new graphic. Other systems will save the entire block of code which will also convert the dynamic content into static content and will end up showing the same description across all product pages.
VWO’s CDN is custom built for optimal A/B testing performance. It unbundles the payload to make smaller packages for each individual test and URL. Some A/B testing tools bundle all the data for all tests running on a domain into one large package. We’ve seen package sizes of up to 3MB when a website is running many tests, which obviously increases page load time. VWO, on the other hand, only sends the data required for the test running on a particular URL to make a small, tidy payload which downloads quickly. This is especially advantageous when you’re a power-testing team running multiple tests on different parts of your domain.
Having said all this, we are confident that VWO’s best-in-class technology coupled with optimal campaign settings will ensure that your website never slows down. We would also like to invite OrangeValley to work with us on setting up their campaign correctly so that they can present a true comparison of all the tools in their study.
As always, if you still have any doubts or clarifications to seek in this regard, please feel free to reach out to me directly at email@example.com.
They say a picture is worth a thousand words. But online, a picture can be worth a thousand kilobytes or more! HTTP Archive shows that images make up 64% of a web page’s total size on average. Given this, image optimization is key, especially considering that many users will abandon a request if it doesn’t load within a few seconds.
The problem with image optimization is that we want to keep file sizes small without sacrificing quality. Past attempts to create file types that optimize images better than the standard JPEG, PNG and GIF formats have been unsuccessful.
As UX professionals, we know the value of conducting usability research. But UX research initiatives — even when designed well — are not perfect. A lab study to test a website, for example, would never perfectly capture a user’s actual behavior in the wild. This is because, inevitably, the research protocol itself will influence the findings.
A lab environment can never replicate the natural environment of the participant, and the mere presence of a research facilitator or moderator creates a dimension of artificiality that can thwart the research goals. They must not only facilitate sessions in such a way that the research goals are achieved, but also balance two challenges that are constantly at odds with each other: keeping the participant within the scope of the study, while allowing the participant to be in the driver’s seat in order to make the experience as realistic as possible.
A major Dutch healthcare professionals’ association decided to a/b test a seemingly minor change in its header image. Using VWO, it discovered that the change – removing a horizontal line in the image, could lead to a substantial 7.8% higher conversion rate, with almost 100 percent probability for consistent results.
VVAA, an association of over 75,000 Dutch healthcare professionals, specializes in providing quality advice to its members on areas ranging from setting up and managing a practice, to portfolio management and mortgages.
As a market leader in the healthcare industry and a pioneer in the area of medical liability insurance, VVAA attracts a very healthy traffic to its site. Visitors are greeted with a fairly big header image containing a list of benefits and a CTA button.
Things were good.
Then, the VVAA corporate communication had a design idea. A horizontal line representing a “lifeline” was added right at the bottom of the header image. The lifeline (that’s what I’m going to call it henceforth), it seemed, would be a good addition since it ties in directly with the industry that VVAA operates in. See the ‘The Test’ section for relevant images of the page.
Alwyn de Bruijn, the webmaster over at VVAA felt that the lifeline could be a distraction, leading visitors’ attention away from the CTA button. So, the association decided to A/B test the design against a variation that would be similar in all respects, except that it wouldn’t contain the ‘lifeline’. The hypothesis was that the variation would convert more visitors (measured as clicks on the CTA).
The A/B test ran for 20 days, on 7885 visitors who were randomly shown one of the two versions – the control and the variation.
How often does it happen that a lifeline gets discarded and the patient gets better?
The variation without the horizontal line effected a 7.8% increase in CTA clicks, clocking a super awesome 99.93% confidence level. In other words, VVAA could be 99.93% confident that the variation (without the ‘lifeline’) will yield a 7.8% increase on the number of clicks on the CTA.
Thanks to the A/B test, VVAA earned an objective basis to form a decision, and optimize its page for better conversions.
Now that we’ve got the facts out of our way, let’s look at even more interesting things, like,
Why did the Variation Win?
In Brujin’s own words, the variation (without the horizontal line) won “because the life line affects where visitors eyeline is placed on the page and might miss the CTA at the beginning.”
Beginning with a horizontal scan of the top section >
> then moving vertically down the page a bit > advancing across the page horizontally again >
> and finally going for a quick vertical scan of the rest of the page.
Hold on to that information. There’s another piece to solving this puzzle. In this study by Neilsen Norman Group, it emerged that visitors spend as much as 69% of viewing time on the left half of the screen.
Keeping both these insights in mind, let’s try and track the eye movement of Bob, a visitor on the VVAA page.
He scans across the page horizontally, covering most of the header elements. Then he moves down the largely empty left section of the page. That’s when the bright orange “lifeline” disrupts his flow. It acts as a leading line, guiding Bob horizontally along the line. By this time, Bob has already moved past the CTA button, which appears above the ‘lifeline’. He might then scan the rest of the page. But, rest assured, Bob and any business potential that Bob presented, have already been lost.
But, it’s right there, the CTA button, you might argue. Why wouldn’t Bob just notice it, and go right back to the real CTA?
What if Bob couldn’t notice the actual CTA button? (no, Bob is not blind)
The Curious Case of ‘False Button’
The ‘lifeline’ carries a bubble about right below the intended CTA button. The bubble also has a text element underneath it that says “Zelf uw zorg kiezen”, which translates to “Choose your care”.
Could the bubble pass for a prominent element – a false CTA, perhaps?
There’s more. The dialogue box that holds the actual CTA button has an appendage pointing right to the center of the bubble. That’s another cue for the visitor that the bubble itself is of some importance, diluting the attention that the actual CTA would otherwise receive. Also, that the lifeline has the same color as the CTA, doesn’t help with creating any discernible contrast, or a conversion.
But, the CTA is still there! Can’t you expect some Bobs to realize this? Yes, you could expect, but you’d probably be unreasonable in doing so. Why?
A simplistic explanation of a key tenet of the law is this – the closer and larger a target (a clickable element on a page), the faster it is to click on the target. This awesome Smashing Magazine article points out that the larger the absolute or relative size of a target button, the higher the probability for it to be clicked.
With the false ‘bubble’ button right below the actual CTA, and in the same color, the relative size (and visibility) of the CTA diminishes in the eyes of Bob, killing that tiny weeny chance for the CTA to be noticed.
Interesting? We’re not done yet.
The VVAA header image plays on an important psychological prompt – directional cue. By nature, human sight locks in on the eyes (or whatever looks eye-like) of a human or human-like subject and then follow the line-of-sight of the subject. Most likely, this trait has its roots in evolution. In the case in question, the woman’s eyes lead Bob towards the part of the image that has quite a few elements – the actual CTA button, the false button and the pointy bit of the dialogue box appendage. By clustering together these elements, the page robs the actual CTA button of its intended prominence. There goes your Big Orange Button for a toss. And Bob, too.
By taking the lifeline away, and with it the false CTA, the actual CTA gets ample white space around it. This accentuates the importance of the button, improving conversions or useful clicks on the CTA. Here’s a good read if you think white space is wasted space.
What Do You Think?
Should such seemingly trivial changes (removing the lifeline) be implemented based simply on intuition? Or would it be prudent to have changes, however minor, tested first?
It would also be interesting to know if you are able to identify the possibility of such minor major changes on your current page.
Let us know in the comments section right below. You can also reach me on twitter @SharanTheSuresh or hit us with your thoughts on twitter @wingify.
Harvard Business Services is a Delaware-registered agent and helps people incorporate their companies in Delaware. They also help their clients form LLCs and corporations and assist with filling their franchise taxes.
To encourage more people to buy their services they decided to redo the navigation bar on their homepage. With that in mind, they tweaked certain tabs, did away with some and also introduced a new tab.
The goal was to get more people to click on the tabs, engage them with the website and ultimately make them buy.
On the original homepage, there were 10 tabs namely — Home, Get Started Now, Our Services, Compare, Learning Center, Blog, Make a Payment, Videos, About Us and Contact Us.
This is how it looked:
In the variation, they made a couple of changes:
The “Compare” tab was renamed to “Compare Prices”
“Get Started Now” was renamed to “Form a Company Now”
A new tab “How to Incorporate” was introduced, which is also present as a link in the left pane on the original homepage
The tabs Blog, About Us and Contact Us were removed
Here’s how it looked:
The test was run on close to 32,000 visitors. The goals that they were tracking were visits to the price comparison page, “How to Incorporate” page. And primarily, the actual sales.
The variation emerged as a winner and recorded 15.68% increase in total orders completed. Visits to the price comparison page and “How to Incorporate” page also increased by 66.26% and 382.45% respectively.
Here’s why I think the variation was able to increase the engagement on their website and also give them a whopping 16% increase in sales:
Renaming the “Compare” tab to “Compare Prices” made it absolutely unambiguous. The word “compare” alone didn’t really give users a clear understanding of what they would see if they click on the tab.
This was an important business change as Korin, who setup this test, puts it, “This (visits to the comparison page) is especially important for us because we work in a competitive industry and our prices are an obvious way that we stand out from the competition. We’re thrilled that this small change has enticed visitors on our site to click through to a page that compares us with the competition, so that they can be more confident in their purchase.”
Changing “Get Started Now” to “Form a Company” made the tone of the tab more authoritative. The new verbiage instilled a sense of confidence and made the mundane process of getting started sound more purposeful.
The new tab “How to Incorporate”, which was originally also present as a link, got them an astounding 382% more visits to the page. This clearly proved to DelawareInc. that a large number of their visitors want to be educated first before they make a purchase.
Essentially, A/B testing allowed them to hear their users speak — that they needed to understand the process before incorporating their company and wanted to see that information upfront. And not sift through multiple links in the left pane.
This was an important business learning for HBS. Their analytics tool also told them that a lot of people from this page moved to the final purchase page bridging the much-required gap between bouncing off and making an informed purchase.
Korin was thrilled with the results. She told us that she loves VWO and is constantly trying out new tests. Shout-out to Korin — we love power users like you too!
Let us and Korin know your views about this case study in the comments section below.