Top Conversion Optimisation Company Australia 2023

CRO: What is A/B testing and how does it help conversion rates?

When discussing conversion rate optimisation (CRO) it is nearly impossible not to include A/B testing. With the help of a myriad of analytics tools, businesses can track how their targeted audience responds to certain changes and the effects it has on their key performance metrics. CRO Specialists and digital marketers with an understanding behind ab testing can gather both qualitative and quantitative user insights and make data-informed decisions to produce positive results for their business. If you’re here to learn the ins and outs of A/B testing and how it helps conversion rates, read on, as we start from the beginning.

Here’s what we’re going to cover:


What is A/B testing?

A/B testing, also known as split testing, refers to the method of comparing two versions of a variable, such as a landing page testing, call-to-action button, ad or email, and determines which version supplies the highest selected outcome, such as leads, or CTR (click through rates). In A/B testing, ‘A’ refers to the control or original testing variable and ‘B’ refers to the variation or a new version.

Image from Optimizely

The variants are shown to differing users randomly and the performance is then analysed based on key performance metrics. A/B testing is a fundamental component of conversion rate optimisation. Split testing provides data and clarity on potential changes to a variable; it collects data that signals the impact of any change/s.


How Does A/B Testing Work?

A/B testing can be as simple or as complex as required. For example, you may want to test a single headline, call-to-action button, or conduct a complete redesign. Generally, half of the users will be shown the original version, and the other half will be shown the modified version. The version that delivers the most favourable results will be your guide to optimisation.

As users are delivered either the control or challenger, their engagement with each experience is measured. Analysing these results will enable you to determine whether changing the experience had a positive, negative or neutral effect on user behaviour, conversions and/or clicks.

As you optimise your webpages, you might discover there are several variables that can and should be a/b tested. To evaluate how effective a change is, it is recommended that you isolate one independent variable and measure its performance. Ie. Change the colour of a CTA button first, then move onto changing the form. Don’t do both at once.

Split testing several different variables at once may lead to unclear information about which variable is responsible for the changes in performance. Therefore, focusing on one change at a time will help pinpoint which edits influenced visitor behaviour, and which ones did not. Over time, you can combine the effect of multiple positive changes and significantly boost your conversion metrics. To be clear, you can test more than one variable for a single webpage, however testing them one at a time will ensure you gain the most accurate and reliable results.


Why should you utilise A/B testing?

A/B testing helps to identify any problems that may be affecting your core conversion metrics, like leaks in the conversion funnel, drop-offs in payment etc. Not only does split testing help to answer quick questions, but it continually improves user experience. Here are some ways that A/B testing can help your conversion:

  1. Achieve better ROI from existing traffic
    It comes as no surprise that the cost of acquiring quality traffic on your website can be significant. To get the most out of your existing traffic, A/B testing allows you to increase conversions without increasing your advertising budget to acquire new website visitors. A higher ROI is likely to result from existing traffic when you A/B test as you improve the user experience and optimise your content for your users.
  2. Improve Bounce Rates
    We have previously explored the importance of bounce rate in analysing the performance of your website. A visitor who bounces from your website will not convert and there are several causes that may results in this action, such as low-quality content, unclear call-to-actions and confusing navigation. There is no optimal bounce rate for any one site. Although businesses and industries can set expectations based on averages, your website is unique to your business and your bounce rate is a starting point that can be optimised. If it is currently 40%, and that’s great for your industry average, that doesn’t mean it couldn’t still be improved with CRO tweaks. A/B testing marketing is the best way to determine which variation of your content has the most positive impact on your users.
  3. Make low risk modifications
    Testing and then modifying minor, incremental changes to your webpage can reduce the risk of jeopardizing your current conversion rate and save you a lot of money. A/B testing optimises resources for maximum output with minimal modifications. For example, you may be looking to introduce a new feature onto your website, however it is unclear if this change will positively affect your website visitors. By conducting a split test of the new feature you can understand the impact of the change before it is implemented across your website. Creating certainty around the outcome of the change will help to pay off in the long run.

How to conduct A/B testing?

1. Determine Which Conversion to Improve

Analytical insights will help with optimising. Elements of your webpage, app, or ad that have low conversion rates or high bounce rates are often a good place to start. And if you’re starting with poor KPIs, you have no where to go but up!

2. Identify Your What Results You Want

Optimal KPIs are typically data-driven, like higher click-through-rates, a higher conversion rate on form submission, or a longer time spent on page. You need to decide what KPI you want to measure before you begin split testing.

Although you may measure several metrics during the test, we recommend choosing a primary metric to analyse. This acts as your dependant variable, which will change based on how you manipulate the independent variable. Your dependant variable will help you to determine whether the variation is more successful than the original.

3. Hypothesise the change

Once you have identified your primary goal, you can generate a clear and official hypothesis. For example:
“If I change the CTA button from green to blue, I expect the CTR to increase.”

You may also like to include a statement about why you think this will happen. A strong hypothesis gives you an objective statement to refer to after you complete your test. It will The data will determine whether your hypothesis was correct and you achieved your desired outcome.

4. Create the variations (The A & B)

Now that you have your dependant and independent variables and have hypothesised the desired outcome, you can set up the original or control version of what will be tested – the ‘A’ version. This could be the call-to-action button you currently use, or the landing page used in your marketing.

Next build the ‘B’, that is the modified or altered version of your call-to-action button or landing page testing. Remember, the change should only focus on one element. So, if you want to optimise your landing page by testing a change to the heading, then only change the heading on your ‘B’ version.

5. Run the experiment

There are various A/B testing marketing tools you can use to run split testing experiments. The most common is Google Analytics when performing an A/B test. Typically, visitors are randomly assigned to either the control or the variation in the experiment. For tests where you have more control it is best practice to test with two similar audiences for conclusive results. All user experience and interactions are measured, counted, and compared to determine how each performs.

6. Measure and analyse results

After you complete the A/B test, refer to your primary goal metric in your analysis. Although you may measure and inspect multiple metrics, your goal metric will determine whether you achieved the desired outcome. For example, if you tested two variations of ad creative, and chose leads as your primary metric, don’t overanalyse click-through rate. A new ad variation may have generated a higher click-through-rate but lower conversion. Based on your primary goal you should keep your existing ad content as that generated more conversions, despite a lower click through rate.

7. Act based on your results

From analysing the performance of your primary goal, you can determine a winning variation. The losing variation should be disabled in your A/B testing tool to complete the test. From here you can then implement the winning variation.

If neither variation is statistically better, the results of your test will be inconclusive. This means that the variable you tested did not impact results and users. This may mean you can implement the new content without fear of a negative impact to users, you can stick with the original variation or plan another test.


How long should A/B testing marketing run?

It is important to allow your test to run long enough to obtain a substantial sample size as it’s required to confidently determine whether there was a statistically significant difference between the two variations tested. Obtaining statistically significant results could happen in a matter of hours, days or weeks, depending on your business and how you ran the A/B test. Ideally, you want the test to run long enough to make sure there is no evidence of results convergence. This occurs when there appears to be an initial significant difference in the two variations, but the margin decreases over time. If this occurs during a split test, you can conclude that the variation did not have a significant impact on your primary goal metric.

A useful guide for how long it may take to get results is how much traffic you generate. If your business does not get a lot of traffic, it will take longer for you to run an A/B test to develop a substantial sample size. Conversely, a business that receives high traffic volumes may generate a functional sample size quickly.


What Can You A/B Test to Improve Conversion Rates?

Split testing can help you analyse the performance of all the elements on your website, emails, and marketing campaigns. Determining where to start with A/B testing should always be backed by analytics to identify your conversion rate pain points. Testing the elements that are likely to have the biggest impact on your conversions will help to ensure you are utilising A/B testing effectively. Here are 5 examples of areas for conversion rate optimisation that may apply to you.

1. Headlines

The headline is typically the first thing visitors notice. If it does not grab attention, link to a user’s intentions, or compel a response then you will not get the conversions you want. Experiment with highly focused headings, catchy and to the point to observe positive changes in user behaviour.

2. Landing Pages

The purpose of your landing page is to encourage users to convert. If your landing page is not converting your users, then you’re losing potential customers. A/B testing your landing pages should be carefully thought-out.

A good place to start is with a heat map to determine where visitors are viewing and clicking on your landing pages. A heat map collects data that can help you decide which elements are the most important to test for optimisation as it shows where users are spending their time.

Image from CrazyEgg

3. Call-to-Action

A call-to-action button can be tested in various ways including, copy, colour, shape, size, and placement. Most conversions will take place after people click on a call-to-action; therefore, it should stand out immediately and capture attention so that it cannot be missed. Consider testing the placement of your call-to-action by analysing a heat map or experimenting with more compelling content.

4. Content Depth

Depending on your consumers, some may prefer valuable information that provides a basic overview of a topic, while others may want to drive deeper with more longform information. You can test what your target consumers prefer by testing content depth. Create two pieces of content, one significantly longer than the other providing more information on your product or service.

5. Forms

A form is extremely important for lead generation and encouraging conversions. Asking for a lot of information from your customers may cause frustration if you require a lot of detail. A/B testing your forms along with the required research to determine which fields your potential customers are most likely to feel comfortable in providing could give you valuable insight into what fields to require in a form and which to ignore for now.

A/B testing allows you to gain deep insights into establishing what content your target audience wants to see and which marketing tactics resonate with users. After reading this comprehensive introduction to A/B testing, you should be fully equipped to begin planning your next steps for conversion rate optimisation. Dedicate your time to creating the most effective changes that will positively impact your business and watch it pay off in the long run.

Some Split testing tools we’d recommend are:

What is A/B testing?

A/B testing, also known as split testing, refers to the method of comparing two versions of a variable and determines which version supplies the highest selected outcome, such as leads, or CTR (click through rates).

How Does A/B Testing Work?

Generally, half of the users will be shown the original version, and the other half will be shown the modified version. The version that delivers the most favourable results will be your guide to optimisation.

How long should A/B testing marketing run?

Obtaining statistically significant results could happen in a matter of hours, days or weeks, depending on your business and how you ran the A/B test.

Share this:


Free 25 Page eBook

Download the Influencing Your Digital Marketing Metrics ebook

Growth in numbers translates to growth in business, learn about the digital marketing KPI’s that can dramatically boost your business trajectory.

Free 25 Page eBook

Download the Influencing Your Digital Marketing Metrics ebook

Growth in numbers translates to growth in business, learn about the digital marketing KPI’s that can dramatically boost your business trajectory.

Where to from here?

Book Your Digital Strategy Session

Free 45 Minute Digital Strategy Session

We’ll get in touch with you to arrange a time for your session and gain some initial background on your business needs

What you'll get

Website Audit

A strategic look at your website from the inside and out conducted by one of our senior digital strategist’s

Industry Strategies

An insiders view of what unique strategies work for similar businesses in your industry and how you can capitalise on these learnings

Spy on your competitor’s

A sneak-peak at what your competitors are doing online

Success framework

A digital marketing success framework tailored to your business

Niki Patterson

Business Assist help us with the growth of our business, which is what every business wants, and also it really feels like everyone on the team understands and knows your business well. It’s not just one person, everyone is somehow involved and I appreciate that. Thank you so much for all your hard work in fixing our campaigns. We are all incredibly appreciative.

Jo McMillan

Business Assist were a pleasure to work with as we developed our new website. They were responsive, considered and always sought to provide us with the best possible product at a competitive price. We are very happy with the website they produced for us and have had a lot of positive comments on it. Business Assist is also great with follow up and ongoing support, should we need it.

Dean Burns

We only launched Rent Busters Perth in November 2018, so it is incredible that Business Assist generated over 500 leads for us in June 2020!  They helped us with our branding, market positioning and have since worked very closely with us on developing new offers, headings and campaigns every month. And most importantly we are signing a record number of deals every month!

Business Assist are more like our business partner than supplier and we heavily rely on their expertise and the results they deliver are extraordinary – I can’t recommend them more highly.

Lisa Bywaters

We’ve been working with Steve and the team at Business Assist since 2010.  With an information dense website it’s vital for us that our visitors find the information they need, when they need it. The BA team understand that people search for information in an organic way, that it’s not a linear process. By using their expertise, we now have a friendly, welcoming website that allows visitors to find the information they need quickly and easily. They were also extremely helpful when we transitioned to our new name and new website – with everything from developing a new website that incorporated consumer and staff feedback, to developing an SEO strategy and Google Ads campaigns that helped us retain our past users and attract new ones. They’re a professional, friendly team that takes the time to get to know the needs of your organisation and your website users.

Tony Raunic

A few years ago Hunt & Hunt Lawyers decided to put more resources into our SEO.  We interviewed a number of contractors who all promised their services would be superior.  We were struck by Steve Foura and his team’s preparedness to invest time in learning about what was distinctive about our business and what we particularly wanted to achieve.

We appointed Business Assist to focus on SEO improvements for aspects of our property team marketing including our compulsory acquisition advisory services.

The results have been outstanding with web-based enquiries growing exponentially and, critically, the right prospective clients contacting us and invariably converting into fee paying clients.

We certainly recommend Business Assist highly for any professional services business looking to better leverage its internet presence.

Ultimately, Hunt & Hunt asked Business Assist to develop a new website for our national legal group and we are very pleased with the results.

We continue to work with Business Assist today across various teams as we derive great value from Steve’s practical layman’s advice on SEO.  Business Assist also understand our business and genuinely seem to go the extra mile to add value.

Robert Thorpe

It felt that our previous digital agency was not very engaged with our business – there was a real disconnect.  With Business Assist we feel like we’re talking to the people who are actually implementing the campaign, or at least have a very good understanding of it.  We believe this is one of the main  reasons we saw results happen straightaway – increased new customer inquiries from Australia and overseas. But the other thing we get is great advice from Business Assist about things we can and can’t do from a Digital Marketing perspective. We trust really these guys. The other thing we’re getting is the changes we’re asking to make or services we’re changing, it happens really fast – there’s nothing like a 2 week period of waiting.

Amanda Greer

We’re a small business but we try and behave like a bigger company and Business Assist help us lift that bar. They have helped us get ahead of our competitors. We have a strategy meeting soon where we will develop a 5 year plan and we look forward to Business Assist’s input and planning what we should be working with them on for the next 5 years.  Business Assist have a  really good personable team and they tailor to us – we really like the flexibility. We’re very strategic in what we do and Business Assist helps us enhance our competitive advantage by reacting to opportunities quickly. Our position, interests and needs are well aligned.

Dave Porter

Business Assist are responsible for our new leads coming in. Increasingly, we are becoming more and more reliant on digital marketing as the other avenues are either too expensive or deliver little or no return. So we are extremely reliant on Business Assist.  And they have delivered for us for many years and continue to do so in 2020 where we keep having all-time record revenue weeks! We also really appreciate the team at Business Assist and I’ve always enjoyed working with a company that we feel as though they are really part of our team. We have a very healthy working relationship.

Karl Zimmerman

Since hiring Business Assist to take over our in-house Digital Marketing management, our Google Adwords spend has gone down by 75-80% and our traffic has increased by over 150%. To see such a massive drop in spend and yet an increase in traffic has to be one of the biggest and most impressive things I have ever seen.

Also, compared to what we were getting before, we see Business Assist basically as a free investment with the high returns and the increase in traffic we are getting. Not only that, each time we face any problems, the team gives us much valued solutions, not just ‘yes, we can fix that’ but also different options to choose from.

Business Assist gave us the ability to trust them with our money compared to the other 3-4 companies we had before them. We now can see where our money is going and the returns for it. They also take the time to explain details to us and make sure we are given regular updates. As we grow as a business, we see us growing with Business Assist.

Brayden Cameron

We have been using the Business Assist team since 2013. Coming from a trade background in Roofing & Roofing maintenance and jumping into Digital for all that is involved is a daunting task. We know everything worth knowing about our own trade and Digital is such an unknown area. In turn we were so hesitant because we felt like we were getting ripped off from previous attempts with other agencies and any requests for information or advice would have an extra charge or a feel like such an up-sell. Upon working with the Business Assist team we have COMPLETE clarity around the following:

  • Cost Vs Conversion (analytics)
  • Competitor analysis
  • Our target market and how to attract them
  • Brand Strategy Marketing
  • Social Media
  • SEO & so much more.

Providing these services should be a given for any Digital company – however we have found that it is not. Providing this whilst maintaining honesty and transparency even educating us along the way, whilst not making us feel like idiots because we didn’t know certain terms throughout the process is the real benefit working with Business Assist. We have meetings every week / fortnight with the team to report on every aspect of the business on a digital front. We feel the Business Assist team is an extension of our 40 + family. I think we are really fortunate we found a company that propelled us to grow from 2 staff to 40+ in 7 years – they know our company as if it was their own!