Articles in the Multivariate Testing Category

Down about your Bounce Rate? Do these five things to improve it today!

May 29th, 2009 by Joe Teixeira

Bounce Rate - Improve it Today!Bounce Rate - the most popular two words in Web Analytics today. It’s become a cliche, a catch-phrase if you will. Everyone is talking about Bounce Rate and how good, how bad, how low or how high it is, and quite a number of folks have started to use Bounce Rate as an evaluation metric for success. I can safely speak for everyone involved with Google Analytics when I extend a huge “Thank You!” to all of you who have embraced it!

Interestingly, Bounce Rate is one of the only metrics in Web Analytics that we want less of. We want lower bounce rates, not higher, and fewer bounces, not more. A question I get asked at least three times a week by clients and co-workers alike is “How do we lower our Bounce Rate?” There are a lot of things that you can do, but there are only so many options that have proven to be effective over time. Today, let me share with you five different things that you can do - today - to start decreasing your bounce rate,  by keeping your website’s visitors engaged with your website.

1. A “Higher” Call-To-Action
Have you ever heard the expression “Out of Sight, Out of Mind“? A persuasive and engaging call-to-action that is very low on a page, say, below the fold of a page, can cause visitors to lose focus and get distracted by your content / video / latest web 2.0 toy, which may cause the visitor to hit the back button or close their browser before visiting the next page on your site. No matter how nice of a call-to-action you have and no matter how attractive the offer or pitch may be, it needs to be highly visible to your website’s audience so that they can react (positively) to it and click on it, thereby lower the number of folks who bounce off of the page.

2. A Sync with your Ads and your Landing Pages
No, I’m not talking about N’Sync - I’m talking about a strong connection between the ads and the messaging you are using with the page that you are directing all of your future visitors to go to. One of the biggest factors that could be driving your Bounce Rates higher and higher is a mixed message that you are sending to your potential visitors. For example, if your ad copy says “15% Off!”, you need to make sure that “15% Off!” is the very first thing that a visitor sees when they hit your website. If you have “multiple sizes and colors available”, direct the visitor to a page where they can choose their favorite color and the right size. Using a promo code in your ad? Create a unique landing page and have the promo code appear right away on the page, so that visitors will feel the connection between your marketing message and what’s really happening on the website.

3. Improper Tagging on your Website Pages
A silent but very deadly killer, untagged pages of your website can only do your website harm. When some pages are missing the Google Analytics Tracking Code, visitors reaching those pages will have their referral cookie updated, thereby resetting information like “google / organic”, the campaign, and the keyword they used to reach you. At all times, when uploading a new page or section to your site, stop and make sure that the Google Analytics Tracking Code is present on your new page(s) first before uploading. This will save you a lot of head-scratching, unnecessary report ugliness, and will decrease your Bounce Rate, all at the same time!

4. Writing for your audience
Khrysti / SEO Team - I haven’t forgotten about you, because I am still writing “Content Is King!” That statement definitely translates to the Analytics side of things, and helps reduce your Bounce Rate. Use a combination of Google Insights for Search, Google Ad Planner and Google Trends for Websites to get an idea of the type of traffic that your website can receive, as well as valuable demographic information which could represent your future audience. Once you are comfortable with the type of audience and volume you expect to receive, write your website’s content appropriately and specifically targeted, so that visitors will feel a connection with what you’re saying. To use an exaggerated example, you wouldn’t want to talk about the fashion stylings of the cast of “The Hills” if your website sells motorcycle insurance (This, unfortunately, happens a lot on the web and it leads to a high number of bounces).

5. Testing, Testing, 1…2…3!
Finally, it’s essential that you incorporate some program of testing and experimentation on your website on a weekly or monthly basis. Each and every week (or few weeks), you should think about some element of your website or some element of an advertisement that you’ll want to experiment with, to see which version is the more profitable and successful one. Google Website Optimizer is a fantastic product where you can easily create as many experiments as you’d like, and see clear results in no time. You can also create a Website Optimizer experiment from start to finish in well under 10 minutes, which means you won’t have to be bogged down with hours of set-up and design time. Testing and experimentation with Google Website Optimizer is one of the best ways to decrease your Bounce Rate over the long-run, while sky-rocketing your conversion rates at the same time!

So there you have it - 5 great things that you can do today to start lowering your Bounce Rate, keeping your website’s visitors engaged, focused, and happy with you!

Posted in Tealeaf, Omniture SiteCatalyst, Key Performance Indicators, WebTrends, Coremetrics, Competitive Intelligence, Urchin Software from Google, Omniture Test & Target, Google AdWords, AW Stats, Web Analytics Metrics, Google Website Optimizer, Google Analytics, A/B Testing, Multivariate Testing, Yahoo! Analytics, Site Usability, Web Analytics

VERY URGENT: INCREASE YOUR ECOMMERCE REVENUE BY 100,000%!!!

March 25th, 2009 by Joe Teixeira

Dear Sir / Madam,

You may be very surprised on receiving this letter from me, since we have never met before. My name is barrister Joe Teixeira, a Malaysian national and personal representative to my client, Google Analytics.

The reason that I write to you is of the utmost importance. I need your help in securing the funds that your website can bring to you, before the National Bank of Malaysia closes the account. The funds in my client’s account are estimated to be valued at ONE HUNDRED FORTY MILLION UNITED STATES DOLLARS, which have been deposited in your name as the next of kin, provided you agree to the terms outlined below.

The bank has issued me a third and final notice to contact the next of kin (you), or the Google Analytics account will be declared unserviceable and the funds will be dispersed to the treasury department. All efforts to get a hold of someone else have failed - you are the last person I could find to contact.

I am asking you for your due diligence, and advise you to perform the following actions on your website to increase your Ecommerce Revenue by ONE HUNDRED THOUSAND PERCENT:

1. Design a clear “Call-To-Action” on your website’s homepage, and pay-per-click landing pages,
2. Continually refine, test, and optimize your landing page, your CPC ads, your keywords, you keyword’s match types, and any other settings possible,
3. Use Google Website Optimizer to conduct A/B or Multivariate experiments to boost conversions and increase revenue,
4. Test out different selling propositions, conversion incentives, ad titles, and anything else outlined in this blog post,
5. Install Google Analytics Ecommerce Tracking Code, and perform Traffic Source, Campaign, and Keyword-level analysis, focusing on revenue, average order value, and conversion rate,
6. Offer a clean, easy-to-use and friendly Ecommerce Shopping Cart, with flexible payment options, clear pricing sub-totals and grand totals, and smooth page-to-page transitions,
7. Provide discount coupons and promotional codes for all return customers,
8. Work to provide fast, reliable, secure shipping and delivery confirmation of purchased products.

When these elements are achieved, and a culture of testing and optimization has been successfully instilled in your company, we will share the funds on a mutually agreed percentage, as my client outlined in his will.

All the legal documentations to back up your claims to your State Department will be provided to you by me. You may also view the Google Analytics Terms of Service for additional privacy policy information. I simply require your honest co-operation to enable us to achieve this transaction.

The intended transaction will be executed under a legitimate arrangement that will protect you from any infraction of laws. Please accept my sincere apology if this proposition offends your moral ethics. Please kindly get back to me if you wish to achieve this goal with me.

Kindest Regards,

Barrister Joe Teixeira, Esq.
Google Analytics Authorized Consultants
+01 561 620 9682

Posted in Multivariate Testing, Site Usability, A/B Testing, Web Analytics Metrics, Google Analytics, Google Website Optimizer, Web Analytics

Wednesday Interview Series: Bounce Rate

February 11th, 2009 by Joe Teixeira

Every Wednesday, I sit down and interview different metrics or report sections from Google Analytics. I ask the tough questions - and I expect straight answers! (This, obviously, is a fictional interview. However, if metrics or reports could talk and be interviewed, this is how I imagine their personalities being and how they would answer my questions. Hopefully this will be a fresh, interesting way to learn about the wonderful world of Google Analytics in a unique way).

Joe Teixeira - “Hey there Bounce Rate, how’s it going?”
Bounce Rate - “Hey Joe! Right now I’m doing great and flying low…but tomorrow I may be down on my luck…”
JT - “Well, why do you say that?”
BR - “There’s a reason my name is “Bounce” Rate - sometimes I’m very low and loved by everyone - other times, when I’m a bit higher, I’m scrutinized and examined like a Wall Street executive on Capitol Hill.”
JT - “Well, you’re a very important metric, Bounce Rate. People really seem to love you when you’re low…”
BR - “I know, I know…it’s just…why can’t they always love me, even when I’m high? I mean, I’m just a metric…why can’t more people look at other things, too?”
JT - “Are there any other places that you want people to start paying attention to?”
BR - “Yeah - and I hate to put him on the spot, because we go way back - but people should look at me when they’re looking at Top Landing Pages. I mean, it’s a great place for everyone to find out how effective each one of the pages of their website are as an entry point, as a landing page.”
JT - “So you feel as if people may be looking at you in a way that you feel is not necessarily the best?”
BR - “Oh yeah, absolutely! When people look at me on the Dashboard, they either love me or hate me - there’s never any middle ground. Well, I think people should really go beyond the Dashboard and see me when I’m broken down by each individual landing page or keyword!”
JT - “Have you talked to Top Landing Pages or Keywords about this?”
BR - I talked to Top Landing Pages - he agrees with me. It’s hard to get a hold of Keywords now a days, though. A lot of requests for him, you know…”
JT - “Sure, I bet.”
JT - “Let’s move on. What percentage makes you happy? 25%? 30%? 50%?”
BR - “See, there you go. You’re just like everyone else; you want a fixed percentage for me. Why can’t anyone accept me for who I am? Sometimes I can’t be 25% - but that doesn’t mean 25% is too high. Other times I can’t get lower than 60%, but - in a lot of industries - 60% is really good! Yet so many people tell me “I want you to be 15% across the board”, and depending on the site and the industry, I just can’t get that low…I just can’t…”
JT - “I’m sorry - I didn’t mean to hurt your feelings. But you’re so great at pointing out to [most] of us the pages, keywords, and even the site search terms that we need to focus our optimization efforts on…sometimes we get greedy and we want you as low as possible!”
BR - “It’s not like I’m not trying to be low, Joe…I DO try…but there’s nothing I can do when sometimes there are just so many bounces that have to be divided into the number of entrances…if people just focused more on helping me be lower, rather than yelling and cursing at me for not being low enough, I probably would be much lower over time!”
JT - “I agree with you. One final question before I let you go: recently, Google Analytics has decided that your long-time friend, setVar, would no longer be counted as an interaction hit. Have you spoken to setVar at all since the announcement?”
BR - “Yeah, I talked to setVar a few times - he’s sorrier for me than I am for him, because now that he’s not an interaction hit, I’m going to go up at least a few percentage points here and there. But I’m OK - and I’m happy for setVar, you know. I think it’s important that he’s classified and tabulated properly from now on.”
JT - “Thank you, Bounce Rate. Hang in there…”
BR - “OK, thank you…I will…”

Tune in next Wednesday, where my special guest will be the notorious Average Time on Site. You won’t want to miss it!

Posted in Site Usability, Google AdWords, Urchin Software from Google, Multivariate Testing, Web Analytics Metrics, Google Analytics, Google Website Optimizer, Web Analytics

This types of stuff happens eh-veh-ree-DAY!

July 17th, 2008 by Joe Teixeira

In my latest, most desperate of attempts at trying to make our loyal blog readers think I’m hip by using titles that come straight out of popular phrases in rap songs (which is in conjunction with my last attempt with a blog post entitled “Tryin’ to make a dollar outta fifteen cent!“), I’d like to give you an idea of what the typical day-to-day life is like here for me at MoreVisibility. Every time I describe what I do to friends, colleagues, co-workers and even some clients, I talk about how being in Web Analytics is like being a private investigator or a federal agent of the internet. You gather data, compile statistics, find clues, compile some more data, interview a couple of people, and solve the mystery! Then you typically have to present your findings to your boss(es) and your clients, and then talk about where to go from there.

Here’s an outline of a typical day for me (which is sort-of a false statement, because no two days are the same, so there really is no such thing as a “typical” day…but you get the idea).

Date: Wednesday, July 9, 2008, Boca Raton, FL, USA (Temp: 91°)

7:04 AM - I have just woken up, and I’m already thinking about what I’m going to be doing for that day. Do I have an Analytics presentation to give? Do I need to check the coding on a site before it launches? What accounts will I be doing some investigating on? Do I have enough laundry to last until the weekend?

7:57 AM - I arrive at my office, turn on my computer, and see a yellow sticky note on my monitor that reads “Joe - Please see me about [Client]’s Top Landing Pages.”

8:01 AM - While my computer is loading and my email is downloading, I catch my co-worker who explains that our client is concerned that the exits from their homepage is too high. I suggest evaluating the page’s Bounce Rate and maybe a quick Navigation Summary to get a better idea of what is really going on with their homepage. I also mention something about A/B testing with Google Website Optimizer.

8:02 AM - I log-in to my Google Reader account and catch-up with the 60+ Web Analytics and Search Marketing blogs that I subscribe to, while simultaneously responding to emails with questions and discussions from co-workers.

8:41 AM - I am finalizing my speech for an in-person Analytics Presentation to one of our clients, when Amber (Client Strategist) buzzes me and tells me her client added an email address to their Google Analytics account, but they cannot log-in. She tells me she knows what the reason is: “The Email address is not a Google Account yet! It needs to be a Google Account in order to log-in with that Email address into their GA Account.” I start smiling, because that’s exactly right.

9:15 AM - I meet with Shawn, our newest co-worker, and begin to review all of the great things that is Web Analytics. Of course, I have to throw in my private investigator / federal agent simile. I also explain that Javascript-based programs like Google Analytics are only able to collect data from users who have both Javascript and Cookies enabled on their browser of choice. If they don’t, Google Analytics simply cannot track those individuals.

10:30 AM - I am out of water, and I’m starting to get hungry. I think about all of the different possible ordering options, and think how cool it would be if some of our favorite local take-outs would have an online ordering option, and imagine what I would give for a large turkey & swiss right now.

10:35 AM - I start to open up a brand new Google Analytics account for a new client. I provide our client with the necessary tracking code to be placed on every single page of the website. I also explain the many different options available, such as SiteSearch, Ecommerce, Benchmarking, and Filters that can be utilized.

10:59 AM - I receive a phone call from another client who asks me to explain the difference between A/B Testing and MVT (Multivariate Testing). We throw around some ideas of what to test and experiment back and forth, and we agree to launch an experiment using Google Website Optimizer for their AdWords Campaign’s landing page.

11:33 AM - Okay I am REALLY hungry right now and I can’t imagine being able to last another 27 minutes without eating something!

11:34 AM - Marni (another Client Strategist) sends me an IM that reads “It’s working!!!” She is referring to the neat advanced filter that we wrote which added the name of the source and the visitor type in front of the transaction ID in this particular client’s Ecommerce Report section. This is great news, as I’m sure the client will be very happy to hear about this.

12:00 PM - I’m about to grab my sunglasses and walk across the street when I see an Email come in that reads “GA Tracking Issue - Please Help!”, flagged as High Importance. Guess lunch is going to have to wait a while…

12:19 PM - Problem solved! Turns out there were two sets of Google Analytics tracking code on the same page, one urchin.js version and one ga.js version, which is bad news. I then proceed to solve another problem - my hunger.

1:10 PM - I return and find some great discussions starting up on the Yahoo! Web Analytics Forum. It’s really a great forum to check out whenever you can.

1:15 PM - My in person analytics presentation is in 45 minutes. I am very obsessive when it comes to presentations, as I like everything to be perfect, neat, and organized, so I visit our client’s website one more time, and find that they have repaired a bug in their shopping cart that was the focus of one of my main points in the presentation!! I think of a good way to still use this slide in the presentation.

1:38 PM - One of Khrysti’s (Director of Optimized Services) clients is in a bind. They cannot figure out why they are not seeing “yahoo / cpc” or “msn / cpc” in their Google Analytics profile, like they can for “google / cpc”. I reference my latest blog post about Google Analytics URL Coding, and I strut away confidently as I’ve capitalized on another opportunity to tell someone about my Analytics Blog. :)

2:00 PM - It’s showtime! Our clients have arrived, and I hand out my business cards and begin with introductions. It’s always great to be able to meet people in person and talk analytics, Site Search, and Shopping Carts to them. This particular client is using both Google Analytics and WebTrends, and they were really concerned about the differences in data between the two, even though they swear that they have everything installed properly. I explained that different analytics packages will always report different values for the same metric, no matter how perfect your installation and coding is.

3:32 PM - I come back and check my own Google Analytics profile for this blog, and I’m surprised to find so much referring traffic from European blogs! I love that someone in Austria and someone in the Netherlands is reading a blog written by someone half-way around the world. I know this because I frequently check my referring traffic reports, to see who is bringing me additional traffic.

4:00 PM - Another one of Khrysti’s clients cannot for the life of them understand why people type in such simple, generic words such as “shoes”, “belts”, and “hats” into their website’s search feature on their online clothing store. They believe something is wrong, broken, or not working correctly. I am pretty sure that their search function is working properly, but I go to their site and double-check with some test searches anyways. After I verify that it is working properly, I pick up the phone and begin to explain to the client that people have much different behavior (and level of tolerance!) when they perform keyword searches on Google or Yahoo vs. performing keyword searches on someone’s website. Again, I direct their attention to my blog by referencing my post about a website’s internal search function.

4:45 PM - My day is starting to come to a close. I like to take a few minutes each day and “spot check” different analytics accounts, just to ensure that everything is still running smoothly and data is being collected and displayed properly. I’m glad I did this, because an important Goal in one of April’s (Director of Strategic Accounts) clients’ accounts has stopped collecting data. After a test on the client’s website, it turns out that the Goal URL has been changed from “thankyou.html” to “thanks.html”. Websites are updated all the time, which is a good reason to routinely double-check your Goals to make sure they are working properly.

5:03 PM - I’m just about wrapping it up here and saying good night to everyone in the office. Out of nowhere, Danielle (my boss) catches me right before I walk out the door. She explains that a new client needs to speak with someone urgently (first-thing tomorrow morning) about what analytics platform they should choose between Omniture SiteCatalyst Hitbox (HBX) or ClickTracks. They also need help in defining new Key Performance Indicators for their executive team, and possibly setting up some custom reporting. I love to think about things like this, especially on off-hours, so I’m glad I have this opportunity.

7:00 PM - Analytics is going to have to wait a while - an episode of Law and Order is on right now that I’ve never seen before. :)

All in a day’s work. :)

Posted in IndexTools, AW Stats, Yahoo! Analytics, Webside Story (HBX), Feedburner, Key Performance Indicators, Google AdWords, MSN Gatineau, Surveys / Polls, Google Website Optimizer, Google Analytics, Web Analytics Metrics, A/B Testing, Site Usability, Multivariate Testing, Web Analytics

If you are not testing, then you are wrong!

May 1st, 2008 by Joe Teixeira

Back in High School, I was a Lieutenant in the Junior Reserve Officers Training Corps (Go Eagle Battalion!). Class leaders had a lot of fun during uniform inspection time, as well as during drill and ceremony time. We would routinely shout out several commands and instructions to our particular platoons during each class hour, which also included several popular sayings within our corps. These included (but definitely were not limited to):

NINE to the front, and SIX to the rear!” - A reference to the length and distance of your arm swing during marching;
“Get in STEP [Cadet’s Rank and Last Name]!!” - During marching, this would be sounded off to ensure that each cadet’s step would precisely match every other cadet’s step. If every cadet stepped with their right foot, the cadet that stepped with their left foot would stick out like a sore thumb;
“Move the RIFLE around your head, not your HEAD around the rifle!” - My personal favorite during drill and ceremony with our Springfield M-1903’s;
“If you are not double-timing it, you are WRONG!” - You can replace “double-timing it” with any number of different instructions or tidbits of information to convey the message that this was a team effort, and you were wrong if you weren’t participating like everyone else.

We can take that last saying and apply it to testing and experimentation on the web. If you have a website and a marketing plan of any kind, it is imperative that you implement a testing and experimentation plan. Why? Because if you are not testing, you are wrong. In today’s internet world, you absolutely need to have some kind of testing strategy where the ultimate goal is to improve your website’s functionality, your lead acquisition process, and your shopping cart, so that you can have even happier customers, create some more returning shoppers, and ultimately make more money.

For starters, it doesn’t matter what you test - just get your feet wet!

If you’ve been thinking about testing, or if this blog post is the first you’ve ever heard of it, know that for right now, it doesn’t really matter what you test. The mere fact that you going to start testing something - anything - is good enough for now. Get your feet wet and get comfortable and familiar with the idea first, before worrying about what types of testing strategies exist or what standard deviation stands for. Pick anything on your homepage to test for a week or two - that picture of a palm tree, that blue “click here” button, or that first paragraph of text. Pick one of those items (only one for now), and make a change to it, upload it live, and see what effect that has on your traffic and your conversion rate over a week or two. Congratulations - you have just tested something!

This testing idea sounds great, but I wish there was a free tool out there that can help me set-up tests or experiments on my website…

Have no fear - Google Website Optimizer is here! Google Website Optimizer (or GWO for short) just recently came out of Beta, and is now available to everyone on the planet for free. GWO affords you the opportunity to create an unlimited amount of experiments, completely controllable and customizable. GWO goes as far as to offer your technical or website programming team a unique set-up page per each experiment, so that they have every piece of code and every instruction necessary to set GWO up for any page on your website.

What types of Experiments can I conduct with Google Website Optimizer?

There are two different types of experiments:

A/B Experiments - Sometimes also referred to as “A/B Split Testing”, this tests one page on your website up against a different version of that same page, to see which page gives you the best possible chance for an increased conversion rate. Rotating your Ads on Google AdWords evenly is a form of A/B testing in the marketing world. This is the same concept, but for a page on your website.

Multivariate Experiments - Sometimes also referred to as “MVT Testing”, this tests different areas of a page on your website (for example, different headers, footers, or product images), to see which combination gives you the best possible chance for an increased conversion rate. This is actually quite an advanced type of test, but Google Website Optimizer makes it easy for all of us.

How long should I run a test for, and what results will Google Website Optimizer show me?

I like the 15-day rule. With 15 days, you get two full weeks, plus that additional day’s worth of information. This could be longer or shorter, depending on the volume of traffic to your website. However, something in the neighborhood of two weeks should be enough time for a proper experiment.

Google Website Optimizer gives you a “Page Sections” report and a “Combinations” report (specifically for your Multivariate Tests) for you to look at. You’ll be able to view the estimated conversion rate range, in both a numerical form and a sliding bar graph, as well as other fancy statistically-oriented metrics, such as “Observed Improvement”, and “Chance to beat Original / Chance to beat All”, allowing you to very quickly see which page version or which page combination is doing the best job of bringing you more conversions.

What if I run a test between my homepage and a new version of my homepage, but the original homepage beats the new homepage - is it back to the drawing board?

Yes, and no. First of all, you’re going to have to become comfortable with the idea that an original page / original combination beating a newer page or newer combination doesn’t equate to an unsuccessful experiment. If you’re able to conduct a fair and unbiased experiment, then the experiment itself is successful, regardless of the outcome of the experiment. Google Website Optimizer runs fair and unbiased experiments, so rest assured that your experiment will be a successful one.

Now, just because your original homepage beat your new homepage, doesn’t mean that you can’t learn something that you can use in your next experiment. Keep track of what changes were made on the new homepage, and what was different on the new homepage versus the original homepage. If you only make one or two changes, you’ll have a much easier time in keeping track of exactly what’s making the visitors tick and what’s making them leave your site than you would if you completely re-invented the wheel and made several dozen changes.

Other than the homepage, what other types of pages can I experiment with?

The question should really be “what can’t I experiment with?”. You can and you should experiment with all different types of pages - homepages, about us pages, thank you pages, shopping cart pages, order confirmation pages, and so on. GWO lets you run an unlimited amount of different experiments, and you can also run multiple experiments simultaneously with different parts of your website.

Stay Committed!

After you’ve started testing, don’t let the novelty of it wear off. Find a way to make testing and experimentation a part of your job. I know, I know - you’re very busy and you have a lot of work to do, and you can’t possibly imagine putting on yet another hat on. But you JUST have to! Otherwise, your competitors will begin to fly right past you and take your customers away from you. You wouldn’t want that, would you?

Try this: every month, pick 1 thing to test. The “Add to Cart” button, the homepage text, the links on your “Thank You” page…anything. In a few months, you will thank yourself, as you will (hopefully) work towards making your website more attractive to your visitors, which should in turn increase every marketers metric, the conversion rate. Even if your conversion rate doesn’t increase, you will at least have started to learn about your visitors - what they like, what they don’t like, and what they react positively or negatively to - which can only help your business.

Posted in Multivariate Testing, A/B Testing, Google Website Optimizer, Google Analytics, Web Analytics

« Previous Entries