Examples and tips for working with experiments

Examples and tips for working with experiments

See some examples of working with experiments and learn some best practices.

The purpose of experiments is to A/B-test changes to campaigns in a controlled environment. You make a tweak in the experimental campaign, and then see how its subsequent performance compares with the original campaign's. This way, you can understand the impact of the change to your business before you commit to it fully. Learn more about creating, evaluating, and applying experiments.

Example uses of experiments

Here are just a few of the ways you can experiment:

  • Try a bid strategy: Compare your existing manual bidding (or your tool provider's bidding) to an automated-bidding bid strategy like Maximize Clicks or Target CPA.
  • Go after a new audience: Try targeting a different audience and see how your performance compares. What are my options for audiences?
  • Test syndication: If your campaign's ad distribution (where on the internet you want to show ads) is set to Bing, AOL, and Yahoo search (owned and operated) only, run an experiment set to All search networks to include our syndicated search partners as well.
  • Play around with your ad copy: Try a funnier or edgier tone! Make your text more descriptive or, conversely, more concise. Experiment with dynamic text parameters or ad customizers.
  • Try out another new feature: Are you familiar with all of your ad extension options, for example?

Tips

To get the most helpful results from your experiments, keep the following in mind:

  • We recommend setting your experiment split at 50/50 to make sure the experiment gets enough traffic to make a fair comparison.
  • After you create an experiment, ensure that it was successfully created without errors by checking the Experiment status column of the Experiments page. If any issues were encountered, you will see a Download errors link in the Action column. Click this link, fix the errors, and try creating the experiment again.
  • In most cases, we recommend approaching experimentation like this:
    1. For the first two weeks of the experiment, keep the original and experiment campaigns identical.
    2. At that point, make the desired change to the experiment to commence A/B testing.
    3. Then let the experiment run in A/B mode for at least two weeks (so at least four weeks in total).
  • You cannot create an experiment on a campaign that uses the Maximize Conversions or Target CPA bid strategy, because these bid strategies require at least 15 conversions at the start in order to work. To experiment with these bid strategies, we recommend:
    1. Creating an experiment on a campaign that doesn't use one of these bid strategies.
    2. Running the experiment in A/B mode for at least four weeks instead of just two weeks. This gives our automated bidding algorithms time to learn, and helps ensure you have enough conversions to compare.
  • You can have up to 10 experiments per campaign, but you can only have 1 experiment running on a campaign at a time. If you want to run multiple experiments on a single campaign, schedule them so they run one after another.

See more videos...