The Surprising Power of Online Experiments

Published by Optimizely

In the fast-moving digital world, even experts have a hard time assessing new ideas. Case in point: At Bing a small headline change an employee proposed was deemed a low priority and shelved until one engineer decided to do a quick online controlled experiment—an A/B test—to try it out. The test showed that the change increased revenue by an astonishing 12%.

That experience illustrates why it’s critical to adopt an “experiment with everything” approach, say Ron Kohavi, the head of the Analysis & Experimentation team at Microsoft, and Stefan Thomke, an HBS professor.

In this article they describe:

• How to properly design and execute A/B and other controlled tests
• Ensure test integrity
• How to interpret results and avoid pitfalls

Download Now

Required fields*

Submit

By submitting this form, you are confirming you are an adult of 18 years or older and you agree that the vendor(s) of this resource may contact you with marketing-related emails or by telephone. You may unsubscribe at any time. If you have any further questions please email dataprotection@headleymedia.com

Please agree to the conditions

By requesting this resource you agree to our terms of use. All data is protected by our Privacy Policy.

Submit

Required fields*

Salutation *

First Name *

Last Name *

Job Title *

Company Name *

Address Line 1 *

City *

State/County *

Zip/Postal Code *

Country *

---------- Australia Austria Belgium Brazil Canada China Czech Republic Denmark Finland France Germany Greece Hong Kong SAR India Ireland Israel Italy Japan Korea Malaysia Mexico Netherlands Nigeria Norway Philippines Poland Portugal Russia Saudi Arabia Singapore South Africa Spain Sweden Switzerland Thailand United Kingdom United States Other

Phone *

Company Size *

---------- 10,000+ 7,501-10,000 5,001-7,500 2,501-5,000 1,001-2,500 501-1,000 251-500 101-250 51-100 0-50

Industry *

---------- Computer and Technology Advertising/Media/Publishing Aerospace and Aviation Agriculture and Forestry Automotive Banking/Accounting/Financial Business Services Education and Training Engineering and Construction Entertainment/Travel/Hospitality Food and Beverage Government and Public Administration Healthcare Insurance Legal Solutions Manufacturing Marketing Non profit Organizations Other Industry Not Listed Pharmaceutical Public Relations Real Estate Retail and Wholesale Scientific Telecommunications Transportation and Shipping Utilities VAR/VAD/System Integrator

Are you currently running or considering running initiatives to improve customer experience digitally? *

---------- currently running initiatives plan to run initiatives considering running initiatives not running or considering over the next 12 months

Do you have any internal resources or can you allocate resources to run these initiatives?   *

How much monthly traffic does your website have?  *

Submit

In order to provide you with this free service, we may share your business information with companies whose content you choose to view on this website.

All information that you supply is protected by our privacy policy and you agree to our Terms of Use.

Related Categories Marketing Analytics, Marketing Technology, Market Research, Marketing Data, Marketing Campaigns, Cross Channel, Customer Data, Market Research, Marketing Insights, Marketing Metrics, Peer Influence, Marketing Strategy, Customer Analytics, Customer Relationship, Consumer Analytics, Data Mining, Digital Marketing, Online Marketing, Data-Driven Marketing, Targeting, Display Advertising, B2B, Marketing Innovation, Collaboration, Adaptation, Technology, Marketing Technology, Modern Marketing, Segmentation