1. Keys to a Successful Landing Page Andrew Eisner Vice President, Client Services

2. Optimost Background Optimost helps customers improve their conversion rates online through real-time testing Company founded in 2001 First on-demand multivariable optimization solution Market leader – most diverse client base Entire company and platform built with mindset of multivariable optimization Methodology: developed with experts from Harvard Business School, Columbia Business School, Yale School of Management Technology: content management, analytics Full-service: dedicated client services team to support test design, production, and analysis

3. Over 150 Customers

4. Key Concepts

5. Not Just One Decision…. YES NO

6. Many Minidecisions YES NO YES NO YES NO YES NO YES NO YES NO YES NO YES NO

7. keyword group: legal music keyword group: burn music keyword group: buy music keyword group: radio Not Just “A” Landing Page

8. “Radio” Keywords Winning Bullet PointsLosing Bullet Points EXAMPLE: Winning bullet points varied by keyword segment “Radio” Keywords “Buy Music” Keywords “Legal Music” Keywords

9. EXAMPLE: Adding price information to bullet points increased response in Yahoo segment, even though it had no impact in non-PPC segment

10. Don’t Need To Do Complete Redesign

11. Control Winner +16.2% Vs. EXAMPLE: Minor Changes Make A Major Difference

12. ControlWinner +36.7% EXAMPLE: Minor Changes Make A Major Difference

13. Control Winner +16.2% Vs.

14. What Works (and Doesn’t Work)

15. Copy Amount of Copy do you need it all? Are “Benefits” Really Benefits Headline/Header Construction

16. EXAMPLE: Keeping instructions simple worked best

17. EXAMPLE: Removing “No Spam” improved performance

18. EXAMPLE: Satisfaction Guaranteed is important benefit Subscriptions +11.1%

19. EXAMPLE: Changing headline into question improved response Vs. baseline

20. Vs. baseline EXAMPLE: Small header changes can make a difference

21. Layout Ordering of Copy Keep It Simple

22. EXAMPLE: Order of Copy Blocks had substantial impact on response rates Clicks to Order -10.6%ControlClicks to Order +8.4%

23. Vs. UCTR = + 35.4%baseline EXAMPLE: Order of Copy Blocks had substantial impact on response rates

24. EXAMPLE: Simple Layout Performed Best

25. Images People Celebrities CEOs, Writers, etc. Endorsements

26. EXAMPLE: Barry Williams Had a Positive Impact C = 4 Confirmation =  Cart = 

27. EXAMPLE: Author’s Picture Had Negative Effect Baseline Clicks to Order = +3.1%

28. EXAMPLE: Endorsements outperformed “Free” messaging

29. What Works (and Doesn’t Work)

30. Submit Buttons Be Cool At Your Own Risk Copy Size Location Flashing Buttons

31. EXAMPLE: “Click Here” buttons did significantly better Vs. baseline

32. EXAMPLE: Red order button was successful Vs. baseline

33. EXAMPLE: Animated button did very well in promo group, but poorly in generic group Vs. baseline UAR promo group = +7.8% UAR generic group = -5.2%

34. How to Optimize

35. The Traditional Process A/B Testing

37. 20%24% (+20% lift) NOTE: for illustrative purposes only - not real data!!!!

38. Why A/B Testing Is Not Optimal 20%24% (+20% lift) -10%+20% +10% NOTE: for illustrative purposes only - not real data!!!!

39. Why A/B Testing Is Not Optimal 20%26% (+30% lift) 0%+20% +10% NOTE: for illustrative purposes only - not real data!!!!

40. Why A/B Testing Is Not Optimal Serial A/B Testing Month 1: Image Month 2: Headline Month 3: Form Layout Month 4: Submit Button Month 5: Endorsements

41. A Better Solution: Multivariable Optimization Images Used Layout; including Right/Left Main headline Copy and Order Of Sell Points Endorsements Form Headline Copy Form Layout Submit Buttons Include Phone Number?

42. A Better Solution: Multivariable Optimization Main Headline: 1)Lose 10 Pounds by April 20 2)Want to Lose 10 Pounds? 3)Get the Perfect Diet for YOU 4)Get Your Free Diet Profile Copy and Order of Sell Points: 1)What makes eDiets different? - 24/7 Support - Convenience and Privacy - No meeting to attend - No expensive foods to buy 2)What makes eDiets different? - Customized meal plans and shopping lists - 24/7 Support - Convenience and Privacy - No meeting to attend - No expensive foods to buy 3)Top 5 reasons to join eDiets - Customized meal plans and shopping lists - 24/7 Support - Convenience and Privacy - Personalized fitness plans and workouts - Expert health and fitness advice

43. Potentially Millions of Possible Permutations

44. Much Fewer Needed for Reliable Results

45. 35% 29% 31% 30% 34% 38% 30% 29% NOTE: for illustrative purposes only - not real data!!!!

46. Multivariable Optimization Winner +15% NOTE: for illustrative purposes only - not real data!!!!

47. Multivariable Optimization Winner Individual Effects -4%+15% +9% -3% -4% -3% +5% +15% NOTE: for illustrative purposes only - not real data!!!!

48. Multivariable Optimization Winner Individual Effects -4%+15% +9% -3% -4% -3% Predicted Winner +5% +15% +29% NOTE: for illustrative purposes only - not real data!!!!

49. Why Isn’t This Done In “Real World”? Real WorldInternet Creative cost would be prohibitive Technology can result in huge efficiency in creative development Getting large enough sample would be prohibitive Finding target audience is easy (and can be performance-based) Guaranteeing “balanced” sample size is difficult Technology easily manages this Timeline for response loop is too long Real-Time Tracking Instant Iterating”

50. Benefits of Multivariable Optimization Ability to test multiple variables and values simultaneously, without increasing sample size Timeline significantly reduced Can test “Non-Obvious” factors Find best solution out of much higher quantity of versions Actual data on best out of 200 rather than best out of 2 Ability to predict the best out of 2 million rather than best out of 2 Learn where to focus developments efforts going forward Discover how much each variable contributes to performance

51. Methodology Is Critical Test Population Evenly Distributed Day of Week Time of Day Source of Traffic Choose Values in Logical, Methodical Fashion Multivariable Testing: Can’t Choose Versions At Random Is It Statistically Significant?

52. Final Thoughts Be Adventurous! Limited Downside and Unlimited Upside There Are Always Ways to Improve Until you’re getting 100% conversion rates, you can do better!

53. Thank You! www.optimost.com andrew.eisner@optimost.com