MRC VIEWABLE IMPRESSION RECONCILIATION PROCESS: PHASE 3 RESULTS AND MOVING FORWARD Presented to IAB 3MS Educational Forum July 8, 2015.

Slides:



Advertisements
Similar presentations
Table of contents 1 Manual of Operational Procedures (MOP) 2
Advertisements

QEP Presentation 1 Attorney Wesley Bishop Associate Vice Chancellor for Academic Affairs (Faculty Affairs, TRIO, and QEP) Pamela E. Wanga, Ph.D. Associate.
Contract Certainty John Harvie 30 May Market Reform Page 2 How did this issue arise? –Global, historic practice and culture, a legacy of the past.
Compliance Application Notice Process Update and Discussion with NERC MRC.
Merit Award Program The School District of Lee County Merit Award Program Training November 2007.
EMS Auditing Definitions
Quality Assurance CS Pace University Jim Leonardo Milo Auguste Jr. Ritu Mehrotra.
ISO 9001 Interpretation : Exclusions
Establishing an Audience Based Cross-Media Currency CIMM 4 th Annual Summit April 22, 2015.
Orientation to the Accreditation Internal Evaluation (Self-Study) Flex Activity March 1, 2012 Lassen Community College.
Purpose of the Standards
Executive Dashboard Systems Secure CITI Adam Zagorecki April 30, 2004.
RC14001 ® Update GPCA Responsible Care Committee September 23, 2013.
A Review ISO 9001:2015 Draft What’s Important to Know Now
Change Advisory Board COIN v1.ppt Change Advisory Board ITIL COIN June 20, 2007.
David Halldearn, ERGEG Conference on Implementing the 3 rd Package 11 th December 2008 Implementating the 3rd Package: An ERGEG Consultation paper.
Lord Mogg Chair of ERGEG Florence Forum June 2009 Implementation of the Third Energy Package.
Certification of Market Values STEB PROGRAM Briefing Points 2011 Pennsylvania Department of the Auditor General Thomas E. Marks, CPA Deputy Auditor General.
ISO 9001:2015 Revision overview - General users
1 An Update on EPA Attainment Modeling Guidance for the 8- Hour Ozone NAAQS Brian Timin EPA/OAQPS/EMAD/AQMG November 16, 2005.
Developing/Refining Your Stress Testing Framework
Nuclear Power Plant/Electric Grid Regulatory Coordination and Cooperation - ERO Perspective David R. Nevius and Michael J. Assante 2009 NRC Regulatory.
The Next Generation of Online Bill Pay. 2 © 2010 – Proprietary & Confidential The Next Generation of Online Bill Pay is Here!
Kay Higby Responsible Care Superintendent ISO Management Representative Akzo Nobel Functional Chemicals, LLC.
© Grant Thornton | | | | | Guidance on Monitoring Internal Control Systems COSO Monitoring Project Update FEI - CFIT Meeting September 25, 2008.
Standards for Internal Control in the Government Going Green Standards for Internal Control in the Federal Government 1.
UDOT I-15 The Point Design-Build Project
242/102/49 0/51/59 181/172/166 Primary colors 248/152/29 PMS 172 PMS 137 PMS 546 PMS /206/ /227/ /129/123 Secondary colors 114/181/204.
Chapter 127 Review Process Patrick Phillips and Pam Rolfe Maine Department of Education October 27, 2005.
Comprehensive Educator Effectiveness: New Guidance and Models Presentation for the Special Education Advisory Committee Virginia Department of Education.
Comprehensive Educator Effectiveness: New Guidance and Models Presentation for the Virginia Association of School Superintendents Annual Conference Patty.
AREVA T&D Security Focus Group - 09/14/091 Security Focus Group A Vendor & Customer Collaboration EMS Users Conference September 14, 2009 Rich White AREVA.
Review and Revision of ISO/IEC 17021
University of Central Florida Assessment Toolkit for Academic, Student and Enrollment Services Dr. Mark Allen Poisel Dr. Ron Atwell Dr. Paula Krist Dr.
 Advanced Metering Working Group (AMWG) Update to RMS 1 August 5, 2014.
242/102/49 0/51/59 181/172/166 Primary colors 248/152/29 PMS 172 PMS 137 PMS 546 PMS /206/ /227/ /129/123 Secondary colors 114/181/204.
International Auditing and Assurance Standards Board IAASB Update Phil Cowperthwaite, Member, IAASB SMP Forum Beijing, China 28 October
1 MTAC eVS®/PTS User Group Thursday November 10, 2011.
April 2011 Mississippi Department of Education Office of Instructional Enhancement and Internal Operations/Office of Special Education 1 SPECIAL EDUCATION.
1 UNC Modification 429 Customer Settlement Error Claims Process – Guidance Document.
Exit Capacity Substitution and Revision Transmission Workstream meeting, 3 rd December 2009.
An Update of COSO’s Internal Control–Integrated Framework
Principles of Merger Analysis The Antitrust Masters Course V September 30, 2010 Andrea Agathoklis, Department of Justice Norman A. Armstrong, Jr., Federal.
11 User Pays User Committee 14th September Agenda  Minutes & Actions from previous meeting  Agency Charging Statement Update  Change Management.
CIWQS Review Phase II: Evaluation and Final Recommendations March 14, 2008.
IT Summit November 4th, 2009 Presented by: IT Internal Audit Team Leroy Amos Sue Ann Lipinski Suzanne Lopez Janice Shelton.
ECC Task Force Webinar November 13, Peak Anti-Trust Statement Meeting Minutes (June and Sept) Phase 1A Progress Phase 1A External Entity Testing.
SPC Advisory Committee Training Fall 2015 Institutional Research President’s Office SPC 10/9/20151.
Chapter 10 Information Systems Development. Learning Objectives Upon successful completion of this chapter, you will be able to: Explain the overall process.
ECC Task Force Webinar September 3, Peak Anti-Trust Statement Phase 1A Update webSAS Integration PSE Access Peak and the Task Force Next Steps.
Madrid Forum 6-7 November 2008 Implementating the 3rd Energy Package: An ERGEG Consultation paper Lord Mogg, ERGEG chairman.
Implementation recommendations 1st COPRAS review Presentation at 2nd COPRAS annual review, 15 March 2006, CEN/CENELEC meeting centre, Brussels Bart Brusse.
TACCM 2015 Conference Viewability and Attribution: How Successful Is Your Online and Mobile Recruitment Campaign?
ISO 9001 Quality Management System implementation experience in the Agency on Statistics of the Republic of Kazakhstan (ASRK) Zhasser Jarkinbayev, ASRK.
MyFloridaMarketPlace Quality Improvement Plan. Page 2 MFMP Quality Improvement Plan  The MFMP team has developed a quality improvement plan that addresses.
Determinations / verifications under JI – Experience to date UNFCCC Technical Workshop on Joint Implementation Bonn, February 13 th, 2007 For the benefit.
© 2015 eHealthcare Solutions, Inc. Proprietary and confidential. 1 Viewability Case Studies April 2015 – December 2015.
DESIRED FUTURE STATE CIMM: Cross-Platform Media Measurement and Data Summit April 13, 2016.
242/102/49 0/51/59 181/172/166 Primary colors 248/152/29 PMS 172 PMS 137 PMS 546 PMS /206/ /227/ /129/123 Secondary colors 114/181/204.
Viewability Case Studies
Every Student Succeeds Act (ESSA) State Plan: Update
Fair Go Rates System Dr Ron Ben-David Chairperson
Viewability Terms & Conditions Summary
PLANNING FOR THE VIEWABLE FUTURE
Office of Nuclear Materials Safety and Safeguards
Background (history, process to date) Status of CANs
Fair Go Rates System Dr Ron Ben-David Chairperson
Exit Capacity Substitution and Revision
An Update of COSO’s Internal Control–Integrated Framework
Kay Higby Responsible Care Superintendent ISO Management Representative Akzo Nobel Functional Chemicals, LLC.
Presentation transcript:

MRC VIEWABLE IMPRESSION RECONCILIATION PROCESS: PHASE 3 RESULTS AND MOVING FORWARD Presented to IAB 3MS Educational Forum July 8, 2015

AGENDA  Background on the Viewable Impression Standard  History of Reconciliation Phases  Reconciliation Phase 3: Approach and Findings  Moving Forward Time for questions and discussion… 2

Background on the Standard 3

MRC Mission Statement  To secure for the media industry and related users measurement services that are valid, reliable and effective; we do this by:  Setting Standards; and  Conducting Audits to Verify Compliance with Standards. 4

Development of the Viewable Impression Standard  Timelines:  First viewability measurers emerge circa  3MS project launches in 2010, 3MS “Principles” published in September 2011  Agency Pilot conducted, Summer 2012  MRC Advisory Period in effect, November 2012-March 2014  Viewable Impression Guidelines Issued, June 2014  Vendor reconciliation phases:  Early 2014, Late 2014-Early 2015, Spring

Reconciliation History 6

Viewable Impression Measurement Reconciliation: Why It’s Necessary Reconciliation Process Always Part of the Plan Some counting differences were expected Similar to Publisher vs. Third Party Ad Servers in Served Impression counting a decade ago A critical mass of accredited vendors was necessary prior to beginning a reconciliation effort Reasons differences in counting might be observed: Different measurement orientations Ex.: 3 rd party vs. ad server vs. publisher Differences in abilities to measure in all situations Differences in processes and/or ordering of processes applied 7

Viewable Impression Measurement Reconciliation: Phase 1  Findings issued on 3/31/14 as part of MRC Viewable Impression Advisory Update  Reasons identified for measurement differences included: 1. Granularity of Measurements 2. Non-rendered served ads 3. Order of processing and processes applied 4. Ad measurement vs. Ad Container measurement 5. Out of Focus conditions 6. Human error 8 Provisions to account for each of the above issues were included in the final Viewable Impression Measurement Guidelines, issued June 30, 2014.

Viewable Impression Measurement Reconciliation: Phase 2 Findings  Issued to Viewability Vendors and Auditors on 4/13/15  Reasons identified for persistence in measurement differences included: 1. Inconsistent application of the optional large pixel threshold 2. Inconsistencies in measurement of multi-ad units 3. Inconsistencies in the use of the Page Visibility API 4. Inconsistencies in the use of the Flash “Throttle” indicator 5. Inconsistencies in processes applied by vendors who also provide “Enhanced NHT” filtration 6. Inconsistencies related to calculation of Viewable Rates using Count on Decision served impression measurements 9 Vendors put on alert to address each issue in near-term, as requirements around each will be included in next update to Viewable Impression Guidelines.

Reconciliation: Phase 3 10

Reconciliation Project Phase 3: Background  MRC issued broad call to the industry on January 16, 2015, requesting data for campaigns measured by 2 or more accredited viewability vendors  All information provided on strictly confidential basis  In response, we received campaigns from a broad range of publishers, agencies, and marketers  Nearly 4 billion served impressions  Included display and video ads, covering a wide range of placements and sites  Campaign data included most major viewability vendors 11

Reconciliation Project Phase 3: Differences by Campaign 12 Among campaigns with more than 100,000 viewable impressions.

Reconciliation Project Phase 3: Topline Findings  Among sizable campaigns* examined, 63% of campaigns had viewable impression measurement differences of less than 10%  The weighted average of these differences was 4.1%  Among the 37% of campaigns where differences of 10% or more were observed, the median difference was 23%, and the weighted average difference was 34%  These ranges were higher than seen in prior reconciliations  Smaller campaigns demonstrated more variability  But reasons for differences consistent with larger campaigns 13 * = defined as >100,000 viewable impressions

Reconciliation Project: Reasons for Differences Observed 14 Among all campaigns for which data was received.

Reconciliation Project Phase 3: Reasons Identified for Differences* Issue 1: 54% of the total difference was a result of differing treatments of mobile viewable impressions. Differences attributable to mobile viewable impression measurement have grown since our earlier reconciliation work. Segregation of mobile counts is highly critical. No one is currently accredited by MRC for mobile viewable impression measurement. 15 * Percentages based on data from all campaigns received.

Reconciliation Project Phase 3: Reasons Identified for Differences Issue 2: 28% of the total differences observed was a result of differing treatments of multi-ad unit situations This issue was addressed in MRC’s April 2015 reconciliation guidance to vendors, and will be formally introduced into the Viewable Impression Measurement Guidelines shortly when that document is formally updated. 16

Reconciliation Project Phase 3: Reasons Identified for Differences Issue 3: 13% of the total differences observed was a result of differences in whether vendors measured ad traffic in campaigns served by ad servers other than themselves This was a new finding of Phase 3 of the reconciliation process, and will be addressed in the next update to the Viewable Impression Measurement Guidelines document. 17

Reconciliation Project Phase 3: Reasons Identified for Differences Issue 4: 2% was a result of differences in the application of certain ad verification processes This issue was addressed in the original Viewability Guidelines release, and reinforced in our April 2015 reconciliation communication to vendors. It will be emphasized again in the next update to the Guidelines document. 18

Reconciliation Project Phase 3: Reasons Identified for Differences Issue 5: The remaining 3% resulted from other causes, such as differing treatments of Large Size display ads; differing applications of invalid traffic filtration; and non-rendered ads included in served impression counts. This reconciliation provided more evidence that many non-rendered ads are currently being counted as served impressions, not only with “count on decision” methodologies, but sometimes even when a “count on download” approach is utilized. While this issue may have a limited impact on viewability metrics, it still needs to be addressed in the near future. 19

Moving Forward: Key Next Steps 20

MRC Reconciliation Findings: Moving Forward  The Viewable Impression Measurement Guidelines document will be formally updated within the next 30 days to reflect the reconciliation learnings  Accredited vendors will have limited time to achieve compliance with any new or revised provisions  Mobile Viewable Impression Measurement Guidelines development is in progress  Interim Guidance on Mobile Viewability currently in place 21

MRC Reconciliation Findings: Moving Forward  Fact: Viewable impression measurement will never be completely static  Recognition that it will evolve and improve over time, as result of technological and other innovation  These changes may have impacts on reconciling vendors’ measurement results 22

MRC Reconciliation Findings: Moving Forward  MRC’s Work in this Area Going Forward  Audit and accreditation process replaces ad hoc reconciliation testing as primary means for achieving and maintaining consistency in accredited vendors’ measurements  Issues will be investigated and run to ground as they arise in audits and as special circumstances are brought to our attention  Additional guidance and updates to MRC Viewable Impression Guidelines will be provided as needed 23

MRC Reconciliation Findings: Moving Forward 24 A Key Point for All Users of Viewable Impression Data: Pay Attention to the Issues Identified Through Reconciliation, and Understand How Your Vendors Address Each

Discussion, Q&A George Ivie Ron Pinelli David Gunzerath (212) Thank You!