Prepared by Opinion Dynamics Corporation May 2004.

Slides:



Advertisements
Similar presentations
MONITORING OF SUBGRANTEES
Advertisements

ASTM International Officers Training Workshop September 2012 Pat Picariello, Director, Developmental Operations 1 Strategic Planning & New Activity Development.
SAS 70 Third Party Report on Controls Overview and Timetable Finance / Audit Committee Meeting Austin, Texas January 14, 2003/ February 18, 2003.
ERCOT: A Work In Progress Board of Directors Austin, TX July 16, 2002.
AACE Goals Goals as identified by AACE’s Board of Directors for
Julianna Bálint Szent István University Ybl Miklós School Dept. of Building Materials and Quality Management Experiment with the model for quality improvement.
Cash study 5 Chapter 9 Not for Profit Organization Craig Lizotte.
SEMINAR NAIC/ASSAL/SVS REGULATION & SUPERVISION OF MARKET CONDUCT © 2014 National Association of Insurance Commissioners Complaint Handling.
Creating Research proposal. What is a Marketing or Business Research Proposal? “A plan that offers ideas for conducting research”. “A marketing research.
TRANSACTION SERVICES ADVISORY Romania conference – IPO process Victor Kevehazi, Senior Partner 18 October 2005.
9/12/2006 TPTF MIS information sharing Pat Harris A portal is a web site or service that offers a broad array of resources and services such as ,
Richard Philp New Zealand Inland Revenue Department Session No. 7 Conclusions for tax policy and revenue administration from compliance studies, perception.
TAC July 2, 2003 Market Design Implementation Process Recommendation.
Organization Mission Organizations That Use Evaluative Thinking Will Develop mission statements specific enough to provide a basis for goals and.
OECD Guidelines on Insurer Governance
Role of Account Management at ERCOT 2008 ERCOT Market Participant Survey February 12, 2008.
Retail Market Subcommittee Update to TAC Kathy Scott April 24,
INTOSAI Public Debt Working Group Updating of the Strategic Plan Richard Domingue Office of the Auditor General of Canada June 14, 2010.
Prepared by Opinion Dynamics Corporation May 2004.
Eurogas CONSUMER PROTECTION & SWITCHING IN THE DOMESTIC GAS MARKET ERGEG Customer Focus Group Workshop Helsinki 11 th October 2005.
1 Report Tile Training & Management Assistance Branch UNITED STATES OFFICE OF PERSONNEL MANAGEMENT Task Order Competition (TOC) Process.
GBA IT Project Management Final Project - Establishment of a Project Management Management Office 10 July, 2003.
August 7, Market Participant Survey Action Plan Dale Goodman Director, Market Services.
Prepared by Opinion Dynamics Corporation May 2006.
January 18, 2012 Administrative Council Presentation.
Item 5d Texas RE 2011 Budget Assumptions April 19, Texas RE Preliminary Budget Assumptions Board of Directors and Advisory Committee April 19,
Texas Nodal Program ERCOT Readiness & Transition (ERT) Business Process Update TPTF January 12, 2009 Kevin Frankeny.
A Strawman for Discussion by Dottie Stockstill & Greg Ramon Special ERCOT Board Meeting June 24, 2003.
Project Kick-off Meeting Presented By: > > > > Office of the Chief Information Officer.
Role of Account Management at ERCOT 2005 Meeting Management Support Survey Review For 2006 Subcommittees.
COMMERCIAL OPERATIONS ORGANIZATION Betty Day Director, Commercial Operations (office) (cell) (fax)
Military Family Services Program Participant Survey Briefing Notes.
Prepared by Opinion Dynamics Corporation May 2004.
ERCOT Strategic Plan H.B. “Trip” Doggett President and Chief Executive Officer Technical Advisory Committee ERCOT Public December 3, 2013.
Communicating Internally About Corporate Reputation Ericka Webb Communications Manager Best Buy, Inc.
Casualty Actuarial Society ERM for the CAS. Centennial Goal The CAS will be recognized globally as a leading resource in educating casualty actuaries.
Chapter Fourteen Communicating the Research Results and Managing Marketing Research Chapter Fourteen.
ERCOT PROGRESS REPORT Board of Directors Austin, Texas February 18, 2003.
Introduction This presentation is intended as an introduction to the audit process for employees of entities being audited by MACD. Please refer to the.
January 28, 2008 DEWG DEWG Discussion Questions ERCOT.
1 Market Participant Survey 2004 January 8, 2004.
Compliance Monitoring and Enforcement Audit Program - The Audit Process.
People Priorities Framework
1 TAC Report to the ERCOT Board February 16, 2005.
ERCOT MARKET EDUCATION Retail 101. Introductions, Roles and Responsibilities.
9/12/2006 TPTF MIS / Training Status & Update Pat Harris A portal is a web site or service that offers a broad array of resources and services such as.
Grid Operations Report To ERCOT Board Of Directors December 16, 2003 Sam Jones, COO.
Emergency and Other Event Communications ERCOT Board of Directors Richard Gruber, Director of Market Services Paul Wattles, Manager, Governmental Relations.
1 TDTWG Accomplishments 2010 Friday January 28, 2011.
TEXAS NODAL Market Design Structure and Process August 19, 2003.
Audience Profiles RoleKey CharacteristicsValues & NeedsRecommendations C-Level Execs Challenge and opportunity is to capitalize on executives’ critical.
Role of Account Management at ERCOT 2006 TAC Subcommittee Review ERCOT Board February 21, 2006.
U.S. Department of Agriculture eGovernment Program Smart Choice Pre-Select Phase Transition September 2002.
Continual Service Improvement Methods & Techniques.
ERCOT MARKET EDUCATION Retail 101. Market Rules Overview Topics in this lesson...  Introduction to Market Rules Public Utility Regulatory Act PUCT Substantive.
Common Origination and Disbursement (COD) Open Forum Session 19.
A Presentation to the USDOE January 13, 2010 Mary Ann Snider Chief of Educator Excellence and Instructional Effectiveness Race to the Top- Assessment Programs.
Commercial Operations Sub-Committee Update to TAC January 8, 2009 Lee Starr, BTU.
ACF Office of Community Services (OCS) Community Services Block Grant (CSBG) Survey of Grantees Satisfaction with OCS Survey of Eligible Entities Satisfaction.
November 26, 2004Governance Committee1 Objective:  Understand from Board Members the strengths and the weaknesses of the TWC Board.
RMS Update to TAC June 7, RMS Activity Summary RMGRR052 File Naming Convention for Customer Billing Contact Information URGENT (Vote) RMS Procedures:
ExpertSelect Belgium S.A. – Chaussée des Collines 54 – B-1300 Wavre – BELGIUM – +32 (0) – Optivalue.
TEXAS NODAL (ERCOT REVISIONS)
Role of Account Management at ERCOT
Description of Revision
By Jeff Burklo, Director
Introduce myself & around table
{Project Name} Organizational Chart, Roles and Responsibilities
Presentation transcript:

Prepared by Opinion Dynamics Corporation May 2004

 Opinion Dynamics was contracted to conduct a primary research effort to measure Market Participant perceptions of ERCOT’s performance with respect to meeting its responsibilities.  Results allow for comparisons between market perceptions and operational realities. Introduction

Three Phases: Methodology Phase 1: 9 in-depth interviews and 2 focus groups with ERCOT staff Phase 2: In-depth interviews with 17 Market Participants Phase 3: Survey of ERCOT’s Market Participants

ODC developed a sample of 1,157 unique Market Participants using the following lists provided by ERCOT staff:  Appropriate points of contact at market participant firms provided by MP’s via CSR’s  ERCOT Board members from 2003 and 2004  Current Committee members from  Attendees of the 2003 IT forum Survey Sample

Response Rate 429 completed surveys from a sample of 1,157 Market Participants (37%) ERCOT Board Membersn=16 Committee Membersn=112 Market Participant Staffn=301 Classification of respondent based on self-selected descriptions – QA1

By Market Participant Firm Type Response Rate

Survey Approach: 10 point scale  Many questions based on a 10 point scale: 1-3 = negative response, 8-10 = positive response.  Mean responses will trend toward the middle of a 10 point scale – only those with passionate opinion are likely to provide a rating in top or bottom 3.  In general, mean responses of 6.6 or above are favorable ratings, 7.5 and above are extremely positive responses.

Background and Context Market Participant Opinions Regarding ERCOT Staff’s Role In Developing Market Rules Findings ERCOT staff should participate in market rules development ERCOT staff should only administer the market rulesUndecided Board Member (n=16) 38%50%13% Committee Member (n=112) 67%28% 5% Market Participant Staff (n=301) 53%23%24%

Background and Context Market Participants’ Understanding of ERCOT’s Committee Structure Findings

Background and Context Market Participants’ Understanding of ERCOT’s Committee Structure (cont.) Findings

Background and Context Market Participant Interactions with ERCOT Staff Findings CSR’sSubject Matter Expert Executive Mgt. Board Member (n=15) 27%20%47% Committee Member (n=112) 38%48% 4% Market Participant Staff (n=299) 66%16% 1%

Background and Context Interest in Future Training Response Rate

Overview of Perceived Strengths  Performance of ERCOT staff, officers and directors  Personalized contact with Market Participants-- particularly CSR contact  Timeliness and accuracy of data provided  Providing effective training Findings

Color Key

ERCOT Staff Performance: Corporate Objectives (10 point scale, means shown) Findings Ensuring Reliability/Adequacy of Grid Nondiscriminatory access to transmission/ distribution Accurate accounting of electric production & delivery Timely information about customer’s choice of REP

Corporate objectives: Non-discriminatory access/Market Participant Registration (10 point scale, means shown) Findings Level of knowledge/ expertise displayed by the client service rep Communication and distribution of necessary information and forms Following procedures/ protocols for market participant registration Board Member (n=16) Committee Member (n=112) Market Participant Staff (n=301) 7.9

ERCOT Staff Performance (10 point scale, means shown) Findings Consistency Attitude Industry expertise Responsiveness to Market Participants Overall Performance Management of ERCOT organization (Officers & Directors only)

ERCOT Staff Performance: CSRs (10 point scale, means shown) Findings Timely response Knowledge/ Industry Expertise Response accuracy Direction of inquiries Accessibility Attitude/Willingness to resolve problem Overall expectations

ERCOT Staff Performance: Functional Areas (10 point scale, means shown) Findings Market Participant Registration Systems Testing Retail Transaction Processing Scheduling Grid Operations Settlements and Billing Settlements Dispute Resolution

Communications (10 point scale, means shown) Findings Amount of information Clarity of ERCOT Staff’s Messages Written Communication Verbal Communication Timeliness

Communications: Functional Areas (10 point scale, means shown) Findings Asset Registration Systems Changes Progress on Market Projects Bidding Systems Planning

Communications: Room for Improvement (10 point scale, means shown) Findings Impacts of PRRs Grid ops decisions When behind schedule for systems changes When systems are down Communicating…

Timeliness & Accuracy of Data (10 point scale, means shown) Findings Settlements Bill Transmission Congestion Rights Renewable Energy Credits Data Extracts Metered Data

Effectiveness of Training (10 point scale, means shown)

Overview of Areas for Improvement  Portal reliability  Spending priorities  Systems and tools for communicating with the market Website navigation EMMS IT Technical Helpdesk  Functional Performance congestion management data extracts settlement dispute resolution Findings

ERCOT Portal Level of Agreement with Statements About ERCOT IT Systems/Staff Findings The Portal is effectiveThe Portal is reliable

ERCOT Spending Practices (10 point scale, means shown) Findings Spending Funds Equitably Spending Funds on Things that are Important to Your Company Spending Funds Cost Effectively

Communications with the Market (10 point scale, means shown) Findings Navigation of the Web Site Usefulness of IT Help Desk Understanding EMMS

ERCOT Functional Performance (10 point scale, means shown) Findings Timely and Effective Implementation of Systems Changes Timely Resolution of Settlements Disputes Providing Data Extracts with Necessary Content Addressing Congestion Management issues

Market perceived areas of strength:  Grid reliability  Systems are providing timely and accurate data  ERCOT staff performance including personal interactions Conclusions

Market perceived need for system improvements with:  Web site navigation  Data extracts (content)  Web portal  EMMS Conclusions

Market perceived communication gaps in:  Impacts of PRRs  Systems changes  Spending priorities  Grid operations decisions Conclusions (cont.)

Specific areas for strategic consideration by ERCOT Board:  Role of committees in setting spending priorities and introducing market changes  Defining and communicating ERCOT staff’s market function Market is interested in more training--More research on potential types of training seminars is necessary Conclusions (cont.)