Prepared by Opinion Dynamics Corporation May 2006.

Slides:



Advertisements
Similar presentations
MONITORING OF SUBGRANTEES
Advertisements

ASTM International Officers Training Workshop September 2012 Pat Picariello, Director, Developmental Operations 1 Strategic Planning & New Activity Development.
September 2013 ASTM Officers Training Workshop September 2013 ASTM Officers Training Workshop Strategic Planning & New Activity Development September 2013.
2007 Annual Conference Survey Says! Collecting Feedback From Customers James Collins.
SAS 70 Third Party Report on Controls Overview and Timetable Finance / Audit Committee Meeting Austin, Texas January 14, 2003/ February 18, 2003.
The Value of a Project Management Office Copyright: Kathy J. Lang, 2004.
Develop an Information Strategy Plan
USG INFORMATION SECURITY PROGRAM AUDIT: ACHIEVING SUCCESSFUL AUDIT OUTCOMES Cara King Senior IT Auditor, OIAC.
ERCOT: A Work In Progress Board of Directors Austin, TX July 16, 2002.
Recruitment: The First Step in the Selection Process
Accountability in Human Resource Management Dr. Jack J. Phillips.
SEMINAR NAIC/ASSAL/SVS REGULATION & SUPERVISION OF MARKET CONDUCT © 2014 National Association of Insurance Commissioners Complaint Handling.
Creating Research proposal. What is a Marketing or Business Research Proposal? “A plan that offers ideas for conducting research”. “A marketing research.
TRANSACTION SERVICES ADVISORY Romania conference – IPO process Victor Kevehazi, Senior Partner 18 October 2005.
Chapter 9 Servicing Fund Shareholders Viewing recommendations for Windows: Use the Arial TrueType font and set your screen area to at least 800 by 600.
Richard Philp New Zealand Inland Revenue Department Session No. 7 Conclusions for tax policy and revenue administration from compliance studies, perception.
TAC July 2, 2003 Market Design Implementation Process Recommendation.
Haldimand County Public Library Board 2001 Municipal amalgamation Why do a Strategic Plan? concentration of resources on key areas ability to deal with.
Role of Account Management at ERCOT 2008 ERCOT Market Participant Survey February 12, 2008.
Retail Market Subcommittee Update to TAC Kathy Scott April 24,
Prepared by Opinion Dynamics Corporation May 2004.
August 7, Market Participant Survey Action Plan Dale Goodman Director, Market Services.
January 18, 2012 Administrative Council Presentation.
WELCOME to Strategic Management BMGT 481w BRIEF OVERVIEW OF TODAY’S SESSION 1.INTRODUCTIONS 2.ATTENDANCE 3.REVIEW OF COURSE DESCRIPTION, MATERIALS, &
Commitment to Excellence in Nursing Regulation Presented at the 2004 CLEAR Annual Conference September 30 – October 2 Kansas City, Missouri Kathy Apple,
TEXAS NODAL Board Review and Approval August 19, 2003.
Prepared by Opinion Dynamics Corporation May 2004.
Item 5d Texas RE 2011 Budget Assumptions April 19, Texas RE Preliminary Budget Assumptions Board of Directors and Advisory Committee April 19,
ERCOT MARKET EDUCATION
TEXAS NODAL Board of Directors Austin, Texas July 15, 2003.
ERCOT MARKET EDUCATION Retail 101. Introductions, Roles and Responsibilities.
Research and Business Proposals and Planning for Business Reports
Electronic Records Management: A New Understanding of Policy, Compliance, and Discovery Robert J. Sobie, Ph.D. Director Information Systems Department.
A Strawman for Discussion by Dottie Stockstill & Greg Ramon Special ERCOT Board Meeting June 24, 2003.
Role of Account Management at ERCOT 2005 Meeting Management Support Survey Review For 2006 Subcommittees.
COMMERCIAL OPERATIONS ORGANIZATION Betty Day Director, Commercial Operations (office) (cell) (fax)
Prepared by Opinion Dynamics Corporation May 2004.
ERCOT Strategic Plan H.B. “Trip” Doggett President and Chief Executive Officer Technical Advisory Committee ERCOT Public December 3, 2013.
Communicating Internally About Corporate Reputation Ericka Webb Communications Manager Best Buy, Inc.
McGraw-Hill/Irwin © 2003 The McGraw-Hill Companies, Inc., All Rights Reserved. 6-1 Chapter 6 CHAPTER 6 INTERNAL CONTROL IN A FINANCIAL STATEMENT AUDIT.
Methodologies and Tools for Technology Needs Assessment: an Overview Zou Ji Dept. of environmental Economics and Management, Renmin University of China.
ERCOT PROGRESS REPORT Board of Directors Austin, Texas February 18, 2003.
Role of Montana State Fund. Montana State Fund is committed to the health and economic prosperity of Montana through superior service, leadership and.
Slide 1 Customer Satisfaction Monitoring Rolling data 2014/15 –Waves 1-12 (April 14-March 15)
1 TAC Report to the ERCOT Board February 16, 2005.
ERCOT MARKET EDUCATION Retail 101. Introductions, Roles and Responsibilities.
Presentation to the 2004 ICAI Practice Conference Great Southern Hotel, Killarney 1 April, 2004 Ian Drennan Corporate Compliance Manager.
TEXAS NODAL Market Design Structure and Process August 19, 2003.
Audience Profiles RoleKey CharacteristicsValues & NeedsRecommendations C-Level Execs Challenge and opportunity is to capitalize on executives’ critical.
Role of Account Management at ERCOT 2006 TAC Subcommittee Review ERCOT Board February 21, 2006.
Market Notices – Current State Ted Hailu Communications and Settlements Working Group (CSWG) ERCOT Public July 28, 2014.
ERCOT MARKET EDUCATION Retail 101. Market Rules Overview Topics in this lesson...  Introduction to Market Rules Public Utility Regulatory Act PUCT Substantive.
Commercial Operations Sub-Committee Update to TAC January 8, 2009 Lee Starr, BTU.
Selecting, Reviewing, and Supporting the Administrator Governing Board Online Training Module.
Slide 1 Customer Satisfaction Monitoring 2015 Summary (April 15-Dec 15)
ACF Office of Community Services (OCS) Community Services Block Grant (CSBG) Survey of Grantees Satisfaction with OCS Survey of Eligible Entities Satisfaction.
February 26, 2015 Technical Advisory Committee (TAC) Update to RMS Kathy Scott March 3, 2015 TAC Update to RMS 1.
Texas Nodal Program ERCOT Readiness & Transition (ERT) Supplemental Information TPTF January 12, 2009 Kevin Frankeny.
ERCOT MARKET EDUCATION
TEXAS NODAL (ERCOT REVISIONS)
Commercial Operations Sub-Committee Update to RMS
Role of Account Management at ERCOT
Vendor Management and Software Asset Management
By Jeff Burklo, Director
Project Management Process Groups
Accounting / Financial Consulting
Development of Internal Quality Assurance and its Challenges in Taiwan Higher Education from University and Students’ Perspectives Angela Yung Chi Hou.
Presentation transcript:

Prepared by Opinion Dynamics Corporation May 2006

 Opinion Dynamics was contracted to conduct a primary research effort to measure Market Participant perceptions of ERCOT’s performance with respect to meeting its responsibilities.  Follow up and expansion of the 2004 Market Participant Survey.  Results allow for comparisons between market perceptions and operational realities and trending of performance over time. Introduction

Three Phases: Methodology Phase 1: Review 2004 Market Participant Survey Instrument Phase 2: In-depth interviews with key ERCOT stakeholders Phase 3: Survey of ERCOT’s Market Participants

ODC developed a sample of 920 unique Market Participants using the following lists provided by ERCOT staff:  Appropriate points of contact at market participant firms provided by Account Managers  Current ERCOT Board members  Current Committee members Survey Sample

Response Rate 287 completed surveys from a sample of 920 Market Participants (31%) ERCOT Board Membersn=5 Committee Membersn=91 Market Participant Staffn=191 Classification of respondent based on self-selected descriptions – QA1 Response Rate

By Market Participant Firm Type

Survey Approach: 10 point scale  Many questions based on a 10 point scale: 1-3 = negative response, 8-10 = positive response.  Mean responses will trend toward the middle of a 10 point scale – only those with passionate opinion are likely to provide a rating in top or bottom 3.  In general, mean responses of 6.6 or above are favorable ratings, 7.5 and above are extremely positive responses.

Background and Context Market Participant Opinions Regarding ERCOT Staff’s Role In Developing Market Rules Findings Board Member (n=5) Committee Member (n=91) Market Participant Staff (n=191) ERCOT staff should take a position in the development of market rules 60%20%21% ERCOT staff should provide individual professional opinion 40%25%17% ERCOT staff should support the development of market rules by providing data and analysis only -46%27% ERCOT staff should only administer the market rules -3%9% Undecided-5%27%

Background and Context Market Participants’ Understanding of ERCOT’s Committee Structure Findings

Background and Context Market Participants’ Understanding of ERCOT’s Committee Structure Findings

Background and Context Market Participants’ Understanding of ERCOT’s Committee Structure (cont.) Findings

Background and Context Interest in Future Training Findings

Overview of Perceived Strengths  Performance of ERCOT staff -- particularly account managers -- officers and directors  Communications -- ERCOT website  Timeliness, accuracy and format of data provided  Providing effective training Findings

Color Key 6.6 to or above 6.5 or below Needs Improvement Good Very Good Findings

ERCOT Staff Performance: Corporate Objectives (10 point scale, means shown) Findings Ensuring Reliability/Adequacy of Grid Nondiscriminatory access to transmission/ distribution Accurate accounting of electric production & delivery Timely information about customer’s choice of REP * Significantly different from 2004 at 95% confidence level.

ERCOT Staff Performance: Staff (10 point scale, means shown) Findings Consistency Attitude Industry expertise Responsiveness to Market Participants Overall Performance * Significantly different from 2004 at 95% confidence level.

ERCOT Staff Performance: Officers & Directors (10 point scale, means shown) Findings Consistency Attitude Industry expertise Responsiveness to Market Participants Overall Performance Management of ERCOT organization

ERCOT Staff Performance: Account Managers (10 point scale, means shown) Findings Timely response Knowledge/ Industry Expertise Response accuracy Direction of inquiries Accessibility Attitude/Willingness to resolve problem Overall expectations * Significantly different from 2004 at 95% confidence level.

ERCOT Staff Performance: Functional Areas (10 point scale, means shown) Findings Market Participant Registration Systems Testing Retail Transaction Processing/ Customer Switching Bi-Lateral Scheduling Grid Operations Settlements and Billing Settlements Dispute Resolution * Significantly different from 2004 at 95% confidence level

ERCOT Staff Performance: PRR (10 point scale, means shown) Findings Timeliness Testing software changes Administering the process Understanding the effects Effective communication Implementing projects

ERCOT Staff Performance: Metering* (10 point scale, means shown) Findings Identifying need for data edits Accuracy of data edits Knowledge Completing data edits Timeliness of data edits *New Question in 2006

ERCOT Staff Performance: Variance Disputes (10 point scale, means shown) Findings Retail Variance Retail Transaction Variance Data Extract Variance

Staff Performance: Finance and Accounting Credit Standards* (10 point scale, means shown) Findings Effectively communicates collateral requirements to market participants Responds well or effectively to questions regarding collateral requirements Responds in a timely manner to questions regarding collateral requirements * New questions in 2006.

Communications (10 point scale, means shown) Findings Amount of information Clarity of ERCOT Staff’s Messages Written Communication Verbal Communication Timeliness Use of Appropriate Mailing Lists** * Significantly different from 2004 at 95% confidence level. ** New question in 2006.

Communications: Functional Areas (10 point scale, means shown) Findings Asset Registration Systems Changes Bidding Systems Planning * Significantly different from 2004 at 95% confidence level.

Communications: Functional Areas* (cont.) (10 point scale, means shown) Findings Collateral requirements Grid operations Changes to IT systems Congestion management * New questions in 2006.

Satisfaction with the Website (10 point scale, means shown) Findings Timeliness of posted information Look of the site Search functionality** Ease of finding documents and info * Significantly different from 2004 at 95% confidence level. ** New question in 2006.

Timeliness of Data (10 point scale, means shown) Findings Settlements Bill Transmission Congestion Rights Renewable Energy Credits Data Extracts * Significantly different from 2004 at 95% confidence level.

Accuracy of Data (10 point scale, means shown) Findings Settlements Bill Transmission Congestion Rights Renewable Energy Credits Data Extracts * Significantly different from 2004 at 95% confidence level.

Format of Data* (10 point scale, means shown) Findings Settlements Bill Transmission Congestion Rights Renewable Energy Credits * New questions in 2006.

Effectiveness of Training (10 point scale, means shown) Findings Settlement and Dispute Seminars Retail Training Seminars System Operations Seminars * Significantly different from 2004 at 95% confidence level.

Overview of Areas for Improvement  Spending priorities  IT Technical Helpdesk  Finance & Accounting Credit Standards  Project Management Findings

ERCOT Spending Practices (10 point scale, means shown) Findings Spending Funds Equitably Spending Funds on Things that are Important to Your Company Spending Funds Cost Effectively

Usefulness of Technical Helpdesk (10 point scale, means shown) Findings * Significantly different from 2004 at 95% confidence level.

Finance and Accounting Credit Standards* (10 point scale, means shown) Findings Credit exposure and related collateral requirements are calculated consistent with protocols Collateral requirements are adequate to mitigate the credit exposure in the market Collateral requirements and credit standards are fairly implemented across the market * New questions in 2006.

ERCOT Project Management Office (10 point scale, means shown) Findings Overall performance Consistently applying cost-benefit analysis** Communicating progress of projects Spending money effectively Knowledge/Industry expertise Implementing projects based on system changes Implementing projects that meet expectations ** New question in 2006.

Market perceived areas of strength:  Performance with respect to corporate objectives  Systems are providing timely and accurate data  ERCOT staff performance across virtually all functional areas  Performance of Account Managers Conclusions

Specific areas for strategic consideration:  Market’s understanding of the role of committees / governance in setting spending priorities  Defining and communicating ERCOT staff’s market function  The market is critical of ERCOT’s project management -- More research on this issue is necessary. Conclusions (cont.) Conclusions