1. NASA Earth Observing System Data and Information Systems
2004 Customer Satisfaction Study
May 2004

2. Snapshot of the American Customer Satisfaction Index (ACSI)
The #1 national economic indicator of customer satisfaction
Compiled by the National Quality Research Center at University of Michigan Since 1994 using methodology licensed from CFI Group
Measures 40 industries, 200 organizations covering 75% of the U.S. economy
Over 70 U.S. Federal Government agencies have used ACSI to measure more than 120 programs/services
Advanced methodology quantifiably measures and links satisfaction levels to performance and prioritizes actions for improvement

3. Why Should Agencies Measure Customer Satisfaction?
Link customer satisfaction with expectations and desired outcomes
Benchmark against “best” in business and government
Set “baseline” for customer satisfaction and measure progress
Provide critical information for annual performance plans to Congress (as required under GPRA)
Identify areas for improving quality of service provided to customers
Raise trust in your agency and the government overall
Enable Senior Executive Service members to meet performance criteria
Customer Satisfaction

4. Review of ACSI Results
A component score is a weighted average of the set of survey questions comprising a component or activity area. Responses to survey questions are given on a 1-10 scale, which is converted to a scale for score reporting.
An impact predicts the increase in satisfaction that would result from a 5-point increase in a component or input score.
Areas for improvement are those components or activities with a relatively low score and a relatively high impact on satisfaction.
EXAMPLE
0.8 79 76 65
1.2
Component 2
Component 1
ACSI
Score
Impact
In the simplified example shown here, Component 2 would be a key action area due to its relatively low score and high impact.

5. Project Background Which NASA EOSDIS customer segment was surveyed?
This customer segment includes individuals who have accessed NASA EOSDIS data and/or products by means of a NASA EOSDIS Data Center (DAAC).
How were the NASA EOSDIS customers identified?
NASA EOSDIS provided a list of 33,251 addresses for people who have used NASA EOSDIS data and/or products. A sample drawn from the list, and CFI Group sent out 9,999 invitations asking customers to participate in the online survey.
The survey was available online April 29, 2004 – May 19, A total of 1,056 surveys were completed, of which CFI Group used 1,016 surveys for analysis.

6. NASA EOSDIS Aggregate Segment
NASA EOSDIS Results
The Customer Satisfaction Index for NASA EOSDIS is…
75*
NASA EOSDIS Aggregate Segment
The Customer Satisfaction Index score is derived from customer responses to three questions in the survey:
How satisfied are you overall with the products and services provided by the Data Center (79)?
To what extent have the data, products and services provided by the Data Center fallen short of or exceeded your expectations (73)?
How well does the Data Center compare with an ideal provider of scientific data, products and services (71)?
This score is four points higher than the 2003 American Customer Satisfaction Index for the Federal Government overall (71).
*The confidence interval for ACSI is +/-1.1 for the aggregate at the 95% confidence level.

7. Customer Satisfaction Index
Comparison Across Government Agencies
Customer Satisfaction Index
While NASA EOSDIS performs well when compared to the Federal Government overall, it doesn’t perform as well when compared to other information providing agencies.

8. NASA EOSDIS Customer Satisfaction Model
Product
Search 70
Delivery 84
Quality 68
Customer
Support
Selection
and Order 73
Satisfaction
(ACSI) 75
Future Use 90
Recommend 86
Complaints
32%
Quality Components (Drivers)
0.8
1.1
0.9
0.5
1.0
3.5
2.5
0.6
ACSI
Outcomes

9. Summary of Findings
Product Quality is the lowest scoring component (68), and has a relatively high impact (0.9).
All attributes in this area received similar ratings
At 84 Customer Support scores well, but is also high impact (1.0).
There is a significant difference in Customer Support ratings given by customers within the U.S. (88) compared to those outside the U.S. (82).
The components Product Search and Product Selection and Order are highly correlated.
Recent customers are more satisfied, but are also reporting more problems.
Percent of Customer Complaints is fairly high (32%) when compared to the Federal Government overall (12%).
Customers may not be calling to complain about a problem, but rather to seek assistance in solving the problem.
90% of respondents who answered the Customer Complaint questions gave user services’ complaint handling a rating of “6” or above.

10. Where Should NASA EOSDIS Focus?

11. Product Quality Impact: 0.9
In what format were data or products provided?
HDF-EOS 49%
HDF 39%
NetCDF 5%
Binary 14%
ASCII 12%
GeoTIFF 19%
Other 7%
Was documentation…
Delivered with the data %
Pointed to (on a website) 41%
Not available %

12. Product Search Impact: 0.8

13. Product Selection and Order Impact: 1.1

14. Customer Support Impact: 1.0

15. 66% of customers’ data was delivered through FTP
Delivery Impact: 0.5
66% of customers’ data was delivered through FTP

16. Desired Outcomes
NASA EOSDIS wants its customer to recommend and use EOSDIS services in the future. Desired customer behaviors were measured with a single question each.
“How likely are you to recommend the Data Center to a colleague?” scored an 86 (Impact of CSI onto Recommend: 3.5.)
“How likely are you to use the services provided by the Data Center in the future?” scored a 90 (Impact of CSI onto Future Use: 2.5.)
NASA EOSDIS customers were also asked if they had ever contacted the Data Center’s user services office to report a problem.
32% of of customer say they have contacted the Data Center’s user services office to report a problem.

17. Score Comparison Time of Last Data Product or Service Request

18. Score Comparison Current Location
10 point difference in the score for “timeliness of response”

19. Score Comparison Data Centers
ACSI

20. Recommendations Focus on Product Quality.
Review the type of data product documentation available with each product. Work to improve the clarity and thoroughness of the documentation.
Assess the various data formats and work to improve the usability of each.
Offer a wider variety of data formats.
Review the Product Search and Product Selection and Order scores to determine how best to help customers find the data they need.
Due to high correlation, improvements in one area will likely result in improvements in the other.
Simplify the search process; make data products more apparent.
Improve data product descriptions.

21. Additional Information
Detailed survey results for all of the Federal services, including trends in performance and customer satisfaction, were updated in December 2003 and can be found on the website
Many agencies share best practices through the interagency customer service forum.