ChiMat user survey and feedback: highlights ChiMat Board Meeting – 29 March 2010

Background to survey This the first user survey conducted since the formation of ChiMat in February The survey was conducted on the website during March 2010 and users were invited to respond via the weekly e- bulletin. 183 users responded to the survey with 116 following through to completion. The primary purpose of the survey was to elicit feedback to enable further development of the website. General questions were also asked about the benefits of using the service, perception of tools and services and background information on users and their organisations. It is this supplementary information which has been analysed for this report.

Benefits – at individual level 183 responses at this stage

Benefits – at corporate level 183 responses at this stage

Individual comments An excellent resource - indispensible A great resource! Fantastic that all this knowledge and information is pulled together in one place. The ChiMat website offers high quality information and is a reliable resource. A good set of information, frustratingly inaccessible Extremely useful tool to support my commissioning role. A very useful resource source that is underutilised to assist in making evidence based commissioning decisions. Is on the right lines but still needs to look at ways to make accessing information easier.

The extent to which different products and/or services are used 110 responses at this stage

Positive feedback on products and services (excellent or good) 110 responses at this stage

Positive feedback versus usage of products and services CSM DMIT Age appropriate environments i-view workforce i-view NCMP European atlas Data atlas 110 responses at this stage

Regional coverage 116 responses at this stage

Organisational types covered 116 responses at this stage

Split of organisational types 116 responses at this stage

Role types covered – others split 116 responses at this stage

Role types – Using ChiMat gives me evidence to support investment decisions

Role types – I have used ChiMat to improve cost effectiveness of services

Principal observations - benefits Users are getting very good benefits from ChiMat at an individual level, in particular keeping up to date, saving time and working more effectively. 46% of users are finding evidence to support investment decisions. This is a robust proportion although lower than the other target benefits and merits further attention. Good evidence that users are applying the ChiMat outputs at a corporate level, in particular identifying opportunities for service improvement. Users are also using ChiMat for needs assessment and performance monitoring. 21% of users are managing to improve the cost effectiveness of services. This is a credible start but currently inadequate for such an important target application. Attention will be given to how users can be supported to develop in this area. Individual comments are very supportive and positive. Some comments include service improvement suggestions include improving access to information and helping with evidence based decision making.

Principal observations – use of products and services Tools most heavily commented on (proxy for use) include health profiles, data atlas, CSM, tools and data directory, needs assessments Positive feedback on all tools, but varies with tool, ranging from 68% to 100% 100% of DMIT users rate tool as good or excellent Variability across extent of use and positive perception of tools Some with very positive feedback but smaller user base, e.g. DMIT and European atlas Some with less positive feedback and small user base, e.g. age appropriate environments and i-View Some with less positive feedback but large user base, e.g. data atlas and CSM

Principal observations – user base Coverage of all English regions with most activity in North West, Yorkshire & Humber and London. Least activity in North East. Some activity at national level and beyond. 72 % of users in local organisations, PCT commissioners NHS providers and Local Authorities strongly represented. The predominant role type covers those involved in the direct delivery and development of clinical services. Other highly represented groups include clinical professionals such as nurses, midwives and health visitors, doctors and public health specialists, in turn further supported by policy developers, researchers and commissioners of services.

Principal observations – those making Value for Money decisions Those using ChiMat to provide evidence to support investment decisions have clinical backgrounds and are actively engaged in the delivery or development of services. Commissioners are also making use of ChiMat for this purpose. Those successfully using ChiMat to improve the cost effectiveness of services predominantly have clinical backgrounds and are actively engaged the delivery or development of services. This is the evidence that ChiMat is hitting the target audience and that audience are using the data and information provided for the intended purpose.

Action plans Proposed actionOwner Follow up key survey respondents with interviewVR Complete detailed analysis of website development surveyVR Review data atlas usability and adapt development plansHS/SC Evaluate more user friendly and front end reporting toolsDW/EB Review usability of CSM website and consider user specific surveyCH Conduct a specific survey for registered users of DMIT toolsHO/VR Extend DMIT to further conditions and develop intervention toolkitsHD/DW/HS Develop a case study for DMITHO/VR Develop targeted publicity for DMIT and distribution planHO/VR Further develop regional network, including a regional publicity pack, paying particular attention to North East coverage. DW/HO Develop a workshop plan and training packs focussed on evidence based decision making, business case development and improving the cost effectiveness of services for implementation via the regional network. DW/HO Use the outputs on commissioning from the Child Health Improvement Partnership to further develop commissioning workshops for implementation via the regional network. HD/DW/HO