Dashboards and Reports Rachel S Dokholyan, MPH

Dashboards and Reports Nothing to disclose

Dashboards and Reports – Current Reports n ‘State-of-the-art’ statistical analyses n ‘Out-of-date’ report delivery and format: l Single PDF document l 100+ pages l Static content – not customizable l Quarterly and twice annual only

Demand for Customizable Reports – Survey 2014 Q 3.1 Are you or your institution interested in the ability to query the STS data yourself? Overall RespondentsSurgeon Respondents

Demand for customizable reports Likelihood of using and time commitment per quarter Q 3.3 How likely is it that you would use a query/customization tool to review your STS data? Q 3.4 If very likely or somewhat likely, how much time would you be willing/able to spend per quarter using this functionality?

Dashboards and Reports – Directions in 2016 n Web-based reporting n Daily updates (dashboard)

Dashboards and Reports – Web-based reporting n Username/password access l Same as currently used to download reports and sign in to data collection modules l Content access managed at the individual level n Tableau™ IT data visualization solution l Ability to customize table/figures l Ability to download PDF/Excel versions l Smartphone app available

Dashboards and Reports – Tableau example n Here

Dashboards and Reports – Patient drill-down n Ability to drill down to patient level n Click on number…. n List of patients with direct identifiers provided

Dashboards and Reports – Patient drill-down n Here

Dashboards and Reports – Customization n Ability to l Select parameters l Apply filters l Select time period

Customization

Customization

Expanded Graphics

Dashboards and Reports – Daily Updates n Participant dashboard to be updated nightly l Will include any new data submitted during that day Participant data only l National benchmarks updated: Quarterly (ACSD) Twice annually (CHSD and GTSD) l Complex (hierarchical) risk-adjustment (e.g. Star Rating) updated with national benchmarks

Dashboards and Reports – Daily Updates n Participant data we expect to provide to you nightly l Frequency of pre-op risk factors l Frequency of intraoperative variables l Observed rate of complications and mortality l Observed to expected ratio (O/E) for model outcomes n Participant data we will NOT provide nightly l Estimated odds ratios for endpoints (hierarchical) l Risk-adjusted endpoints that require estimated odds ratio

Dashboards and Reports – Training n Quick Reference Document: l An educational resource that will be available in a PDF format for e ‐ mail distribution and/or posting to the STS website. n Multi-media training module: l Designed to introduce users to the system and its functionality. Will be posted on STS website. n Frequently Asked Questions (FAQ): l A frequently asked questions resource about the on-line reporting environment.

Dashboards and Reports – Timeline n 2015: l Content selection begins n 2016: l Adult Cardiac Surgery Database n 2017: l Congenital Heart Surgery Database l General Thoracic Surgery Database

Dashboards and Reports – Report Content n 2014 Report Survey identified some content needs n Group of surgeons and core data managers will help select priority content and needed data visualization functionality

What is dashboard-worthy? Q 3.2 Which parameters would you like to be able to select for your reports/queries? (Select all that apply)

Best time interval for QI review? Q 3.2 Which parameters would you like to be able to select for your reports/queries? (Select all that apply) Answer% Rolling 6 months30% Rolling 12 months42% Calendar year20% Other8% One size definitely does not fit all….

Dashboards and Reports – Timeline n 2016: l January – June Pilot test: FeasibilityUsability Content selection l July – December Roll out to all ACSD participants Expand to include all ACSD report content

Dashboards and Reports – Timeline n 2017: l January – June Congenital Heart Surgery Database Pilot (possible) Rollout l July – December General Thoracic Heart Surgery Database Pilot (possible) Rollout

Dashboards and Reports – Future directions n On-line Data Quality Report n On-line Regional or 3 rd Party Reports