1. Faculdade de Medicina da Universidade do Porto Introdução à Medicina II "Artificial Intelligence in Medicine: a survey of interests and beliefs of health researchers from four backgrounds" Turma 7 Orientador: Pedro Pereira Rodrigues Abril de 2010

2. Contents ● Introduction ● Methods ● Internal Validity Results ● Expected Results

3. Introduction Artificial Intelligence (AI) is, in a modern definition, the study and design of intelligent agents, where an intelligent agent is a system that perceives its environment and takes actions which maximise chances of success [1]. We decided to add this definition in the introduction due to the feedback we obtained from the Internal Validation. [1] Bernstein RB, Curtis WN, Artificial Intelligence: New Research, 2009

4. Introduction Impacts and applications of AI ● The AIM field has already produced systems/programs/machines that demonstrate that the application of AI techniques to medical decision is a fruitful methodology. [2] ● Integrating AIM modules into the daily-routine software environment of our care providers gives us a great chance for maintaining and improving quality of care. [3] ● ● [2] SHORTLIFFE EH; AI in medicine comes of age: blossoming or languishing?; 2009; ICAART, 5-6 ● [3] ABBOD MF, LINKENS DA, DOUNIAS G, MAHFOUF M; Survey on the use of smart and adaptive engineering systems in medicine; Artif Intell Med; 26, 179-209; 200 2

5. Research Question Is Artificial Intelligence relevant and valuable for current applications in Medicine? And in the future?

6. Aim To survey the different interests and beliefs of four different types of health researchers about Artificial Intelligence in Medicine and its current and future applications.

7. Specific Objectives ● Assess the different opinions across different types of health researchers: researchers of artificial intelligence in medicine, general clinical practitioners, critical care researchers and medical school deans; ● Identify the different applications/areas of impact/medical fields of AI in Medicine; ● Study the importance and the impact of AI in medical progress;

8. Specific Objectives Verify the contribution of medical researchers in the development of AI in Medicine Infer on the future application of AI in Medicine

9. Study design Observational and transversal study, using an online survey, answered by: Directors of European Medical Schools AIM researchers Critical Care researchers General Care researchers

10. Methods 4 populations Directors of European Medical Schools Researchers of Artificial Intelligence Researchers of Critical Care Researchers of General Practice Journals AIM JAMIA SMMR Journals Critical Care Critical Care in Medicine Intensive Care Journals New England Lancet JAMA

11. Methods Contacts Collection Journals: Search for e-mails of researchers in each area in the site of the journal in articles of the last 3 years Deans: Search for e-mails of directors of european medical schools in each university site Definition of samples Random selection of 100 contacts of each population

12. Methods

13. Internal Validation: ● The questionnaires were sent to teachers of the department to analize and give their opinion about them; ● After this, the surveys were reformulated and they will be sent to the target samples.

14. Methods Send the survey to 100 e-mails of each population If the number of answer is low, new random selection is made in our populations The surveys are sent again

15. Methods Fluxogram

16. Methods Schedule

17. Methods Survey ● Personalized e-mails will be sent to each population. ● Specific information concerning AI in Medicine will be provided to each group.

18. Methods Survey ● AIM Researchers

19. Methods Survey Each population has a group of specific questions. AIM Researchers My research receives the necessary financial support. ● I totally disagree ● I disagree ● I do not have a solid opinion ● I agree ● I totally agree

20. Methods Survey ● Directors of Medical European Schools

21. Methods Survey Each population has a group of specific questions. ● Directors of Medical European Schools How would you rate the relevance that your educational institution gives to the promotion of AI in Medicine? ● None ● Low ● Moderate ● High ● Very High ● My Educational Institution shoul give more relevance to the promotion of AI in medicine. ● I totally disagree ● I disagree ● I do not have a solid opinion ● I agree ● I totally agree

22. Methods Survey ● Critical Care Researchers

23. Methods Survey Each population has a group of specific questions. ● Critical Care Researchers In which situations do you consider the application of AI most useful? ● Decision support ● Data management ● Data monitoring ● Drug administration ● Other

24. Methods Survey ● General Practice Researchers

25. Methods Survey Each population has a group of specific questions. General Practice Researchers AI may improve the work of a general practionier. ● I totally disagree ● I disagree ● I do not have a solid opinion ● I agree ● I totally agree

26. Statistical Analysis Variables

27. Internal Validation S tatistical Analysis

28. Age Minutes spent answering the questionnaire

29. Internal Validation S tatistical Analysis Yes NoNot sure Nº of cases 2 - Have you ever applied AI in your professional life? 6 5 1

30. ● Seven teachers have answered this question and two of them have chosen two options. ● Data management was the most chosen option Internal Validation S tatistical Analysis Areas of AI application Nº of cases

31. ● From 7 answers, 5 pointed the impact of AI in the experience positive. ● The options “negative” and “extremely negative” weren't chosen. Internal Validation S tatistical Analysis

32. Rate of the relevance give to AI by the educational institution Internal Validation S tatistical Analysis Nº of cases

33. Internal Validation S tatistical Analysis Contingency Table – Age and contact with AI

34. Internal Validation S tatistical Analysis AI can enhance medical education

35. Internal Validation Necessary modifications

37. 8 - What is the future scenario that you predict for the link between AI and Medicine? Do you believe that, nowadays, it is important to apply AI in Medicine? Why? What benefits may, from your point of view, come out of this association? “AI may be complementary to classical decision making, allowing for better use of data available or its collection in support of medical decisions. “ “In the future, and as a technique starts to make it easier to integrate these systems in real-world scenarios of clinical practice, it seems to me that they come to play an increasingly important role in clinical decision support(...).” Internal Validation S tatistical Analysis

38. Statistical Analysis SPSS Analysis ● For the Lickert scales, the median will be the appropriate statistical measure. ● To the categorical variables comparison, the Chi- square test will be used.

39. Expected results ● There will certainly be different opinions based on: ● - Academic background; ● - Medical specialization; ● - Place of work.

40. Expected results Researchers in Artificial Intelligence AIM Researchers will probably be more receptive in answering the questionnaire and also give highly favorable opinions in relation to the use of these systems in the future.

41. Expected results Directors of European Medical Schools ● Should be receptive to the use of this technology since it is an excellent teaching and training tool for future physicians. ● It will all depend on the schools, countries and resources available.

42. Expected results Critical Care Specialists ● Might have a good opinion about AI in Medicine as they work in emergency situations where it is important to be fast in knowing when it is more appropriate to continue diagnosis or begin therapy (this data might be easily obtained using AI). ● We hope to get a considerable amount of answers but highly related to researchers own specialization, since nowadays critical care is intimately related to AI.

43. Expected results General Practice Researchers ● Will probably have a less beneficial view; ● We believe that the availability to answer will depend mostly on the institution where physicians work and if AI resources are already available there.

44. Expected difficulties ● Language differences may discourage many from answering the survey. ● Difficulties in analysis and interpretation of the answers. ● Difficulties in the selection of variables to consider. ● Difficulties with the contacts obtained, since some of the emails may already be inactive.

45. Expected difficulties ● Some information contained from the Internet might not be correct, at least regarding contacts that were googled. ● Difficulties in creating questions for the survey. ● Delay in obtaining the answers. ● Difficulties with the creation of the database containing the contact details of researchers. ● People do not always show an interest in answering surveys.