“Victor Babes” UNIVERSITY OF MEDICINE AND PHARMACY TIMISOARA DEPARTMENT OF MEDICAL INFORMATICS AND BIOPHYSICS Medical Informatics Division www.medinfo.umft.ro/dim.

Slides:



Advertisements
Similar presentations
Lecture 2: Basic Information Theory TSBK01 Image Coding and Data Compression Jörgen Ahlberg Div. of Sensor Technology Swedish Defence Research Agency (FOI)
Advertisements

Entropy and Information Theory
Information Theory EE322 Al-Sanie.
Sep 8 Fall 05 Medical Data Patient Data Clinical Data Healthcare Data Biomedical Data.
INTRODUCTION TO MEDICAL INFORMATICS DR. ALI M. HADIANFARD FACULTY MEMBER OF AJUMS
SIMS-201 Compressing Information. 2  Overview Chapter 7: Compression Introduction Entropy Huffman coding Universal coding.
APPLICATION OF COMPUTER IN MEDICINE BY MASHAEL SAUD ALHARBI.
1/15 KLKSK Pertemuan III Analog & Digital Data Shannon Theorem xDSL.
Chapter 6 Information Theory
Biotech 4490 Bioinformatics I Fall 2006 J.C. Salerno 1 Biological Information.
Edward H. Shortliffe, MD, PhD College of Physicians & Surgeons
Introduction to Bioinformatics Spring 2008 Yana Kortsarts, Computer Science Department Bob Morris, Biology Department.
UNR, MATH/STAT 352, Spring Random variable (rv) – central concept of probability theory Numerical description of experiment.
1 Chapter 1 Introduction. 2 Outline 1.1 A Very Abstract Summary 1.2 History 1.3 Model of the Signaling System 1.4 Information Source 1.5 Encoding a Source.
Lessons from Biomedical Informatics for Nutrition Informatics James J. Cimino, M.D. Laboratory for Informatics Development NIH Clinical Center.
Lecture 2: Basic Information Theory Thinh Nguyen Oregon State University.
What is “Biomedical Informatics”?. Biomedical Informatics Biomedical informatics (BMI) is the interdisciplinary field that studies and pursues.
Bioinformatics Original definition (1979 by Paulien Hogeweg): “application of information technology and computer science to the field of molecular biology”
Overview of Signals & Systems Hany Ferdinando Dept. of Electrical Engineering Petra Christian University.
Management Information Systems Lection 06 Archiving information CLARK UNIVERSITY College of Professional and Continuing Education (COPACE)
Medical Informatics Basics
2. Mathematical Foundations
INFORMATION THEORY BYK.SWARAJA ASSOCIATE PROFESSOR MREC.
METU Informatics Institute Min720 Pattern Classification with Bio-Medical Applications Lecture Notes by Neşe Yalabık Spring 2011.
9/30/2004TCSS588A Isabelle Bichindaritz1 Introduction to Bioinformatics.
Formal Empirical Applied Mathematical and technical methods and theories Cognitive, behavioral, and organizational techniques and theories ImagingBioInformaticsClinical.
“Victor Babes” UNIVERSITY OF MEDICINE AND PHARMACY TIMISOARA DEPARTMENT OF MEDICAL INFORMATICS 2005 / 2006.
Lectures on Medical Biophysics Department of Biophysics, Medical Faculty, Masaryk University in Brno Norbert Wiener Biocybernetics.
Information Systems Basic Core Specialization Clinical Imaging BioInformatics Public Health Computer Science Methods (formal models) Biomedical Decision.
“Victor Babes” UNIVERSITY OF MEDICINE AND PHARMACY TIMISOARA DEPARTMENT OF MEDICAL INFORMATICS AND BIOPHYSICS Medical Informatics Division
Medical Informatics Basics
“Victor Babes” UNIVERSITY OF MEDICINE AND PHARMACY TIMISOARA DEPARTMENT OF MEDICAL INFORMATICS AND BIOPHYSICS Medical Informatics Division
Medical Informatics Basics Lection 1 Associated professor Andriy Semenets Department of Medical Informatics.
Introduction Random Process. Where do we start from? Undergraduate Graduate Probability course Our main course Review and Additional course If we have.
Integrated Biomedical Information for Better Health Workprogramme Call 4 IST Conference- Networking Session.
(Important to algorithm analysis )
Image Compression (Chapter 8) CSC 446 Lecturer: Nada ALZaben.
Unit A Vocabulary Words. 1. Sensory Neurons Neurons that carry signals from receptors and transmit information about the environment to processing centers.
“Victor Babes” UNIVERSITY OF MEDICINE AND PHARMACY TIMISOARA DEPARTMENT OF MEDICAL INFORMATICS AND BIOPHYSICS Medical Informatics Division
Summer 2004CS 4953 The Hidden Art of Steganography A Brief Introduction to Information Theory  Information theory is a branch of science that deals with.
Introduction to Digital and Analog Communication Systems
“Victor Babes” UNIVERSITY OF MEDICINE AND PHARMACY TIMISOARA DEPARTMENT OF MEDICAL INFORMATICS AND BIOPHYSICS Medical Informatics Division
Computer Vision – Compression(1) Hanyang University Jong-Il Park.
Information Theory The Work of Claude Shannon ( ) and others.
Coding Theory Efficient and Reliable Transfer of Information
Chapter 3 Foundation of Mathematical Analysis § 3.1 Statistics and Probability § 3.2 Random Variables and Magnitude Distribution § 3.3 Probability Density.
Prepared by: Engr. Jo-Ann C. Viñas 1 MODULE 2 ENTROPY.
“Victor Babes” UNIVERSITY OF MEDICINE AND PHARMACY TIMISOARA DEPARTMENT OF MEDICAL INFORMATICS AND BIOPHYSICS Medical Informatics Division
1 Physical Layer Computer Networks. 2 Where are we?
NPS CISREthics1 Information William Hugh Murray October 15, 2001.
Digital Image Processing Lecture 22: Image Compression
Introduction to Biological Concepts and Research Chapter 1.
Combinatorics (Important to algorithm analysis ) Problem I: How many N-bit strings contain at least 1 zero? Problem II: How many N-bit strings contain.
Entropy (YAC- Ch. 6)  Introduce the thermodynamic property called Entropy (S)  Entropy is defined using the Clausius inequality  Introduce the Increase.
ECE 101 An Introduction to Information Technology Introduction to ECE 101.
Basic Concepts of Information Theory A measure of uncertainty. Entropy. 1.
Biomedical Informatics and Health. What is “Biomedical Informatics”?
UNIT I. Entropy and Uncertainty Entropy is the irreducible complexity below which a signal cannot be compressed. Entropy is the irreducible complexity.
Binary data to transmit The faster the bit rate, the more energy is spread on the spectrum + a - a a2T0a2T0 s(t) T0T0 1/T 0 2/T 0 Frequency Time.
KHARKOV NATIONAL MEDICAL UNIVERSITY MEDICAL INFORMATICS МЕДИЧНА ІНФОРМАТИКА MEDICAL INFORMATICS.
Health Care Informatics
Medical Informatics Prof. Dr. Nizamettin AYDIN
Digital Image Processing Lecture 20: Image Compression May 16, 2005
(Important to algorithm analysis )
Information Theory Michael J. Watts
(Important to algorithm analysis )
What is “Biomedical Informatics”?
Physical Layer Computer Networks.
Inf 723 Information & Computing
What is “Biomedical Informatics”?
Presentation transcript:

“Victor Babes” UNIVERSITY OF MEDICINE AND PHARMACY TIMISOARA DEPARTMENT OF MEDICAL INFORMATICS AND BIOPHYSICS Medical Informatics Division / 2006

COURSE 1

1. MEDICAL INFORMATICS MEDICAL INFORMATICS MEDICAL INFORMATICS – an interdisciplinary field studying: Old definition: computer applications in medical practice and research Modern definition: generation, acquisition, storage, transmission, processing, protection and use of medical information

2. INFORMATION THEORY 2. INFORMATION THEORY

2.1. INTRODUCTORY NOTIONS a) VARIABLESa) VARIABLES –deterministic well defined values by repeating the measurement the same values will be obtained –random (stochastic) get different values even will keep the conditions ex: throwing the dice, tossing a coin

b) PROBABILITY:b) PROBABILITY: –EVENT = EXPERIMENT’S RESULT –FREQENCES: ABSOLUTE - n iABSOLUTE - n i RELATIVE - n i / N,  n i = NRELATIVE - n i / N,  n i = N –FIELD OF EVENTS: EVENTS X 1 X 2... X kEVENTS X 1 X 2... X k ABS.FREQ.n 1 n 2... n kABS.FREQ.n 1 n 2... n k –DEFINITION OF PROBABILTY: EXAMPLES

c) FIELD OF PROBABILITIES: c) FIELD OF PROBABILITIES: - - EVENTS X 1 X 2... X k - PROBABILITIESp 1 p 2... p k TYPES OF EVENTS: TYPES OF EVENTS: - - certain event p = 1 - impossible event p = 0 - equelprobabile events p i = p j

2.2. NOTION OF INFORMATION a) Definition: philosophical category (with high degree of generality) defined by properties:a) Definition: philosophical category (with high degree of generality) defined by properties: Basic property: ‘REMOVING AN UNCERTAINTY’ b) Information nature:b) Information nature: –it’s not substance –it’s not energy

c) Complete approach (triadic):c) Complete approach (triadic): –matter structure –Energy support –information (function) d) Utility value of informationd) Utility value of information –depends on the receptor –examples

2.3. AMOUNT OF INFORMATION a) FOR ONE EVENT (Shannon)a) FOR ONE EVENT (Shannon) I i = log 2 (1/p i ) = - log 2 p i b) UNIT of measure: BIT (Binary digIT):b) UNIT of measure: BIT (Binary digIT): 1 bit removes an uncertainty of 1/2

c) INFORMATIONAL ENTROPY AVERAGE INFORMATION OF ONE EVENT IN A MESSAGE OF LENGTH “N”AVERAGE INFORMATION OF ONE EVENT IN A MESSAGE OF LENGTH “N” I m = (n 1 I n k I k ) / N I m = H =  p i I i H = -  p i log 2 p i

d) FOR EQUIPROBABLE EVENTS p i = 1 / k, H = H max = log 2 k p i = 1 / k, H = H max = log 2 k e) Examples: one proteic sequence of 100 amino acids e) Examples: one proteic sequence of 100 amino acids k = 20 aa, p = 1 / 20 k = 20 aa, p = 1 / 20 H = 20 ( (1/20) log 2 (1/20) ) = 4,5 bit/aa H = 20 ( (1/20) log 2 (1/20) ) = 4,5 bit/aa I tot = 100 x 4,5 = 450 bit I tot = 100 x 4,5 = 450 bit f) The relation with the thermodynamic entropy and order ( Maxwell’s demon ) f) The relation with the thermodynamic entropy and order ( Maxwell’s demon )

2.4. REDUNDANCY a) DEFINITION:a) DEFINITION: - ABSOLUTE REDUNDANCY R = H MAX - H REAL - RELATIVE REDUNDANCY R r = R / H MAX b) UTILITY: to decrease perturbations effects in the information transfer processb) UTILITY: to decrease perturbations effects in the information transfer process

2.5. COMMUNICATION SYSTEMS a) DEFINITIONS:a) DEFINITIONS: MESSAGE = the information which is transmitted SIGNAL = the physical support for the message

b) THE COMMUNICATION SYSTEM SCHEME S = source (emmitter) R = destination (receptor) C = communication channel N = perturbations (noise)

c) TRANSDUCERS = device which changes d) MODEMS = MOdulation / DEModulation e) CODING = translation from one alphabet to another f) THE CHANNEL CAPACITY = bits/seconds (bps,baud)

2.6. INFORMATION TRANSFER IN BIOLOGICAL SYSTEMS a) THE GENETIC CODE: a) THE GENETIC CODE: DNA, 4 bases (A - T / U, C - G) DNA, 4 bases (A - T / U, C - G) REPLICATION, CODONS REPLICATION, CODONS b) CODING IN NERVOUS SYSTEM b) CODING IN NERVOUS SYSTEM - FREQUENCY - ON AXONS - FREQUENCY - ON AXONS - AMPLITUDE - DENDRITES, SYNAPSES - AMPLITUDE - DENDRITES, SYNAPSES c) EXTERNAL INFORMATION - sense organs c) EXTERNAL INFORMATION - sense organs d) INTERNAL INFORMATION - interorceptors d) INTERNAL INFORMATION - interorceptors

3. MEDICAL INFORMATION 3. MEDICAL INFORMATION

3.1. MEDICAL INFORMATION PACIENT – PHYSICIAN RELATIONPACIENT – PHYSICIAN RELATION ELEMENTARY CYCLE OF MEDICAL ACTIVITYELEMENTARY CYCLE OF MEDICAL ACTIVITY MEDICAL INFORMATION USED IN MEDICAL ACTIVITY:MEDICAL INFORMATION USED IN MEDICAL ACTIVITY: –DATA – individual character - facts –KNOWLEDGE – general character - concepts

ELEMENTARY CYCLE OF MEDICAL ACTIVITY

Structural level Studied by: Domain Correspondin g area of MI molecular / sub cellular molecular biology genetics life sciences bioinformatics cell / tissuecell biology organphysiology neuro informatics systembrain theory cognitive sciences body (‘patient’) - paraclinical depts. (investigation) - clinical depts. (diagnosis, treatment) medical sciences medical informatics - community level - public health healthcare healthcare - healthcare activity healthcare managementsciencesinformatics 3.3. CLASIFICAREA INFORMATIEI MEDICALE PE NIVELE STRUCTURALE

TYPES OF DATA QUALITATIVE – Anamnesis (descriptive)QUALITATIVE – Anamnesis (descriptive) NUMERICAL – Laboratory investigationsNUMERICAL – Laboratory investigations GRAPHICAL – Biosignals (ECG, EEG…)GRAPHICAL – Biosignals (ECG, EEG…) SOUNDS: PhonocardiogramSOUNDS: Phonocardiogram STATIC IMAGES: X-Ray, NMRSTATIC IMAGES: X-Ray, NMR DYNAMIC IMAGES – moviesDYNAMIC IMAGES – movies

Operations with information -Generation (biomedical process or action) -Acquisition (collection) – depends on information nature -Storage – data bases, knowledge bases -Processing – for interpretation -Transmission -Protection -Use

4. CHAPTERS OF MEDICAL INFORMATICS 4. CHAPTERS OF MEDICAL INFORMATICS I st PART. DATA STORAGE - DATABASES ACQUISITION & PROCESSING: NUMERICAL & QUALITATIVE – BIOSTATISTICS SIGNAL PROCESSING MEDICAL IMAGING II nd PART. MEDICAL KNOWLEDGE MEDICAL DECISION SUPPORT EXTRACTION & FORMALIZATION OF MEDICAL KNOWLEDGE III rd PART. INFORMATION SYSTEMS

END