“Victor Babes” UNIVERSITY OF MEDICINE AND PHARMACY TIMISOARA DEPARTMENT OF MEDICAL INFORMATICS AND BIOPHYSICS Medical Informatics Division www.medinfo.umft.ro/dim.

Slides:



Advertisements
Similar presentations
Lecture 2: Basic Information Theory TSBK01 Image Coding and Data Compression Jörgen Ahlberg Div. of Sensor Technology Swedish Defence Research Agency (FOI)
Advertisements

Entropy and Information Theory
EE465: Introduction to Digital Image Processing 1 One-Minute Survey Result  Thank you for your responses Kristen, Anusha, Ian, Christofer, Bernard, Greg,
Information Theory EE322 Al-Sanie.
Sep 8 Fall 05 Medical Data Patient Data Clinical Data Healthcare Data Biomedical Data.
SIMS-201 Compressing Information. 2  Overview Chapter 7: Compression Introduction Entropy Huffman coding Universal coding.
APPLICATION OF COMPUTER IN MEDICINE BY MASHAEL SAUD ALHARBI.
1/15 KLKSK Pertemuan III Analog & Digital Data Shannon Theorem xDSL.
BIOMEDICAL ENGINEERING A New, Promising Interdisciplinary Field Mohamed Bingabr, Ph.D. Associate Professor Department of Engineering and Physics University.
Chapter 6 Information Theory
Biotech 4490 Bioinformatics I Fall 2006 J.C. Salerno 1 Biological Information.
S. Mandayam/ ECOMMS/ECE Dept./Rowan University Electrical Communications Systems Spring 2005 Shreekanth Mandayam ECE Department Rowan University.
UNR, MATH/STAT 352, Spring Random variable (rv) – central concept of probability theory Numerical description of experiment.
Biostatistics Frank H. Osborne, Ph. D. Professor.
1 Chapter 1 Introduction. 2 Outline 1.1 A Very Abstract Summary 1.2 History 1.3 Model of the Signaling System 1.4 Information Source 1.5 Encoding a Source.
Lecture 2: Basic Information Theory Thinh Nguyen Oregon State University.
What is “Biomedical Informatics”?. Biomedical Informatics Biomedical informatics (BMI) is the interdisciplinary field that studies and pursues.
Overview of Signals & Systems Hany Ferdinando Dept. of Electrical Engineering Petra Christian University.
Management Information Systems Lection 06 Archiving information CLARK UNIVERSITY College of Professional and Continuing Education (COPACE)
Medical Informatics Basics
Prof. SankarReview of Random Process1 Probability Sample Space (S) –Collection of all possible outcomes of a random experiment Sample Point –Each outcome.
2. Mathematical Foundations
INFORMATION THEORY BYK.SWARAJA ASSOCIATE PROFESSOR MREC.
METU Informatics Institute Min720 Pattern Classification with Bio-Medical Applications Lecture Notes by Neşe Yalabık Spring 2011.
9/30/2004TCSS588A Isabelle Bichindaritz1 Introduction to Bioinformatics.
Formal Empirical Applied Mathematical and technical methods and theories Cognitive, behavioral, and organizational techniques and theories ImagingBioInformaticsClinical.
Introduction.
“Victor Babes” UNIVERSITY OF MEDICINE AND PHARMACY TIMISOARA DEPARTMENT OF MEDICAL INFORMATICS 2005 / 2006.
Lectures on Medical Biophysics Department of Biophysics, Medical Faculty, Masaryk University in Brno Norbert Wiener Biocybernetics.
“Victor Babes” UNIVERSITY OF MEDICINE AND PHARMACY TIMISOARA DEPARTMENT OF MEDICAL INFORMATICS AND BIOPHYSICS Medical Informatics Division
Medical Informatics Basics
“Victor Babes” UNIVERSITY OF MEDICINE AND PHARMACY TIMISOARA DEPARTMENT OF MEDICAL INFORMATICS AND BIOPHYSICS Medical Informatics Division
“Victor Babes” UNIVERSITY OF MEDICINE AND PHARMACY TIMISOARA DEPARTMENT OF MEDICAL INFORMATICS AND BIOPHYSICS Medical Informatics Division
Medical Informatics Basics Lection 1 Associated professor Andriy Semenets Department of Medical Informatics.
Introduction Random Process. Where do we start from? Undergraduate Graduate Probability course Our main course Review and Additional course If we have.
Channel Capacity.
Image Compression (Chapter 8) CSC 446 Lecturer: Nada ALZaben.
Unit A Vocabulary Words. 1. Sensory Neurons Neurons that carry signals from receptors and transmit information about the environment to processing centers.
Agent-based methods for translational cancer multilevel modelling Sylvia Nagl PhD Cancer Systems Science & Biomedical Informatics UCL Cancer Institute.
COMMUNICATION NETWORK. NOISE CHARACTERISTICS OF A CHANNEL 1.
“Victor Babes” UNIVERSITY OF MEDICINE AND PHARMACY TIMISOARA DEPARTMENT OF MEDICAL INFORMATICS AND BIOPHYSICS Medical Informatics Division
Summer 2004CS 4953 The Hidden Art of Steganography A Brief Introduction to Information Theory  Information theory is a branch of science that deals with.
Introduction to Digital and Analog Communication Systems
Computer Vision – Compression(1) Hanyang University Jong-Il Park.
Information Theory The Work of Claude Shannon ( ) and others.
Coding Theory. 2 Communication System Channel encoder Source encoder Modulator Demodulator Channel Voice Image Data CRC encoder Interleaver Deinterleaver.
Coding Theory Efficient and Reliable Transfer of Information
Chapter 3 Foundation of Mathematical Analysis § 3.1 Statistics and Probability § 3.2 Random Variables and Magnitude Distribution § 3.3 Probability Density.
Prepared by: Engr. Jo-Ann C. Viñas 1 MODULE 2 ENTROPY.
“Victor Babes” UNIVERSITY OF MEDICINE AND PHARMACY TIMISOARA DEPARTMENT OF MEDICAL INFORMATICS AND BIOPHYSICS Medical Informatics Division
1 Physical Layer Computer Networks. 2 Where are we?
NPS CISREthics1 Information William Hugh Murray October 15, 2001.
Combinatorics (Important to algorithm analysis ) Problem I: How many N-bit strings contain at least 1 zero? Problem II: How many N-bit strings contain.
Entropy (YAC- Ch. 6)  Introduce the thermodynamic property called Entropy (S)  Entropy is defined using the Clausius inequality  Introduce the Increase.
Presented by Minkoo Seo March, 2006
ECE 101 An Introduction to Information Technology Introduction to ECE 101.
Basic Concepts of Information Theory A measure of uncertainty. Entropy. 1.
SEAC-3 J.Teuhola Information-Theoretic Foundations Founder: Claude Shannon, 1940’s Gives bounds for:  Ultimate data compression  Ultimate transmission.
UNIT I. Entropy and Uncertainty Entropy is the irreducible complexity below which a signal cannot be compressed. Entropy is the irreducible complexity.
Information Theory Information Suppose that we have the source alphabet of q symbols s 1, s 2,.., s q, each with its probability p(s i )=p i. How much.
KHARKOV NATIONAL MEDICAL UNIVERSITY MEDICAL INFORMATICS МЕДИЧНА ІНФОРМАТИКА MEDICAL INFORMATICS.
(Important to algorithm analysis )
Introduction to Information theory
Information Theory Michael J. Watts
(Important to algorithm analysis )
A Brief Introduction to Information Theory
Physical Layer Computer Networks.
Inf 723 Information & Computing
POPULATION (of “units”)
Electrical Communications Systems ECE Spring 2019
Presentation transcript:

“Victor Babes” UNIVERSITY OF MEDICINE AND PHARMACY TIMISOARA DEPARTMENT OF MEDICAL INFORMATICS AND BIOPHYSICS Medical Informatics Division / 2008

COURSE 1

1. MEDICAL INFORMATICS MEDICAL INFORMATICS MEDICAL INFORMATICS – an interdisciplinary field studying: Old definition: computer applications in medical practice and research Modern definition: generation, acquisition, storage, transmission, processing, protection and use of medical information

2. INFORMATION THEORY 2. INFORMATION THEORY

2.1. INTRODUCTORY NOTIONS a) VARIABLESa) VARIABLES –deterministic well defined values by repeating the measurement the same values will be obtained –random (stochastic) get different values even will keep the conditions ex: throwing the dice, tossing a coin

b) PROBABILITY:b) PROBABILITY: –EVENT = EXPERIMENT’S RESULT –FREQENCES: ABSOLUTE - n iABSOLUTE - n i RELATIVE - n i / N,  n i = NRELATIVE - n i / N,  n i = N –FIELD OF EVENTS: EVENTS X 1 X 2... X kEVENTS X 1 X 2... X k ABS.FREQ.n 1 n 2... n kABS.FREQ.n 1 n 2... n k –DEFINITION OF PROBABILTY: EXAMPLES

c) FIELD OF PROBABILITIES: c) FIELD OF PROBABILITIES: - - EVENTS X 1 X 2... X k - PROBABILITIESp 1 p 2... p k TYPES OF EVENTS: TYPES OF EVENTS: - - certain event p = 1 - impossible event p = 0 - equelprobabile events p i = p j

2.2. NOTION OF INFORMATION a) Definition: philosophical category (with high degree of generality) defined by properties:a) Definition: philosophical category (with high degree of generality) defined by properties: Basic property: ‘REMOVING AN UNCERTAINTY’ b) Information nature:b) Information nature: –it’s not substance –it’s not energy

c) Complete approach (triadic):c) Complete approach (triadic): –matter structure –Energy support –information (function) d) Utility value of informationd) Utility value of information –depends on the receptor –examples

2.3. AMOUNT OF INFORMATION a) FOR ONE EVENT (Shannon)a) FOR ONE EVENT (Shannon) I i = log 2 (1/p i ) = - log 2 p i b) UNIT of measure: BIT (Binary digIT):b) UNIT of measure: BIT (Binary digIT): 1 bit removes an uncertainty of 1/2

c) INFORMATIONAL ENTROPY AVERAGE INFORMATION OF ONE EVENT IN A MESSAGE OF LENGTH “N”AVERAGE INFORMATION OF ONE EVENT IN A MESSAGE OF LENGTH “N” I m = (n 1 I n k I k ) / N I m = H =  p i I i H = -  p i log 2 p i

d) FOR EQUIPROBABLE EVENTS p i = 1 / k, H = H max = log 2 k p i = 1 / k, H = H max = log 2 k e) Examples: one proteic sequence of 100 amino acids e) Examples: one proteic sequence of 100 amino acids k = 20 aa, p = 1 / 20 k = 20 aa, p = 1 / 20 H = 20 ( (1/20) log 2 (1/20) ) = 4,5 bit/aa H = 20 ( (1/20) log 2 (1/20) ) = 4,5 bit/aa I tot = 100 x 4,5 = 450 bit I tot = 100 x 4,5 = 450 bit f) The relation with the thermodynamic entropy and order ( Maxwell’s demon ) f) The relation with the thermodynamic entropy and order ( Maxwell’s demon )

2.4. REDUNDANCY a) DEFINITION:a) DEFINITION: - ABSOLUTE REDUNDANCY R = H MAX - H REAL - RELATIVE REDUNDANCY R r = R / H MAX b) UTILITY: to decrease perturbations effects in the information transfer processb) UTILITY: to decrease perturbations effects in the information transfer process

2.5. COMMUNICATION SYSTEMS a) DEFINITIONS:a) DEFINITIONS: MESSAGE = the information which is transmitted SIGNAL = the physical support for the message

b) THE COMMUNICATION SYSTEM SCHEME S = source (emmitter) R = destination (receptor) C = communication channel N = perturbations (noise)

c) TRANSDUCERS = device which changes d) MODEMS = MOdulation / DEModulation e) CODING = translation from one alphabet to another f) THE CHANNEL CAPACITY = bits/seconds (bps,baud)

2.6. INFORMATION TRANSFER IN BIOLOGICAL SYSTEMS a) THE GENETIC CODE: a) THE GENETIC CODE: DNA, 4 bases (A - T / U, C - G) DNA, 4 bases (A - T / U, C - G) REPLICATION, CODONS REPLICATION, CODONS b) CODING IN NERVOUS SYSTEM b) CODING IN NERVOUS SYSTEM - FREQUENCY - ON AXONS - FREQUENCY - ON AXONS - AMPLITUDE - DENDRITES, SYNAPSES - AMPLITUDE - DENDRITES, SYNAPSES c) EXTERNAL INFORMATION - sense organs c) EXTERNAL INFORMATION - sense organs d) INTERNAL INFORMATION - interorceptors d) INTERNAL INFORMATION - interorceptors

3. MEDICAL INFORMATION 3. MEDICAL INFORMATION

3.1. MEDICAL INFORMATION PACIENT – PHYSICIAN RELATIONPACIENT – PHYSICIAN RELATION ELEMENTARY CYCLE OF MEDICAL ACTIVITYELEMENTARY CYCLE OF MEDICAL ACTIVITY MEDICAL INFORMATION USED IN MEDICAL ACTIVITY:MEDICAL INFORMATION USED IN MEDICAL ACTIVITY: –DATA – individual character - facts –KNOWLEDGE – general character - concepts

ELEMENTARY CYCLE OF MEDICAL ACTIVITY

3.3. Medical Information Classification on Structural Levels Level of medical information Structural level Studied by: DomainChapter in IM Infra- individual level Molecular / subcellular Molecular Biology and Genetics LifeSciencesBioinformatics Cell / tissue Cell Biology Organ / SystemPhysiology Neuro - informatics Brain Theory CognitiveSciences Individual level Whole organism (‘pacient’) Paraclinical Disciplines (investigations) Clinical Disciplines (diagnosis, treatment) MedicalSciences Clinical Informatics Supra- individual levelCommunity Public Health Health Sciences HealthInformatics HealthcareActivityHealthcareManagement

TYPES OF DATA QUALITATIVE – Anamnesis (descriptive)QUALITATIVE – Anamnesis (descriptive) NUMERICAL – Laboratory investigationsNUMERICAL – Laboratory investigations GRAPHICAL – Biosignals (ECG, EEG…)GRAPHICAL – Biosignals (ECG, EEG…) SOUNDS: PhonocardiogramSOUNDS: Phonocardiogram STATIC IMAGES: X-Ray, NMRSTATIC IMAGES: X-Ray, NMR DYNAMIC IMAGES – moviesDYNAMIC IMAGES – movies

Operations with information -Generation (biomedical process or action) -Acquisition (collection) – depends on information nature -Storage – data bases, knowledge bases -Processing – for interpretation -Transmission -Protection -Use

4. CHAPTERS OF MEDICAL INFORMATICS Ist PART. DATA Ist PART. DATA –STORAGE - DATABASES –ACQUISITION & PROCESSING: NUMERICAL & QUALITATIVE – BIOSTATISTICS SIGNAL PROCESSING, MEDICAL IMAGING IInd PART. MEDICAL KNOWLEDGE IInd PART. MEDICAL KNOWLEDGE –MEDICAL DECISION SUPPORT –EXTRACTION & FORMALIZATION OF MEDICAL KNOWLEDGE IIIrd PART. HEALTHCARE INFORMATICS IIIrd PART. HEALTHCARE INFORMATICS –INFORMATION SYSTEMS

END