Some from Heim Chap 13 Sound The sound files are not included– most should work on windows 7 machines you tube.

Slides:



Advertisements
Similar presentations
Technology Assistance for People with Hearing Loss.
Advertisements

I Power Higher Computing Multimedia technology Audio.
HEARING.
Sound – Part 3 Year 7 Science. Sound Intensity Now, we found the rate at which particles vibrate affects the pitch of the sound and frequency. The magnitude.
Sensation and Perception - audition.ppt © 2001 Laura Snodgrass, Ph.D.1 Audition Anatomy –outer ear –middle ear –inner ear Ascending auditory pathway –tonotopic.
Hearing Our auditory sense. Frequency the number of complete wavelengths that pass through point at a given time. This determines the pitch of.
Some from Heim Chap 13 Prepared By Beryl Plimmer 2011 Sound The sound files are not linked – most should work on windows 7 machines.
Class 6 LBSC 690 Information Technology Human Computer Interaction and Usability.
The Auditory System. Audition (Hearing)  Transduction of physical sound waves into brain activity via the ear. Sound is perceptual and subjective. 
Designing a User Interface for People with Disabilities u u
The Cocktail Party Effect Presented by Group 8 廖朝弘 梅衍儂 張雅婷 陳瑋鈴 張筠淇 郭裕芯 組長:劉芳潔 翁怡欣
Chapter 6: The Human Ear and Voice
Chapter 14 Recording and Editing Sound. Getting Started FAQs: − How does audio capability enhance my PC? − How does your PC record, store, and play digital.
Digital audio and computer music COS 116, Spring 2012 Guest lecture: Rebecca Fiebrink.
Technology for Hearing Impairments
Digital Sound and Video Chapter 10, Exploring the Digital Domain.
Section 1: Sound Preview Key Ideas Bellringer Properties of Sound
Introduction to Interactive Media 10: Audio in Interactive Digital Media.
DO NOW: Put your homework packet together and get your reading notes out to be checked. THEN answer: Explain the Young-Helmholtz trichromatic theory.
School of Computer Science & Information Technology G6DPMM - Lecture 11 Media Design II – Sound.
Some from Heim Chap 13 Sound you tube Learning outcomes Describe the basics of human hearing Explain the difference between visual and auditory interaction.
Multimedia Specification Design and Production 2013 / Semester 2 / week 3 Lecturer: Dr. Nikos Gazepidis
Hearing: How do we hear?. Hearing: The Nature of Sound Module 9: Sensation.
1 Hearing or Audition Module 14. Hearing Our auditory sense.
Sound Checkpoint Physics. Sound You have probably performed some experiments on sound without knowing it. At some time most people have made a ruler vibrate.
MS. SUHA JAWABREH LECTURE # 9 Oral Communication.
Modication by tuti 1 LECTURE 7 THE USES OF DIGITAL AUDIO IN MULTIMEDIA.
Chapter 15 Recording and Editing Sound. 2Practical PC 5 th Edition Chapter 15 Getting Started In this Chapter, you will learn: − How sound capability.
Introduction to SOUND.
Hearing Sound – Travels through the air in waves – Caused by changes in air pressure that result from vibration of air molecules – Anything that makes.
Audio / Sound INTRODUCTION TO MULTIMEDIA SYSTEMS Lect. No 3: AUDIO TECHNOLOGY.
Georgia Institute of Technology Introduction to Processing Digital Sounds part 1 Barb Ericson Georgia Institute of Technology Sept 2005.
The human 11 Lecture 2 chapter 1 the human 1 of 3.
COCHLEAR IMPLANTS Brittany M. Alphonse Biomedical Engineering BME 181.
Microsoft Assistive Technology Products Brought to you by... Jill Hartman.
The human What does this means in terms of human processing? the human 13.
1 Human Computer Interaction Week 2 Users. 2 A Cognitive perspective Cognition: How we gain knowledge These includes: Understanding Remembering Reasoning.
EQ: How do different mediums affect the speed of sound?
By Sarita Jondhale 1 The process of removing the formants is called inverse filtering The remaining signal after the subtraction of the filtered modeled.
HEARING. The Nature of Sound Sound, like light, comes in waves Sound is vibration Features of sound include: –Pitch / Hertz – Loudness / Decibels.
Intro-Sound-part1 Introduction to Processing Digital Sounds part 1 Barb Ericson Georgia Institute of Technology Oct 2009.
Digital Media Dr. Jim Rowan ITEC 2110 Audio. What is audio?
Beath High School - Int 1 Physics1 Intermediate 1 Physics Sound and Music Sound Waves Speed of Sound Using Sound Amplified Sound.
Human Computer Interaction
Copyright © 2008 Pearson Education, Inc. Publishing as Pearson Addison-Wesley Lecturer: Jim Warren Lecture 15 Based on Chapter 13: Speech and Hearing.
Choosing the right recording tools for the job Hazzan Rob Menes May, 2015.
HEARING Do you know how you are able to hear your phone ringing? A baby crying? Leaves rustling? Sound travels through the air in waves. It is caused.
You better be listening… Auditory Senses Sound Waves Amplitude  Height of wave  Determines how loud Wavelength  Determines pitch  Peak to peak High.
Glencoe Introduction to Multimedia Chapter 8 Audio 1 Section 8.1 Audio in Multimedia Audio plays many roles in multimedia. Effective use in multimedia.
The Marvelous Ear. How Do Our Ears Work? Quiz 1. How do humans hear sounds? 2. How does human hearing work? Sketch and label the system. 3. Do you know.
Session 18 The physics of sound and the manipulation of digital sounds.
The Ear and Hearing The Ear How the Ear Works - videos.
The Nature of Sound Sound, like light, comes in waves Sound is vibration Features of sound include: –Pitch –Hertz –Decibels.
Sound and LightSection 1 Properties of Sound 〉 What are the characteristics of sound waves? 〉 Sound waves are caused by vibrations and carry energy through.
Sound and LightSection 1 Section 1: Sound Preview Key Ideas Bellringer Properties of Sound Musical Instruments Hearing and the Ear Ultrasound and Sonar.
The physics of hearing and other odds and ends. The range of human hearing The range of average human hearing is from about 15Hz to about 15,000Hz. Though.
Start with the Holy name of Almighty ALLAH. Human Input Output Channels
Auditory System…What??? It plays an important role in language development and social interactions… Plus…it alerts us to dangerous situations! The auditory.
Earcons, Auditory Icons and spearcons
Chapter 15 Recording and Editing Sound
Auditory System: Sound
Human Computer Interaction Lecture 2 The Human
Human Computer Interaction Lecture 20 Universal Design
Section 1: Sound Preview Key Ideas Bellringer Properties of Sound
INPUT-OUTPUT CHANNELS
Department of Computer Science and Engineering
CEN3722 Human Computer Interaction Advanced Interfaces
Auditory Interfaces map to event in computer sound new mail mail sent
Assist. Lecturer Safeen H. Rasool Collage of SCIENCE IT Dept.
Auditory, Tactical, and Olfactory Displays
Presentation transcript:

Some from Heim Chap 13 Sound The sound files are not included– most should work on windows 7 machines you tube

Learning outcomes Describe the basics of human hearing Explain the difference between visual and auditory interaction Describe the classes and subclasses of sound output and the attributes of each Describe the classes and subclass of sound input and recognition and attributes of each 2

the human 1 3 Hearing Provides information about environment: distances, directions, objects etc. Physical apparatus: outer ear– protects inner and amplifies sound middle ear– transmits sound waves as vibrations to inner ear inner ear– chemical transmitters are released and cause impulses in auditory nerve Sound pitch– sound frequency loudness – amplitude timbre– type or quality

the human 1 4 Hearing (cont) Humans can hear frequencies from 20Hz to 15kHz less accurate distinguishing high frequencies than low. Higher frequencies disappear as you get older Auditory system filters sounds can attend to sounds over background noise. for example, the cocktail party phenomenon. Hearing aids disrupt this filtering

the human 1 5 What if…. You are in a noisy environment Night clubbing Phone call/ text message? Your hearing is below average You are deaf

Sound versus Visual Sound exists in time and over space, vision exists in space and over time. (Gaver, 1989) -Sound is only there when it is playing/made -Vision is there until it is replaced 6

Sound Interaction Computer Output/Generation (Human Input) Non speech Music Audio Icons and Earcons Speech Computer Input/Recognition Speech Non speech Environmental Music 7

Computer Output: Music Can be pre-recorded or generated Movies Games Immersive experiences 8

Generating music Exciting area for artists Everything from pseudo real to completely abstract There are Jazz music generators that only skilled people can differentiate from actual musicians. Serato – dj software ( Auckland company doing fantastic things Several UOA grads there 9

Auditory Icons and Earcons The difference between these two is subtle ‘Natural’ sounds ‘Artificial’ sounds (generated) Windows hardware fail insert remove 10

Auditory Icons and Earcons Redundant Encoding It aids memory by adding additional associations. Can alert without interrupting An alterative communications channel. Positive/Negative Feedback Auditory alarms might be crucial to the safe operation of computer-operated machinery or mission-critical environments Too many alarms Annoying Ignored 11

Using Sound in Interaction Design Learnability of the mapping between the icon and the object represented “Oink” and “bow wow” have high articulatory directness A swishing sound accompanying a paintbrush tool also has high articulatory directness A system beep carries is an abstract representation 12

Innate human understanding Volume Whisper Shout Pitch Baby crying Reassurance Authoritative Rhythm Urgency Mood Length Start, stop, duration 13

Can you remember earcons? How many? How often do you hear them? Can you intuitively tell what these mean? OnSleepOff Mis- recognized Dis- ambiguate 14

Speech Output Eyes free operation Alternative output channel Good for checking your essays Navigation is hard Back tracking, Finding location of particular thing 15

Speech Output Recorded Menu choices for telephone systems Books or other multimedia experiences Generated Good voice synthesisers built in to op systems Windows navigator Can give pronunciation rules Still sound a little artificial 16

Sound Input Speech Environmental Music 17

Speech Recognition Two distinct applications: Transaction Transcription Transaction Telephone menu systems Choose from a limited number of options, works ok Automatic speech recognition (ASR) Built into operating systems Siri (iPhone) and Android are ~~ usable This is a triumph of Artificial Intelligence Very difficult, ongoing research problem 18

Searching Speech and Audio Sound files do not afford easy opportunities for indexing and searching Speech translation can be used to transcribe speech files and create transcripts that can be searched like any other text file So long as recognition accuracy is ok, which it isn't at the moment Tune identification apps hum a bit of the tune and it tells you what it is! Easier than translation 19

Summary Describe the basics of human hearing Explain the difference between visual and auditory interaction Sound is transitory Describe the classes and subclasses of sound output and the attributes of each Non speech Music Earcons Speech Describe the classes and subclass of sound input and recognition and attributes of each Speech Transaction Transcription Sound is more complex than colour/light 20