MUSICAL ACOUSTICS PITCH AND TIMBRE Science of Sound Chapter 7

PITCH “THAT ATTRIBUTE OF AUDITORY SENSATION IN TERMS OF WHICH SOUNDS MAY BE ORDERED ON A SCALE EXTENDING FROM LOW TO HIGH.” (ANSI) THE BASIC UNIT IN MOST MUSICAL SCALES IS THE OCTAVE. IN MUSIC THE OCTAVE IS DIVIDED IN DIFFERENT WAYS. (IN WESTERN MUSIC IT IS GENERALLY DIVIDED INTO 12 SEMITONES) PYTHAGORAS DISCOVERS THE OCTAVE (ca. 600 B.C.)

PSYCHOACOUSTICAL PITCH SCALES IF A LISTENER HEARS A 4000 – Hz TONE FOLLOWED BY ONE OF LOW FREQUENCY, A TONE OF ABOUT 1000 Hz WOULD LIKELY BE SELECTED AS HAVING A PITCH “HALF WAY BETWEEN.”

FREQUENCY DISCRIMINATION DIFFERENCE LIMEN OR JUST NOTICEABLE DIFFERENCE (JND) JND DEPENDS ON FREQUENCY, SOUND LEVEL, and DURATION

PITCH OF PURE TONES PITCH DEPENDENCE ON SOUND LEVEL After Terhardt 1979 12 Dependence of pitch on intensity Tr 27,28

HOW DOES PITCH DEPEND ON SIGNAL ENVELOPE?

EFFECT OF INTERFERING SOUNDS AUDITORY DEMO:) 1000 – Hz TONE + NOISE OF LOWER FREQ. 14 Influence of masking noise on pitch, Track 30

OCTAVE MATCHING A 500-HZ TONE ALTERNATES WITH A COMPARISON TONE OF INCREASING FREQUENCY. WHICH PAIR SOUNDS LIKE A “CORRECT” OCTAVE? 15 Octave matching, Track 31

OCTAVE MATCHING A 500-HZ TONE ALTERNATES WITH A COMPARISON TONE OF INCREASING FREQUENCY. WHICH PAIR SOUNDS LIKE A “CORRECT” OCTAVE? THE FREQUENCIES WERE 985, 990, 995, 1000, 1005, 1010, 1015, 1020, 1025, 1030, 1035

OCTAVE MATCHING - TWO DIFFERENT OCTAVES?

DEMONSTRATION: WHICH PRESENTATION SOUNDS MOST IN TUNE? 16 Stretched and compressed scales Track 32

DEMONSTRATION: WHICH PRESENTATION SOUNDS MOST IN TUNE? In München steht ein Hofbräuhaus, eins, zwei gsuffa Da läuft so manches Wasserl aus, eins, zwei gsuffa . . . 16 Stretched and compressed scales, Track 32

DEMONSTRATION: WHICH PRESENTATION SOUNDS MOST IN TUNE? In München steht ein Hofbräuhaus, eins, zwei gsuffa Da läuft so manches Wasserl aus, eins, zwei gsuffa . . FIRST: BASS IN C, MELODY IN B SECOND: BASS IN C, MELODY IN C# THIRD: BASS IN C, MELODY IN C

VIRTUAL PITCH 20, 21 Virtual pitch, Track 37, 38, 39

VIRTUAL PITCH DEMO: MASKING SPECTRAL & VIRTUAL PITCH 22, TRACK 40-42

VIRTUAL PITCH DEMO: VIRTUAL PITCH WITH RANDOM HARMONICS 22 DEMO: VIRTUAL PITCH WITH RANDOM HARMONICS HARMONICS BETWEEN 2 AND 6 HARMONICS BETWEEN 5 AND 9 3) HARMONICS BETWEEN 8 AND 12 23 TRACK 43-45

STRIKE NOTE OF A CHIME IN ORCHESTRA CHIMES (TUBULAR BELLS) THE STRIKE NOTE LIES BETWEEN THE 2ND AND 3RD PARTIALS. THE PITCH IS USUALLY IDENTIFIED AS THE MISSING FUNDAMENTAL OF THE 4TH, 5TH, AND 6TH PARTIALS, WHICH HAVE FREQUENCIES NEARLY IN THE RATIO 2:3:4. A FEW LISTENERS IDENTIFY THE CHIME STRIKE NOTE AS COINCIDING WITH THE 4TH PARTIAL (AN OCTAVE HIGHER). In which octave do you hear it? 24 Strike note of a chime, Track 46, 47

ANALYTIC vs SYNTHETIC PITCH IS THE PITCH OF THE SECOND TONE HIGHER OR LOWER THAN THE FIRST TONE? 25 Analytic vs Synthetic Pitch, Track48

ANALYTIC vs SYNTHETIC PITCH IS THE PITCH OF THE SECOND TONE HIGHER OR LOWER THAN THE FIRST TONE? 800, 1000 Hz  750, 1000 Hz Synthetic: 200  250 Hz Analytic 800  750 Hz (disregard steady 1000 Hz tone) 25 Analytic vs Synthetic Pitch, Track48

SEEBECK’S SIREN IS PITCH DETERMINED BY THE FREQUENCY OR THE PERIOD?

THEORIES OF PITCH PLACE THEORY: VIBRATIONS OF DIFFERENT FREQUENCIES EXCITE RESONANT AREAS ON THE BASILAR MEMBRANE. PERIODICITY THEORY: THE EAR PERFORMS A TIME ANALYSIS OF THE SOUND. CLUES FROM BOTH FREQUENCY AND TIME ANALYSES ARE USED TO DETERMINE PITCH LOW FREQUENCY: TIME ANALYSIS IS MORE IMPORTANT HIGH FREQUENCY: FREQUENCY ANALYSIS IS MORE IMPORTANT MODERN THEORIES: OPTIMUM PROCESSOR THEORY VIRTUAL PITCH THEORY PATTERN TRANSFORMATION THEORY

REPETITION PITCH 26 Scale with repetition pitch, Track 49-51

ANALYTIC vs SYNTHETIC PITCH 25 IS THE PITCH OF THE SECOND TONE HIGHER OR LOWER THAN THE FIRST TONE?

CIRCULARITY IN PITCH JUDGMENT “SHEPARD’S ILLUSION” 27 Circularity in pitch judgment, Track 57

CIRCULARITY IN PITCH JUDGMENT “SHEPARD’S ILLUSION” 27 Circularity in pitch judgment, Track 52

ABSOLUTE PITCH ABILITY TO RECOGNIZE AND DEFINE THE PITCH OF A TONE WITHOUT A REFERENCE TONE A RARE TRAIT MORE COMMON AMONG SPEAKERS OF “TONE LANGUAGES” (SUCH AS CHINESE) REFERENCE MAY CHANGE WITH TIME IN SOME PERSONS

PITCH STANDARDS •EARLY ORGANS HAD A’s TUNED FROM 374 TO 567 Hz •HANDEL’S TUNING FORK VIBRATED AT 422.5 Hz •1859: A 435 Hz ADOPTED BY FRENCH GOVERNMENT •C 256 (POWERS OF TWO) WHICH RESULTS IN A 431 Hz •1939: A 440 Hz INTERNATIONAL STANDARD ADOPTED

WHAT IS TIMBRE? THE AMERICAN NATIONAL STANDARDS INSTITUTE (ANSI) DEFINES IT “TIMBRE IS THAT ATTRIBUTE OF AUDITORY SENSATION IN TERMS OF WHICH A LISTENER CAN JUDGE TWO SOUNDS SIMILARLY PRESENTED AND HAVING THE SAME LOUDNESS AND PITCH AS DISSIMILAR.”

TIMBRE PERCEPTION IT IS LIKELY THAT THE TOTAL NUMBER OF DIMENSIONS REQUIRED TO CHARACTERIZE TIMBRE MIGHT APPROACH THE NUMBER OF CRITICAL BANDS (ABOUT 37). FOR MOST SOUNDS, HOWEVER, FEWER DIMENSIONS WOULD SUFFICE. SCHOUTEN (1968) SUGGESTED THAT TIMBRE RECOGNITION MAY DEPEND ON FACTORS SUCH AS: WHETHER THE SOUND IS PERIODIC WHETHER THE WAVEFORM ENVELOPE IS CONSTANT OR FLUCTUATES WHETHER ANY ASPECT OF SOUND (e.g. SPECTRUM) IS CHANGING WHAT THE PRECEDING AND FOLLOWING SOUNDS ARE LIKE. PATTERSON (1995) FOUND THAT RAMPED AND DAMPED SOUNDS HAD DIFFERENT TIMBRES, POINTING OUT THE IMPORTANT ROLE OF TEMPORAL ENVELOPE IN TIMBRE PERCEPTION.

A MULTIDIMENSIONAL ATTRIBUTE OF SOUND TIMBRE CAN BE DESCRIBED AS A MULTIDIMENSIONAL ATTRIBUTE OF SOUND. IT IS IMPOSSIBLE TO CONSTRUCT A SINGLE SUBJECTIVE SCALE OF TIMBRE OF THE TYPE USED FOR LOUDNESS (SONES) AND PITCH (MELS, FOR EXAMPLE. PRATT AND DOAK (1976)

A HYBRID MODEL OF TIMBRE A HYBRID MODEL OF TIMBRE, WHICH INTEGRATES THE CONCEPTS OF COLOR AND TEXTURE OF SOUND, HAS BEEN DEVELOPED AT CCRMA BY HIROKO TERASAWA AND JONATHAN BERGER (see JASA 124, 2448 (2008)). THE “COLOR” OF SOUND IS DESCRIBED IN TERMS OF AN INSTANTANEOUS SPECTRAL ENVELOPE, WHILE THE “TEXTURE” OF A SOUND DESCRIBES THE TEMPORAL NATURE OF THE SOUND AS THE SEQUENTIAL CHANGES IN COLOR WITH AN ARBITRARY TIME SCALE.

SPECTRAL (FOURIER) ANALYSIS

EFFECT OF SPECTRUM ON TIMBRE DEMONSTRATION: TONES OF TWO MUSICAL INSTRUMENTS ARE PRESENTED BEGINNING WITH THE FUNDAMENTAL AND ADDING PARTIALS ONE AT A TIME. RAISE YOUR HAND WHEN YOU RECOGNIZE THE INSTRUMENT AND NOTE THE NUMBER OF PARTIALS REQUIRED FOR YOUR IDENTIFICATION. 28 Effect of spectrum on timbre, Track 53

CHANGE IN TIMBRE WITH TRANSPOSITION HIGH AND LOW TONES FROM A MUSICAL INSTRUMENT NORMALLY DO NOT HAVE THE SAME RELATIVE SPECTRUM. DEMONSTRATION: A 3-OCTAVE SCALE IS PLAYED ON A BASSOON, FOLLOWED BY A 3-OCTAVE SCALE SYNTHESIZED BY TEMPORAL STRETCHING OF THE HIGHEST NOTE TO OBTAIN THE DESIRED PITCHES. EXCEPT FOR THE HIGHEST NOTE, THE TONES DO NOT SOUND AS PLAYED ON THE BASSOON. 30 Change in timbre with transposition, Track 57

EFFECT OF TONE ENVELOPE ON TIMBRE EFFECT OF ATTACK AND DECAY

TIMBRE DURING ATTACK OF A NOTE WAVEFORM OF ATTACK TRANSIENT SPECTRUM OF FIRST 5 PARTIALS (KEELER, 1972)

EFFECT OF ENVELOPE ON TIMBRE PIANO NOTES PLAYED FORWARD AND BACKWARD 29 Effect of tone envelope on timbre, Tracks 54-56

EFFECT OF ENVELOPE ON TIMBRE PIANO NOTES PLAYED FORWARD AND BACKWARD THE SPECTRUM IS THE SAME; THE TIMBRE IS NOT

TONES AND TUNING WITH STRETCHED PARTIALS DEMONSTRATION: FIRST A SYNTHESIZED 4-PART BACH CHORALE IS PLAYED THEN THE SAME CHORALE IS PLAYED WITH BOTH THE MELODIC AND HARMONIC SCALES STRETCHED LOGARITHMICALLY IN SUCH A WAY THAT THE OCTAVE RATIO IS 2.1 TO 1 NOW THE SAME PIECE WITH ONLY THE MELODIC SCALE STRETCHED FINALLY THE SAME PIECE WITH ONLY THE PARTIALS OF EACH VOICE STRETCHED 31 Tones and tuning with stretched partials, Track 43-45

TRISTIMULUS DIAGRAMS TIMBRE CAN BE REPRESENTED ON A TRISTIMULUS DIAGRAM SIMILAR TO THAT USED RO REPRESENT COLOR. THREE DIMENTIONS x, y, and z ARE SELECTED, SUCH THAT x + y = z.

VIBRATO VIBRATO IS DEFINED BY THE NATIONAL STANDARDS INSTITUTE AS “A FAMILY OF TONAL EFFECTS IN MUSIC THAT DEPEND ON PERIODIC VARIATIONS OF ONE OR MORE CHARACTERISTICS IN THE SOUND WAVE.” FREQUENCY VIBRATO, AMPLITUDE VIBRATO, AND PHASE VI BRATO ARE WIDELY USED IN MUSICAL PERFORMANCE. IN PRACTICE, IT IS UNUSUAL TO HAVE FREQUENCY VIBRATO (FM) WITHOUT AMPLITUDE VIBRATO (AM). THE RATE AND DEPTH OF VIBRATO ARE IMPORTANT CONTRIBUTORS TO TIMBRE. PERFORMERS TYPICALLY SELECT A VIBRATO RATE OF ABOUT 7 Hz.

BLEND OF COMPLEX TONES OUR AUDITORY SYSTEM HAS THE ABILITY TO LISTEN TO COMPLEX SOUNDS IN DIFFERENT MODES. WHEN WE LISTEN ANALYTICALLY, WE HEAR THE DIFFERENT PARTIALS SEPARATELY. WHEN WE LISTEN SYNTHETICALLY (OR HOLISTICALLY), WE FOCUS ON THE WHOLE SOUND AND PLAY LESS ATTENTION TO THE INDIVIDUAL PARTIALS. A TONE WITH SEVERAL HARMONIC PARTIALS, WHOSE FREQUENCIES AND RELATIVE AMPLITUDES REMAIN STEADY, IS GENERALLY HEARD AS A SINGLE COMPLEX TONE EVEN IF THE TOTAL INTENSITY CHANGES. HOWEVER, WHEN ONE OF THE PARTIALS IS TURNED ON AND OFF, IT STANDS OUT CLEARLY . THE SAME IS TRUE IF ONE OF ITS HARMONICS IS GIVEN A VIBRATO (i.e., ITS AMPLITUDE, FREQUENCY, OR PHASE IS MODULATED AT A SLOW RATE).

TONE OR CHORD? ERICKSON (1975) POINTS OUT THAT A COMPLEX SOUND CAN BE HEARD AS A CHORD; A SINGLE TONE (WITH TIMBRE); OR AS AN UNPITCHED SOUND. TRANSFORMATION FROM A CHORD TO A SOUND, FOR EXAMPLE, IS ILLUSTRATED BY THE MUSIC OF EDGAR VARESE.

EFFECT OF ECHOES IN MOST ROOMS, REFLECTIONS OCCUR FROM THE WALLS, CEILING, AND FLOOR. THESE ARE NOT “HEARD” AS ECHOES UNLESS THE ROOM IS LARGE. BY RECORDING THE SOUND AND PLAYING THE RECORDING BACKWARDS, HOWEVER, THESE REFLECTIONS BECOME APPARENT AND HAVE A LARGE EFFECT ON THE TIMBRE. THIS IS DONE: 1) IN AN ANECHOIC ROOM; 2) IN A CONFERENCE ROOM; AND 3) IN A VERY REVERBERANT ROOM. 35 Effect of echoes Track 70