Presentation is loading. Please wait.

Presentation is loading. Please wait.

WP4 – Sound Object Identification WP5 – Enriched Access Tools.

Similar presentations


Presentation on theme: "WP4 – Sound Object Identification WP5 – Enriched Access Tools."— Presentation transcript:

1 WP4 – Sound Object Identification WP5 – Enriched Access Tools

2 18 Month Biannual Technical Meeting Workpackage 5 - Tasks WP5 PartnerRole DIT (Lead)- Pitch / timescale modification, - Source Separation**, - EQ, - Noise Reduction. QMUL- Looping and marking, - Video TSM, NICE- Speech enhancement tools, - subjective quality tools Total 80 PM** developed in WP4 but ultimately an access tool also.

3 18 Month Biannual Technical Meeting Deliverables and Milestones Month 1 5 10 15 20 25 30 T5.3 Multimedia Alignment Video + Audio TSM 90% Complete T5.1 Looping and Marking D5.1 M9 100% Complete T5.2 Time and Pitch Scale Modification D5.2 M27 90% Complete D1D2D3 T5.4 Sound Enhancement & NR D5.3 M30 60% Complete 1 5 10 15 20 25 30 M5.2 Initial prototype integrated with interfaces (Month 18) You Are Here i i i x T4.2 Sound Source Separation D4.2 M14 90% Complete x i = integrated

4 18 Month Biannual Technical Meeting Real-time engine integration Load Frame Interpolate Window + FFT Is Transient ? Update Phases IFFT + window 75% RT Overlap ++ SynHop x TSM++ SynHop x 4 75% RT Overlap IFFT + window Yes Real-time Access Tools Source Separation Equalisation Noise Reduction PSM & TSM factor Real-time Engine EASAIER HOST APP. Audio UI control Clock Feedback i

5 18 Month Biannual Technical Meeting Workpackage Progress  TSM/PSM – successfully integrated and operational  Video synchronised TSM integrated and operational i TSM VTSM

6 18 Month Biannual Technical Meeting Further Modification  Link option for time and pitch scaling  Pitch change via transposition (requires Key sig estimate)  Time change via tempo change (requires tempo estimate)

7 18 Month Biannual Technical Meeting Workpackage Progress Sound Source Separation  Source separation tool is fully developed and ready for integration Problem: DIT IP regulations will not allow code to be open source Solution: DLL for windows release and shared library for Linux release

8 18 Month Biannual Technical Meeting Workpackage Progress Equalisation / Enhancement  Equalisation tool is fully developed and ready for integration The equalisation tool can be used to filter out tones and hums which are often present in archival formats such as magnetic tape. Alternately, the tool can be simply used to tailor the sound to a listeners taste and playback system

9 18 Month Biannual Technical Meeting Workpackage Progress Equalisation / Enhancement Simple mode interaction uses 5 controls to increase or decrease the level of 5 fixed bands Advanced mode allows user to view the spectrum and draw the desired curve onto spectrum Demo to follow Integration – Mid December 07’

10 18 Month Biannual Technical Meeting Upcoming Work Plan Months 19-30 Integrate EQ module Integrate Source Separation Work is ongoing w.r.t. “intelligent noise reduction” algorithms Evaluation / Benchmarking / User testing. Journal Publication planned for VTSM

11 18 Month Biannual Technical Meeting Demonstrations 1. Integrated pitch and timescale modification 2. Integrated video/audio time and pitch scale modification 3. Prototype restoration EQ and simple EQ

12 18 Month Biannual Technical Meeting Questions ? Discussion


Download ppt "WP4 – Sound Object Identification WP5 – Enriched Access Tools."

Similar presentations


Ads by Google