Textual Information Access for the Visually Impaired Ramani Duraiswami.

Slides:



Advertisements
Similar presentations
COMPUTERS: TOOLS FOR AN INFORMATION AGE Chapter 5 Input and Output.
Advertisements

Input Jeopardy The Keyboard Pointing Devices Pictures and Sounds Scanners and Readers Grab Bag $100100$100100$100100$100100$ $200200$200200$200200$200200$
Interacting with the Computer lesson 2 essential concepts.
A Digital Imaging Primer Nick Dvoracek Instructional Resources Center University of Wisconsin Oshkosh.
Equipment in the Library There are no readings for this lecture. Remember to do the assessment in iCollege.
Braille keyboard/printer (H) Braille keyboard/printer (H) PAC mates (S) PAC mates (S) Voice recognition devices (S) Voice recognition devices (S) Magnifiers.
Chapter 5 Input and Output. What Is Input? What is input? p. 166 Fig. 5-1 Next  Input device is any hardware component used to enter data or instructions.
Input & Output Devices ASHIMA KALRA.
Input to the Computer * Input * Keyboard * Pointing Devices
IRead Team Members: Matt Cardin, Paul Kennedy, Oscar Perez.
Muhammad Tehseen Qureshi.  What is input?  Input device is any hardware component that allows users to enter data and instructions  Data or instructions.
- Talkback with Dark screen Rapid key input and Speak PW - Font Size - Negative Colors - Magnification gestures - Notification reminder - Colour adjustment.
Chapter 5 Input. What Is Input? What are the input devices? Input device is any hardware component used to enter data or instructions Data or instructions.
IT Introduction to Information Technology CHAPTER 05 - INPUT.
GCSE Information Technology Computer Systems. GCSE Information Technology The three stages of computing are input, processing and output. A computer works.
4/14: Scanners Roll Call Response to request Lecture: scanners –general –flatbed –sheet-fed –hand-held –OCR Image courtesy of Microtek
2 pt 3 pt 4 pt 5pt 1 pt 2 pt 3 pt 4 pt 5 pt 1 pt 2pt 3 pt 4pt 5 pt 1pt 2pt 3 pt 4 pt 5 pt 1 pt 2 pt 3 pt 4pt 5 pt 1pt Terms 2 Terms 3 Terms 4 Terms 5 Terms.
 Optical Scanners Optical Scanners  Scanners Scanners  Electronic Tablet/Pen Electronic Tablet/Pen  Digital Camera Digital Camera  Webcam Webcam.
Peripherals Devices Submitted By-Ashish Kataria UPS Bhankla Rampur (Block) Saharanpur(u.p ) Sarva Siksha Abhiyan.
Peripherals The term peripherals refers to all hardware devices that are attached to your computer and are controlled by your computer system Peripherals.
AS Module 2 Information; Management and Management and Manipulation or what to do with data, how to do it, and……... ensure it provides useful information.
CSCI-235 Micro-Computers in Science Hardware Part II.
Unit 3- Input, Output, & Peripherals.  Identify & describe input devices  Identify & describe output devices  Connect input & output devices to a computer.
2 pt 3 pt 4 pt 5pt 1 pt 2 pt 3 pt 4 pt 5 pt 1 pt 2pt 3 pt 4pt 5 pt 1pt 2pt 3 pt 4 pt 5 pt 1 pt 2 pt 3 pt 4pt 5 pt 1pt Terms 2 Terms 3 Terms 4 Terms 5 Terms.
Technology for Students with Visual Impairments Chapter Eight.
By: Hadley Scholtz Supervisor: Mehrdad Ghaziasgar Co – supervisor: James Connan Assisted by: Ibraheem Frieslaar.
Fill in the blanks: The _____________ utility in Windows’ Accessories is used for running audio CD. For recording sound, there must be _________ in the.
DATA COLLECTION METHODS CONTENT PAGE How data is collected via questionnaires. How data is collected via questionnaires. How data is collected with mark.
Assistive Technologies for Vision Impairments and Reading.
Copyright © Allyn & Bacon 2008 POWER PRACTICE Chapter 4 Digital Technologies in the Classroom START This multimedia product and its contents are protected.
COMPUTER PARTS AND COMPONENTS INPUT DEVICES
 Data or instructions entered into memory of computer  Input device is any hardware component used to enter data or instructions 2.
Gili Werner. Motivation Detecting text in a natural scene is an important part of many Computer Vision tasks.
B-READER (Giving vision to the blind) Team Leads: Rahul Srivastava, Siddharth Parashar Pranav Chaturvedi Mansi Khare.
Intro to Scanners. A scanner works by creating a digital image. When you scan a document, you are making a picture of it. This digital image can be used.
Chapter 14 Working with Graphics. 2Practical PC 5 th Edition Chapter 14 Getting Started In this Chapter, you will learn: − About different graphics you.
Multimedia in Education We are going to Learn – Role of Multimedia in Education.
Audio Visual Vocab 9 Decibel, LCD, Lens, Pixel, Megapixel,
CSCI-100 Introduction to Computing Hardware Part II.
ASSISTIVE TECHNOLOGY WHAT EDUCATORS NEED TO KNOW 1.
Specialized Input Devices
Computers Storage and Input/Output Devices Input and Output Devices Input device – converts our commands and data into a form a computer can understand.
Scanners. Using a Scanner Scanners are used to digitize any flat object. Several types of scanners- flatbed, sheet fed, handheld, film. Most common is.
Collecting.  What are some Tools for Information Processes?  Collecting is the information process that involves deciding what to collect, locating.
ASSISTIVE TECHNOLOGY AMBER POIRIER UNIVERSITY OF WEST ALABAMA ED 505.
Computer Skills Dr. Omar Al Jadaan RAK-MHSU College of Medical Sciences
Section 2B. Objectives List two reasons why some people prefer alternative methods of input over a standard keyboard or mouse. List three categories of.
HOW SCANNERS WORK A scanner is a device that uses a light source to electronically convert an image into binary data (0s and 1s). This binary data can.
By: Hossein and Hadi Shayesteh Supervisor: Mr. James Connan.
Name Enrolment no.: Dhruti Desai Khushboo Desai Sneha Gangwani Rajul Shah
INPUT DEVICES. Keyboard & Mouse  Keyboard: Enter text and commands  Mouse: Point, Select & enter Commands.
 By: Ann Carey, M.A., CCC-SLP Speech-Language Pathologist Assistive Technology Building Coach.
Portable Camera-Based Assistive Text and Product Label Reading From Hand-Held Objects for Blind Persons.
Chapter 14 Working with Graphics
Input & Output Devices ASHIMA KALRA.
Standard Input Devices
Lesson 4 Alternative Methods Of Input.
PART C – AT for visual impairments
Alternative Methods Of Input
Input and output devices for visually impaired users
Input Devices.
bReader – Blind can read now
Chapter 5 - Input.
Lesson 4 Alternative Methods Of Input.
Computer Fundamentals
Introduction to Computers
Terms 1 Terms 2 Terms 3 Terms 4 Terms 5 1pt 1 pt 1 pt 1pt 1 pt 2 pt
It’s easier than you think
Lesson 4 Alternative Methods Of Input.
Introduction to Computers
Presentation transcript:

Textual Information Access for the Visually Impaired Ramani Duraiswami

Project Approximately 1 million blind and 5 million visually impaired people in the US –Comparable fractions of the population elsewhere Their Goal: Lead an independent productive life –To do this they need to understand a significant amount of textual information from the environment Examples –Signs on streets, supermarkets/groceries, buildings –Labels on medicines, products –Instructions on equipment, computers –Newspapers, magazines Our goal: Provide them with devices to read text –Computer vision, Pattern recognition (OCR), computational audio, and wearable computers to help them.

Restricted initial goal: magazine reader Tool targeted to people with some vision Use optical character recognition (OCR) software –OCR works with flat, high resolution scanned text. Read out the recognized text with text-to-speech (TTS) software Goal: read text with a video camera, OCR software, portable/wearable computer, headphones Problems – Text is on a surface that is mostly planar or curved – Warped by perspective projection to the camera – Camera images are low resolution (640 x 480) – OCR uses scanned images at 600 to 2400 dpi

System Design For good OCR –Characters must be pixels tall –Characters must not be skewed Camera captures initial image of page Using initial images –Estimate font size and page structure –Determine scanning pattern Zoom into pieces of the image –Register each zoomed piece with the big picture –Capture image at optimum focus and zoom To make sure pieces are not too small –Use super-resolution techniques Mosaic pieces together and dewarp

Super-resolution Convert a sequence of many (different) coarsely sampled images into a high resolution image.