視覚障害者のための指差し文字検出システムの開発 [in Japanese] Development of a Fingertip Character Extraction System for the Visually Handicapped [in Japanese]
Access this Article
This paper proposes a system to assist the visually handicapped by extracting text characters on the surface of an object. The visually handicapped user cannot know exactly what the object is and cannot read the text written on the surface. The user touches a point on the surface with his or her index finger; the system extracts characters around the fingertip. To implement these functions, we propose fingertip detection and character extraction methodologies. For fingertip detection, the user wears a ring, in which three acrylic infrared-reflective beads are embedded, on the index finger. The system detects the beads and locates their positions from an infrared image, then, calculates the fingertip position based on bead arrangement. For character extraction, a region is generated according to the position of the fingertip. The characters are extracted from the region based on color histogram and shape. Then, the extracted characters are combined as text. Finally, the text is recognized by commercially available OCR software and is read aloud to the user by reading software. We have experimentally verified that these methodologies achieved character extraction accuracy of at least 70.0% expect the case of narrow character extraction. The experiments demonstrated the basic validity of our proposed method.
- Journal of the Japan Society for Precision Engineering
Journal of the Japan Society for Precision Engineering 82(12), 1109-1118, 2016
The Japan Society for Precision Engineering