This App is based on the concept that people with visual impairment can ‘see color by sound’. By touching the picture screen with your finger, you can recognize the shape, the shade, the color of what is being photographed, in this order, by voice and sound.
When you want to know the sight in front of you, take a picture. In addition, you can select a picture from your album and use it.
2018.10.23 Masao MIYAKE
How to use
1. Selecting a picture
Use the camera button to take a picture, or the album button to select a picture.
2. Line Drawing
The type of line is two kinds of bold line and thin line.
Touch the screen, if the touch point is a bold line, it responds with ‘Bold line’ by voice and ‘Don’ by sound. In the case of a thin line, it responds with ‘Thin line’ by voice and ‘Pan’ by sound. There is no sound where there is no line. If you trace slowly, it will be only sound.
When touching the screen, long press it, it tells the plane information of a certain size. That is, it responds by voice with `a lot of lines’ or `some lines’ or `no line’ in a square area around your finger (one side is about 1.5 cm).
On this screen, you can recognize the shape. Tap the ‘Next’ button on the bottom left to display Grayscale Image.
3. Grayscale Image
The five types of shading color are White, Light gray, Gray, Dark gray, Black.
Touch the screen, the sounds of percussion instruments respond with White ‘Kon’, Light gray ‘Ton’, Gray ‘Pashi’, Dark gray ‘Bashi’, Black ‘Don’. In this way it responds the type of shading with voice and sound. If you trace slowly, it will be only sound.
When touching the screen, long press it, it tells the plane information of a certain size. It responds to the shading contained in a square area around your finger (one side is about 1.5 cm) and its proportion. The ratio is calculated as 10 as a whole, but the total may not be 10 in some cases because of rounding off etc..
On this screen, you can recognize the change in brightness and darkness of the picture. Tap the ‘Next’ button on the bottom left to get Color Picture.
4. Color Picture
10 kinds of color types in chromatic color are Red, Yellow red, Yellow, Yellow green, Green, Blue green, Blue, Purple, and Brown, and Beige. Achromatic color is 3 types of White, Gray, Black.
Touch the screen, it responds with color name by voice and sound. If you trace slowly it will only sound. Correspondence between color names and sounds is as follows.
With the sound scale of the organ, ‘C’ is Red, ‘D’ is Yellow red, ‘E’ is Yellow, ‘F’ is Yellow green, ‘G’ is Green, ‘A’ is Blue green, ‘B’ is Blue, the high sound ‘C’ is Purple.
In other words it expresses sounds of one octave.
Brown is piano low sound ‘C’, Beige is piano low sound ‘B’.
With the sound of the percussion instruments, White is ‘Kon’, Gray is ‘Pashi’, Black is ‘Don’.
Besides Brown, Beige, White, Gray and Black, there is a distinction between light color and dark color. Then light color is with sound ‘Ton’ and dark color is with sound ‘Bashi’.
| Chromatic Color | Sound | Light・Dark Ton・Bashi |
| Red | C（Organ） | add |
| Yellow red | D（Organ） | add |
| Yellow | E（Organ） | add |
| Yellow green | F（Organ） | add |
| Green | G（Organ） | add |
| Blue green | A（Organ） | add |
| Blue | B（Organ） | add |
| Purple | C（Organ high sound） | add |
| Brown | C（Piano low sound) | |
| Beige | B（Piano low sound |
| Achromatic Color | Sound |
| White | Kon（Percussion) |
| Gray | Pashi（Percussion |
| Black | Don（Percussion） |
When touching the screen, long press it, it tells the plane information of a certain size. It responds to the color names contained in a square area around your finger (one side is about 1.5 cm) and its proportion. There is no distinction between light and dark. The ratio is calculated as 10 as a whole, but the total may not be 10 in some cases because of rounding off etc..
Tap the ‘Next’ button in the bottom left to return to Line Drawing.
5. Key Points
key1.
Recognize the shape of what is shown in Line Drawing, and identify the light and dark areas in Grayscale Image. Then, by feeling color change and same color area in Color Picture, the thing is recognized by stepwise. However, complex images such as natural landscapes can have many lines, so in Line Drawing it is difficult to understand the shape.
key2.
Learn the relationship between voice and sound with touch, and by tracing slowly, you will feel the change in color due to the change in sound. If the same sound continues, it will be the same color area. If you do not understand the color, also touch and listen to the voice.
key3.
Voice and sounds will come out as much as you touch, so it may not correspond to the part you are looking at. Please slowly examine the pictures.
key4.
You can enjoy more photos by trying this App while asking someone with visual explanation.
6. Goal of the future App
It is the goal of this App that people without vision feel color. We will upgrade the App version based on opinions of people actually used. Please tap the ‘Contact’ button on the explanation screen and send me your opinions and impressions.
(This site ‘Contact’ page plays the same. )