Sound Imaging: Clever Acoustics
Help Blind People See the World
Spain -- Video from portable cameras are analysed to calculate the distance of obstacles and predict the movements of people and cars. This information is then transformed and relayed to a blind person as a three-dimensional ‘picture’ of sound.
The concept is apparently simple and two prototypes have been successfully tested. Laser and digital video cameras become the eyes for the blind man and see the objects and activity going on around him.
Researchers from the University of Bristol have developed powerful real-time image processing and some clever algorithms to then identify objects and obstacles, such as trees, street furniture, vehicles and people. The system uses the stereo images to create a “depth map” for calculating distances. The system can also analyse moving objects and predict where they are going.
So much for the image processing, but how do you present this visual information to a blind person? Technology developed at the University of Laguna in Spain makes it possible to transform spatial information into three-dimensional acoustic maps.
A blind person wears headphones and hears how sounds change as they move around. The stereo audio system makes it possible to place sounds so that the brain can interpret them as a point in space. Sounds get louder as you walk towards objects, quieter as you move away. Objects to your right are heard on your right, and if you move your head the sound moves too. And if something is heading right for you, you'll hear it coming, with a tone that tells you to get out of the way.
The full picture
The EU-funded CASBLiP project was conceived to integrate the image processing and acoustic mapping technologies into a single, portable device that could be worn by blind people and help them to navigate outdoors.
The University of Laguna worked to adapt its acoustic mapping system and the University of Bristol refined its image processing algorithms. The device also incorporates a gyroscopic sensor developed by the University of Marche, Italy. This component, called the head-positioning sensor, detects how the wearer moves his head. It feeds back the position of the head and the direction it is facing, so that the relative position of the sounds being played to the wearer also move as expected. For example, if you turn your head towards a sound on the right, the sound must move left towards the centre of the sound picture.
Vision for the future
After three years, the consortium has produced two prototype devices mounted on a helmet. They have been tested successfully in trials by blind people in several real-world environments, including busy streets. Two blind institutions (the German Federation of the Blind and Partially Sighted and the Francesco Cavazza Institute, Italy) were heavily involved in the testing programme.
The first design (M1) uses a laser sensor developed by Siemens and originally intended to detect passengers in cars. It can calculate the distance to objects within 0 to 5m in a 60º field of view. The system is mounted inside glasses and cannot be seen by others because it uses infrared light. The M1 has been extensively tested by blind users who are able to recognise items, such as chairs and trees, from the sound picture they receive.
A second version (M2) adds two digital video cameras to either side of a helmet. It can detect moving objects and predict their path.
The University of Marche has also worked closely with the Cavazza Institute to build a complementary GPS location system. This technology could be used to pinpoint the location of a blind person and integrate the device with additional data sources, such as mapping services. It could provide the wearer with verbal directions to their destination.
“We know that the technology works,” says Guillermo Peris-Fajarnés, who coordinated the project from the Research Group on Graphic Technologies at the Universidad Politecnica de Valencia. “Our tests have been very successful and blind people have been able to navigate comfortably in controlled tests and even along a normal street.”
“There is still a lot of development work to do before this could go on the market, especially to prove that the system is 100% reliable,” Peris-Fajarnés notes. “You can't risk it going wrong while a user is crossing the road.”
He says the consortium has decided to continue work on this aspect beyond the end of the EU funding period.
Nevertheless, Peris-Fajarnés is confident that the device could be commercialised: “We are now looking for manufacturing partners to explore the possibilities for a commercially viable product. There's no other system like this available and it should complement existing aids, such as the white stick. But its commercial success will depend on miniaturising the system and mounting the cameras onto glasses.”
“In my personal opinion, anything that can offer some more autonomy to the blind person is positive,” said one tester.
CASBLiP received funding from the ICT strand of the EU’s Sixth Framework Programme for research.
Sprint’s BlackBerry Was Not Developed for PWD
By John M. Williams
I am pleased to become a consumer of the BlackBerry telephone craze. I had held onto my Sprint cell phone too long. As someone who receives more than a hundred e-mails daily, I watched with envy as people accessed their e-mails on trains, buses, cars, at airports and on streets as they walk. They were in constant contact with their friends, clients, news organizations and family. They could text message or call anyone they wanted at anytime from almost anyplace. Instant communication and productivity are a pressed button in the palm of their hands.
With my former cell phone, I could not twitter and access the Internet. I was not a member of the instant IT world. I am now. With my old phone, I could make calls, receive calls, store more than 100 telephone numbers, respond to voice mail, take pictures and play four games. The numbers and letters on the keyboard were readable and easy to push.
For three weeks, I have had a BlackBerry. It is a gift. Its features such as accepting e-mails, storing voice mails, text messaging, easy storing of telephone numbers, excellent voice quality, an okay camera, Internet access, a map, speaker phone and telephone calling keep me connected around the clock to business associates, family and the news. I like the many features, and in the time I have had it, it has increased my productivity. But?
My gripe with the BlackBerry is with its tortuous, miniscule keyboard. The tiny numbers, letters and other functions are very difficult to read and push. Sometimes, I use a magnifying glass to read the keyboard so I can text someone or add a phone number to my address book or make a first time call. I had to let my finger nails grow on my index fingers so I can use the keyboard. Other times, I have used a lead pencil. It is extremely frustrating to use different tools so I can use the keyboard.
Occasionally, the trackball freezes. This delays opening up services such as e-mails, or going to the web, or making a call and even taking a Kodak moment picture. I get angry when this happens.
In designing the cell phone, the designers did not consider the millions of people with vision problems and dexterity challenges as potential customers. If they had, they would have designed a larger keyboard with voice that pronounced each letter and reads each function on the screen. Some cell phones today have voice recognition capability that eliminates using the keyboard for some functions.
In the future, the BlackBerry must be designed for usage by people with vision limitations and physical disabilities. (The BlackBerry has been designed to use with a hearing aid.) The American Council of the Blind, American Foundation of the Blind, National Federation of the Blind, and aging organizations should be consulted. BlackBerry designers should cultivate every consumer who can use a Blackberry. That’s capitalism!
|
