The news that the blind road design is unreasonable, the blind road is occupied, the bus taxi refuses to carry the guide dog, etc., which affects the blind travel, is often reported in the newspapers. The news from the 17th Institute of China Aerospace Science and Industry Group said that the institute has used the latest development of space technology. A successful “helping blind smart glasses” has the function of navigating for the blind. The target positioning accuracy of the engineering prototype reaches 5 cm, which can solve the problem that plagues the blind.
According to Zhu Jianguo, the person in charge of the “Helping Blind Smart Glasses” project, the 17th Navigation and Optoelectronics Division of the China Aerospace Science and Technology Institute has long been engaged in the research and development of inertial navigation systems and optoelectronic products, with profound technical accumulation. Aerospace inertial navigation and optoelectronic technology to develop blind navigation aid products. "With the gradual maturity of machine vision technology, especially stereoscopic 3D environment-aware technology, it provides a solution for blind people to solve travel problems and realize or replace some physiological vision functions."
How to meet the needs of visual blindness? The “Blind Smart Glasses” project team decided to adopt a binocular stereo vision solution. The scheme is to simulate human eyes, obtain depth information based on the principle of parallax, and has the characteristics of high-precision three-dimensional environment measurement capability, strong environmental adaptability, and low sensor cost.
Through technical breakthroughs, the project team broke through a series of key technologies such as dual CMOS image sensor synchronous drive imaging, FPGA real-time binocular stereo matching, obstacle recognition detection, etc., and successfully developed a prototype of the “Blind Smart Glasses” product to achieve a front scene of 6 meters. 3D measurement within the range, generating 2 million 3D points per second, obstacle positioning accuracy of centimeter level, recognition accuracy of 99%, can effectively provide information about the surrounding environment for the visually impaired.
For the prototype, there are still problems such as large size and heavy weight, and the project team continues to improve and optimize and continuously iterate and upgrade. Finally, the successful “assisted blind smart glasses” engineering prototype is developed. It consists of glasses, controller and belt. The composition basically has the function of navigating for the blind.
Zhu Jianguo said that the "assisted blind intelligent glasses" engineering prototype products can identify and prompt obstacles, potholes, blind roads, two-dimensional code pattern items and other targets, positioning accuracy of 5 cm, wearing component weight 70 grams, battery life more than 4 hours . Han Xinjian, a project team designer, added that the key technologies of “helping blind smart glasses” can be extended to robot navigation, auto autonomous driving, VR/AR (virtual reality/augmented reality) and other fields with broad application prospects.
It is understood that in order to test the effect of “helping blind smart glasses”, the project team also recruited blind volunteers to carry out experience activities. After 30 blind people experience, the smart glasses are very sensitive to the distribution of obstacles and their movement. I hope this glasses product can be mass-produced as soon as possible. In addition, “Blind Smart Glasses” received wide attention during the 3rd International Innovation and Entrepreneurship Expo, and has been selected as the “creative pool” and “seed pool” of China Aerospace Science and Industry Group.