This new technology lets blind people 'see' on a scenic car ride

The Marriott Hotel building is photographed through a blind at a restaurant in the centre of Warsaw January 8, 2013. The effect was achieved through zooming action on the lens. REUTERS/Peter Andrews (POLAND - Tags: CITYSCAPE TPX IMAGES OF THE DAY)
Ford's 'Feel the View' prototype allows blind passengers to feel the landscape through vibrations.Image: REUTERS/Peter Andrews

Ford has developed a prototype smart car window that lets blind people “see” the passing landscape.

The “Feel the View” prototype, which was developed with Italian startup xyz, uses vibrations to give blind and visually impaired passengers a sense of the scenery outside.

The smart window takes pictures using an external camera and turns them into high-contrast grayscale images. These images are reproduced on the glass using special LEDs. When a passenger touches the image, different shades of gray vibrate with a range of 255 intensities. The idea is that blind or visually impaired passengers can touch the scene and use the varying intensities of vibration to create in their mind what the landscape looks like.

Ford’s team in Italy worked with agency GTB Roma and Aedo, a local start-up that specializes in devices for the visually impaired.

Image: Ford

The smart window also has an AI voice assistant that taps into the car’s audio system and put what the passengers are feeling into context. For instance, it might tell the passenger “snowy mountain,” as depicted in the video, or “lake.”

The prototype is part of Ford’s advanced research, which means there are no plans (at least not publicly) to bring this to market.

This is the kind of technology that could show up in Ford’s autonomous vehicle program. The company has been testing its technology and its future business model through pilot programs with Dominos and Postmates. The company has been using research vehicles to learn the logistical challenges of delivery by a driverless vehicle. One of those challenges is how an autonomous vehicle will interact with passengers and give them the information they need as they travel from Point A to Point B.

License and Republishing
World Economic Forum articles may be republished in accordance with the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International Public License, and in accordance with our Terms of Use. The views expressed in this article are those of the author alone and not the World Economic Forum.