Back to Articles

StreetReaderAI: Making Maps Accessible with Artificial Intelligence

November 18, 2026668

StreetReaderAI: Making maps accessible to everyone using AI

Interactive mapping tools like Google Street View have become an integral part of how we plan routes or explore new places. However, for blind or visually impaired people, these tools have remained largely inaccessible, as they rely on a purely visual interface. Google, in collaboration with accessibility researchers, is trying to change this with the launch of StreetReaderAI – an open-source project that is a game changer.

What exactly is StreetReaderAI?

StreetReaderAI is a prototype of an accessible mapping tool that combines multimodal AI with adapted navigation interfaces. The goal is to allow users to explore urban environments virtually, understand the space around them, and plan routes independently, without needing vision.

The tool was built through a co-design process with blind individuals, which led to an experience that feels more like a voice-guided computer game than a traditional map browser. The system allows users to "walk" through virtual streets, receive voice descriptions of the environment, and ask follow-up questions about what appears in the image [1, 2, 8].

How does it work in practice?

The core of the system is based on Google's Gemini model and consists of two main components:

  • •AI Describer: Provides a real-time voice description of the environment. The system analyzes the current image combined with geographic data and provides information about intersections, buildings, and points of interest. You can choose between a "navigation and safety" mode and a "tour guide" mode that provides historical or architectural context [1, 7].
  • •AI Chat: Allows the user to conduct a free-flowing conversation about the location. Thanks to the system's memory, the user can ask questions like "Where was the bus stop I passed just a moment ago?" and the system will be able to answer based on the previous location and geographic context [1, 4].

The navigation itself is performed using a keyboard or voice commands, which allow the user to pan, move forward in virtual steps, or even "jump" to more distant intersections [1, 4].

Why is this important?

Studies conducted with blind users showed that the primary need is not just to "see" the place, but to understand the space: Where is the crosswalk? Are there obstacles on the sidewalk? What is the exact distance to the bus stop? StreetReaderAI provides answers to these questions and enables "last-mile" route planning in a much safer and more accessible way [1, 4, 8].

It is important to emphasize: This is not a navigation system for walking in the field. It is an assistive tool for planning, research, and virtual exploration. The system does not replace physical navigation tools, but rather gives the user the ability to get to know the destination before they leave the house [1, 3].

Availability and development

Google has released the code for StreetReaderAI under the Apache 2.0 license, which allows developers and researchers to run the application locally or integrate it into AI Studio [3]. This is a significant step that opens the door for the developer community to continue and improve the accessibility of global mapping tools.

For more information and access to the project code, you can visit the official GitHub page of the project [3] or read the full paper published by the research team [1, 8].

Summary

StreetReaderAI is an excellent example of how artificial intelligence can bridge social and technological gaps. By turning complex visual information into accessible and interactive voice information, Google is not only improving the user experience, but granting greater independence to people with visual impairments. This is a tool worth following, especially for those involved in developing accessibility and AI-based technologies.

Relevant links:

Thanks to Spotlight by Daniel Trabelsi by Daniel Trabelsi for sharing and inspiring this article.

Join the channel
#AI#accessibility#StreetReaderAI#navigation for the blind#Google#assistive technology#maps#audio description