Augmented Reality for Cultural Institutions

Instant Translation AR

Translation is one of the critical tools since we use text daily as our primary communication method. Without written text, the information is not possible to be conveyed(Petter et al, 2016).

Visitors prefer to digest the contents in their own language rather than spend time translating words from the museum labels, wall texts, or signs for basic information. As museums and cultural institutions perceive the diversity of their audiences, many organizations consider translation strategies to reach a broader audience and engage them successfully.

While map and audio guides in multiple languages would be many museums and cultural institutions’ first choice for translation options, real-time mobile AR translation is another approach we can suggest to increase visitor’s experience. It is not only helpful for translating the maps or signs but any text that visitors might encounter during their tour, even for a word in a piece of art.

Latest trends and AR applications that cultural institutions can consider to offer visitors for instant translation :

Google Lens application. Source: Google Lens.

Google Lens application

Google Lens detects any text and translates them in real-time. It also allows visitors to search for items by pointing their phones at them. It will display what they're looking at. Visitors will get basic information as well as valuable suggestions based on their search.

Source: The Fine Arts Museums of San Francisco and Google Arts & Culture and Google Lens..

de Young Museum

In a special collaboration de Young Museum with Google Arts & Culture, visitors can use their smartphone’s camera to discover the artists and hidden stories behind the art paintings(de Young museum).

“This is a way for artists to share their perspective, too.” - Robson,T. 2019

Augmented Reality Ignites Museum Experiences. Source: World Itineraries.,(2020.).

Harvard Semitic Museum, Cambridge, Massachusetts

In Harvard Semitic Museum, visitors are able to access information with a device. Visitors will be provided a pad upon entry. Once they point it at reconstructed stone stellas in their tour, the revealing hieroglyphs carved on the stone will be translated into English. According to World Itineraries (2020), there are also animation effects available for users to experience to feel standing in front of a sphinx in Egypt.

Snap a picture of text to decode in Google Translate. Source: Conner.K. (2019.). .

Google Translate app

Google Translate’s augmented reality feature is a powerful tool that makes users break language barriers by translating any type of text such as signs, words, or sentences instantly. All they need to do is looking at the types through their device's camera lens. With this application, visitors will be able to scan a description of label, sign, text in artwork, or any text form to translate to a language they prefer.With this application, visitors will be able to scan a description of label, sign, text in artwork, or any text form to translate to a language they prefer. This feature can be considered to use not only for visitors as external use but also internal use for staff to translate their documents. Visitors can use this application offline easily, but it does require some preparation. Users can download a Google language pack onto their devices when they are online. This way, they can translate text without an internet connection. Google translate app is an ideal platform for visitors to guide through cultural institutions.


Author: Jiae Oh