After a few research of gem&mineral collections at NMNH and team brainstorming, we came up with 3 initial ideas for creating an AR experience there for the gems.
01
Aesthetics as a trigger to encourage visitors to "try on" the elegant pieces of jewelry.
Discovery: Making the installation attractive by decorating it into an old-fashioned style, incorporating with the years of history when the jewelry was originally possessed.
Engagement: The "mirror" is actually a reflective interactive screen with a set of cameras to detect visitor's action. Visitors interact with the screen by body movements (waving hands, nodding head, stamping foot), and select the diamond or costume displayed on the mirror to "try" them on. By watching their reflections with the elegant diamonds or jewelry, visitors get a sense of immersive experience.
Action: Visitors may get feedback from the installation (Printed card or e-mail) to mark the experience. Similar to a souvenir, it records the visitor's figure with collections, and provide the basic information of pieces of jewelry. The target is not only making it fancy-looking and entertaining but also educational.
Follow-up: Costume exhibition in other museums / Digital(interactive) development of current biological models in museums (AMNH)
02
Represent values (price / cultural / owners) metaphorically
Discovery: large statistics /value represented metaphorically/ QR code
Engagement: Presenting figures in AR scenario metaphoring the value of the collection (Cash, car, houses, etc)
Action: Scanning QR code and follow the instruction, getting figures and texts on the interface
Follow-up: Using AR to present vivid data visualization
Reference: https://www.youtube.com/watch?v=u76ww3NJFgE
03
Manufacture Process (handcraft / design / shape / trends)
Discovery: Recreating the atmosphere (workshop etc.)
Engagement：Watch craftmen fabricating the diamonds. (compare modern way and traditional way)
Action: Follow the manufacture process / storyline
Follow-up: AR based living characters with static scenes
Case Study of AR Apps
01. Ink hunter
The augmented reality app InkHunter shows exactly what a tattoo would look like before it’s permanently etched on the body. Literally, it creates a virtual fitting room for tattoos. Which is definitely innovative and impressive.
After trying various apps that use AR technology as a mean strategy, I think InkHunter is one of the best examples. Trying tattoos is not only a crucial needs in our daily life, but also a great scenario that AR tech can be applied to. The only problem I met is the way they trigger the effect. Users have to draw a smile pattern on their skin before trying tattoos, which seems a little awkward because they have to wash it away after use.
02. 阴阳师Onmyoji
Onmyoji is a popular mobile game launched in China and Japan. With some of its function, players are able to play with 3D characters by simply scanning a certain pattern, no matter the pattern is displayed on a screen, a paper, or a sketch.
In this case, AR technology makes game experience more vivid and immersive. By combining the 3D character with different environment in the real world, players could create their unique scenario and keep that as a memorial or share with others.
Although it is a function in the mobile game, people are not able to actually interact with the character. The function is basically a new way to display the model. In terms of this, there would be more possibilities and multiple directions for the developers of AR games to explore.