ImayohClay

Mixed Reality Tools for Exploring Japanese Traditional Colors by Using Clay Interface

Chisa YAMAMOTO, Toshikazu OHSHIMA

https://gyazo.com/114a9203493bcfa8f2d582d70a433e8c

ABSTRACT

ImayohClay is a Mixed Reality system of “colors and words,” that emphasizes experience by using clay as an interface. Users learn about the traditional Japanese colors while enjoying coloring, mixing, and modeling clay with this tool. Traditional Japanese color names can tell us about Japanese culture and history. ImayohClay is designed to motivate students to learn through the experience of coloring and modeling clay.

EN

https://youtu.be/qIW_bCxMMpE

J

https://youtu.be/DU3Y07eIFt8

“Ima-yoh” is derived from one of the traditional Japanese colors. This color name means "trendy color" and refers to a slightly pale red. “Ima” means now. This "now" refers to the Heian period. In "The Tale of Genji," the main character, Hikaru Genji, presented his beloved wife, Murasaki no Ue, with a costume in this color.

The reading comprehension of Japanese students has been declining compared to the rest of the world. Reading comprehension is not only a necessary skill for other subjects, but also an important ability for building good relationships with others. In other countries, cross-curricular learning has been widely adopted, and Japan is paying attention to it. This project devised a teaching material that crosses "Japanese language" and " drawing and manual arts".

Operation Procedure

Users pick up the clay and place it on the palette. When clay is placed on a clay plate, the color is projected onto the clay. Users can choose 5 colors from the palette. Five colors: red, blue, yellow, green, and white. Users can choose two different colors and place them on the clay plate to enjoy color mixing. And the palette has "What Color?" section. Selecting this will display the name of the Japanese color on the monitor. Users can naturally learn the names of colors while playing with clay.

System structure

The clay uses the Kinect depth sensor to measure its position. Using a projector to project colors onto clay. The palette is controlled by Arduino. The pallet is equipped with CdS photocells that determines if clay is being placed on it or not. The LED glows when a selection is made, so the user can visually see what has been selected.

Color mixing and color names

Measuring the distance between clay regions using OpenCV's labeling process. Two clays are set to change color as it approaches. ImayohClay has a total of 250 colors of data on traditional Japanese color information. It explains in detail the names and origins of the colors. Users can learn about the history and culture of Japan by looking at these. We hope you find your favorite color too! Of course, our favorite is Ima-yoh.

Acknowledgment

This work is supported by the Japan Society for the Promotion of Science KAKENHI Grant Number 21K12004.

https://gyazo.com/4522d14ac0d68891838b200729703c32

SIGGRAPH Asia2021Exhibition

インタラクション2022

インタラクティブ発表 2 　2022-02-28 14:50

デモ発表(2D-13) ImayohClay:粘土型インタフェースを用いた色と言葉に親しむためのAR教材

山本 知沙，大島 登志一（立命館大）

ImayohClay: 粘土型インタフェースを用いた色と言葉に親しむためのAR教材

本研究では，手を使う体験を重視して，粘土をインタフェースとして活用し「色」と「言葉」を関連付けながら楽しく学べるARシステムを試作した．ユーザは実際に手を動かして，粘土の造形と着色，混色による色の創造を楽しむことができる．着色と混色は投影によって表現され，色の名前として日本の伝統的な色彩語を採用することで，伝統的な色名を通して，日本の言語文化や歴史に触れ，豊かな言語感覚を養うことを期待する．本研究は粘土の着色や造形などの体験を通して，学習の動機づけを高めることを目的とする．