NTT has presented the first part of “December Grand Kabuki”, which Shochiku is performing at Kabuki-za in Tokyo until December 26th (Tuesday), “Super Kabuki Powered by NTT” and “Hana “Kurabe Senbonzakura”, they are developing a new stage production that incorporates cutting-edge ICT, including real-time CG production using the network “APN IOWN1.0”, which features ultra-high speed and low latency.
For example, you can see the interaction between lead actor Shido Nakamura and CG Hatsune Miku.
This was achieved by connecting the Kabuki-za where Mr. Shido is located and the remote location where Hatsune Miku performers are located using APN, and by reflecting the performers’ motions as Hatsune Miku on the digital twin in real time.
Traditionally, CG was created as an animated video, making it difficult to interact with co-stars, where pauses were important.However, real-time CG has made it possible to interact with co-stars in harmony. Ta.
NTT also applied this technology to its “real-time version naked-eye XR seated conversation system.” They are developing a shared seat dialogue system that enables real-time interaction with Hatsune Miku.
They have also evolved Mr. Shido’s digital twin, “Shido Twin.”
For example, in the scene where Mr. Shido and the Shido Twins were talking, the Shido Twins greeted each other in English.
This was achieved by utilizing the “cross-lingual speech synthesis technology” developed by NTT. Shido’s own voice data was recorded in advance, and based on that data, AI reproduced the digital voice in Shido’s own voice. By applying the reproduced Japanese, it was also possible to speak in multiple languages such as English and Chinese.