Researchers at Aalto University have developed a new technique called WAVE for instructing dance choreography in virtual reality. The technique will be presented at the CHI conference in May, a major event for human-computer interaction research. Previous methods have relied on pre-rehearsals and simplification, making it difficult to visualize and communicate complex dance movements in real time. The WAVE technique allows dancers to anticipate future movements through a wave-like movement of model dancers, enabling them to follow choreography without the need for prior rehearsal.
The WAVE technique is based on the idea of guiding continuous, fluid movements like contemporary dance through anticipatory visualization. In a study involving 36 participants, the WAVE visualization was compared to a traditional virtual version with only one model dancer to follow. The results showed that the WAVE technique was suitable for slow-paced dance styles, allowing dancers to start dancing without prior learning. However, further research is needed to adapt and test the approach with faster movements and different dance styles. The technique may have applications beyond virtual dance games, including music videos, karaoke, and tai chi.
While mainstream VR devices currently track the movement of the headset and handheld controllers, tracking leg movements in dance poses a greater challenge due to the complexity of dance movements. Machine learning data can be used to infer leg movements, but incorporating a virtual mirror in the dance space may provide a solution. By exaggerating movements such as flexibility, height of jumps, and hip movement, virtual dancers can enhance their performance and feel more skilled, boosting motivation for physical activity. The virtual dance game developed by the researchers utilizes motion capture technology to record dance animation and can be downloaded for Meta Quest 2 and 3 VR devices.
The WAVE technique opens up possibilities for social virtual reality interactions, allowing multiple dancers to send movements to each other in a new way of dancing together. The researchers suggest that users should be able to customize the positioning of model dancers to suit their preferences. By making use of machine vision and virtual mirrors, dancers can improve their performance and enhance their virtual experience. The development of the WAVE technique involved experimenting with different visualization techniques and stages, ultimately leading to the use of a wave-like movement to guide dancers through choreography in real time.
Overall, the WAVE technique developed by Aalto University researchers offers a novel approach to instructing and visualizing dance choreography in virtual reality. By allowing dancers to anticipate future movements through a wave-like visualization, the technique enables a more intuitive way of following choreography without prior rehearsal. Further research is needed to adapt the approach to different dance styles and faster movements, with potential applications in music videos, karaoke, and tai chi. The open-source code for the WAVE dance game is available for anyone to use and develop further, offering new possibilities for interactive virtual dance experiences.
