On January 28, User Local Co., Ltd. released a web application that allows you to move a VTuber model with your own movements reflected on the camera. It supports "Google Chrome" and "Firefox" running on Windows 10 / macOS Mojave or later, and can be used free of charge.
is a VTuber model manipulation application that runs on a web browser. It is possible to trace the movement of a person captured by a PC camera, such as a USB camera or a laptop's built-in camera, and make the VTuber model do the same movement in real time.
It is assumed that the screen of the web browser will be live-streamed using "OBS Studio" or a capture device, video chat, recorded and uploaded. Detailed distribution methods are explained on the help page.
It is said that the skeleton is estimated internally by AI, so the accuracy of the trace is quite high. In addition to the face direction and arm movements, mouth and eye movements and finger movements can also be reproduced, and five types of facial expressions can be switched with the numeric keys. It will be possible to make the VTuber model express various expressions.
Five male and female 3D characters such as "Sendagaya Shino" and "Sakurada Shiriya" are prepared in advance, and existing VRM files can be uploaded and used. Of course, you can also upload original 3D models output with "Vroid Studio" or "Blender". You can also zoom in and out of the character with shortcut keys.
"VRoid Studio" A tool that allows you to intuitively create 3D models of humanoid avatars (characters) - Mado no Mori
Blender Watching 2022 Article List
Sendagaya Shinosakurada Shitoshiya AvatarSample_CAvatarSample_DIn addition to presets with backgrounds, you can upload and use your favorite image files (JPEG/PNG format). Blue screen and green screen are also included in the presets, so you can easily synthesize and deliver the actual scenery and chromakey.