In this corner, Hiroki Yamashita, who presides over the web media "SEAMLESS", introducing the latest research on technology.Mr. Yamashita picks up and explains a highly new nature paper.
"Gazechat: Enhancing Virtual Conference with Gaze Awarence and Interactive 3D Photos" developed by the research team of the University of New York and the University of Maryland and the United States, and the U.S. -Mary Land University, and the U.S. Google research teamis.Depending on the gaze of the user who tracked with a PC web camera, the eyes movement of who is looking is reflected in real time in a profile photo.
左上の女性の視線が横を向いた時の様子Users may turn off the camera at a video conference, such as when the network bandwidth is narrow or concerned about privacy.In that case, like a voice conference, you can only see each other's profile photos and lack a sense of realism.
The research team focuses on the fact that people tend to look at the profile photos of those who are listening during the video meeting.We propose a method of animating the profile photograph's gaze in accordance with the user's closing, aiming to enhance the realism by visualizing who is looking at it.
ビデオ会議のカメラオフ時に表示するプロフィール写真の視線を動かして臨場感を高めるThis gaze tracking is not an approach that pursues reality, such as moving the eyes of the profile photo according to the actual position of the user, but renders the eyes only to clarify who is looking at it.。
For example, if you are looking at a side person, the eyes in your profile photo move the eyeballs as if you are looking at the profile photos of the side.It is scary to move only the eyeballs, so the eyeball moves and the head works a little.The advantage is that it can be implemented in low -cost low bands without any special hardware.
When you register your profile photo, you will generate 20 gaze images that are synthesized to express 3D mesh and eye masks, 3D mesh, eye masks, as seen from various angles.Identify who the user is looking at from the gaze direction, and renders 3D photos that take the gaze into account.
システムの概要As a result of a user experiment for 16 subjects, it was found that this method had a better sense of eye contact than the conditions of regular video conferences and audio conferences.While eliminating the unstable problems caused by low bandwidth in video conferences, it can also solve privacy issues, but still provide moderate realism.In the video, you can see how the gaze and the head work
Source and Image Credits: Zhenyi He, Keru Wang, Brandon Yushan Feng, RuoFei Du, and Ken Perlin.2021.Gazechat: Enhancing Virtual Conference with Gaze-Aware 3D Photos.The 34th Annual ACM Symposium on User Interface Software and Technology.Association for Computing Machinery, New York, NY, USA, 769 --782.Doi: https: // doi.Org/10.1145/3472749.3474785
To read more, you need to agree to the terms of use and register "ITMEDIA NEWS Anchor Desk Magazine".