LEAPSE: Learning Environment Affordances for 3D Human Pose and Shape Estimation.
IEEE Trans Image Process
; 33: 3285-3300, 2024.
Article
en En
| MEDLINE
| ID: mdl-38709601
ABSTRACT
We live in a 3D world where people interact with each other in the environment. Learning 3D posed humans therefore requires us to perceive and interpret these interactions. This paper proposes LEAPSE, a novel method that learns salient instance affordances for estimating a posed body from a single RGB image in a non-parametric manner. Existing methods mostly ignore the environment and estimate the human body independently from the surroundings. We capture the influences of non-contact and contact instances on a posed body as an adequate representation of the "environment affordances". The proposed method learns the global relationships between 3D joints, body mesh vertices, and salient instances as environment affordances on the human body. LEAPSE achieved state-of-the-art results on the 3DPW dataset with many affordance instances, and also demonstrated excellent performance on Human3.6M dataset. We further demonstrate the benefit of our method by showing that the performance of existing weak models can be significantly improved when combined with our environment affordance module.
Texto completo:
1
Banco de datos:
MEDLINE
Asunto principal:
Postura
/
Algoritmos
/
Imagenología Tridimensional
Límite:
Humans
Idioma:
En
Revista:
IEEE Trans Image Process
/
IEEE trans. image process. (Online)
/
IEEE transactions on image processing (Online)
Asunto de la revista:
INFORMATICA MEDICA
Año:
2024
Tipo del documento:
Article