http://asheshjain.org/srnn/ Structural-RNN: Deep Learning on Spatio-Temporal Graphs

Spatio-temporal graphs are a popular flexible tool for imposing such high-level intuitions in the formulation of real world problems. In this paper, we propose an approach for combining the power of high-level spatio-temporal graphs and sequence learning success of Recurrent Neural Networks (RNNs). We develop a scalable method for casting an arbitrary spatio-temporal graph as a rich RNN mixture that is feedforward, fully differentiable, and jointly trainable. The proposed method is generic and principled as it can be used for transforming any spatio-temporal graph through employing a certain set of well defined steps. The evaluations of the proposed approach on a diverse set of problems, ranging from modeling human motion to object interactions, shows improvement over the state-of-the-art with a large margin. We expect this method to empower a new convenient approach to problem formulation through high-level spatio-temporal graphs and Recurrent Neural Networks, and be of broad interest to the community.

https://arxiv.org/abs/1808.07182 Can 3D Pose be Learned from 2D Projections Alone?

https://akanazawa.github.io/human_dynamics/

https://www.zdnet.com/article/chinas-ai-scientists-teach-a-neural-net-to-train-itself/