I completed my PhD from the Computer Science & Engineering department at the University of Michigan, Ann Arbor. My adviser is Professor Honglak Lee. My general research interest lies on modeling structured motion with deep neural networks. Particularly, my interest spans across the areas of computer vision, graphics and model-based reinforcement learning. Most of my work has been in video prediction/generation, motion retargeting and human motion synthesis.
Fun Facts: I played for my national basketball team (I am originally from Ecuador). I was also second best scorer in the nation in a national championship I played back in the day. I was part of a team that beat the media's projected champion during a championship in Quito (the guy that was best scorer in the national championship played for the other team :P). Let's have a Curry-range 3-point shootout. Ok, I'll stop now ...
Unsupervised Learning of Object Structure and Dynamics from Videos New!
Matthias Minderer, Chen Sun, Ruben Villegas, Forrester Cole, Kevin Murphy, Honglak Lee
Learning Latent Dynamics for Planning from Pixels New!
Danijar Hafner, Timothy Lillicrap, Ian Fischer, Ruben Villegas, David Ha, Honglak Lee, James Davidson
In Proceedings of the 36th International Conference on Machine Learning (ICML), 2019
MT-VAE: Learning Motion Transformations to Generate Multimodal Human Dynamics
Xinchen Yan, Akash Rastogi, Ruben Villegas, Kalyan Sunkavalli, Eli Shechtman,
Sunil Hadap, Ersin Yumer, Honglak Lee.
In European Conference on Computer Vision (ECCV), 2018
Hierarchical Long-term Video Prediction without Supervision
Nevan Wichers, Ruben Villegas, Dumitru Erhan, Honglak Lee
In Proceedings of the 35th International Conference on Machine Learning (ICML), 2018
Neural Kinematic Networks for Unsupervised Motion Retargetting Oral Presentation
Ruben Villegas, Jimei Yang, Duygu Ceylan, Honglak Lee
In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018
(Oral acceptance rate: 2.1%)
Learning to Generate Long-term Future via Hierarchical Prediction
Ruben Villegas, Jimei Yang, Yuliang Zou, Sungryull Sohn, Xunyu Lin, Honglak Lee
In Proceedings of the 34th International Conference on Machine Learning (ICML), 2017
Decomposing Motion and Content for Natural Video Sequence Prediction
Ruben Villegas, Jimei Yang, Seunghoon Hong, Xunyu Lin, Honglak Lee
In International Conference on Learning Representations (ICLR), 2017
Improving Object Detection with Deep Convolutional Networks
via Bayesian Optimization and Structured Prediction Oral Presentation
Yuting Zhang, Kihyuk Sohn, Ruben Villegas, Gang Pan, Honglak Lee
In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015
(Oral acceptance rate: 3.3%)
Who Do I Look Like? Determining Parent-Offspring Resemblance via Genetic Features
Afshin Dehghan, Enrique G. Ortiz, Ruben Villegas, Mubarak Shah
In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2014