Abhinav Shrivastava's Academic Website

tl;dr

Assistant Professor,
University of Maryland, College Park

Note to prospective students: We hire PhD students in computer vision, machine learning, and related fields every year. Find more about the graduate program here.

If you are interested in working with me, mention my name in your research statement.

News

09/23:

One paper accepted at NeurIPS 2023.

08/23:

One paper accepted at BMVC 2023. (details)

07/23:

Six papers accepted at ICCV 2023 (including two Orals). (details)
02/23:

Seven papers accepted at CVPR 2023 (details).
01/23:

LilNetX accepted at ICLR 2023 (details).
01/23:

COVID-VTS accepted at EACL 2023 (details).
12/22:

We are organizing the 3rd Workshop on Visual Perception via Learning in an Open World, at CVPR 2023.

08/22:

We are organizing the 2nd Workshop on Dealing with Novelty in Open Worlds (DNOW), at WACV 2023.
07/22:

Four papers accepted at ECCV 2022 (details).
05/22:

We are organizing workshop on Visual Perception and Learning in an Open World (VPLOW), the second workshop on Open World Vision at CVPR 2022, including the challenge on ObjClsDisc: In-the-Wild Object Discovery.
03/22:

Five papers accepted at CVPR 2022 (details).
03/22:

We are organizing a AAAI Spring Symposium 2022 on Designing Artificial Intelligence for Open Worlds.
12/21:

One paper accepted at AAAI 2022 (details).
10/21:

One paper accepted at WACV 2022 (details).
10/21:

Three papers accepted at BMVC 2021 (details).
09/21:

Two papers accepted at NeurIPS 2021 (details).
08/21:

We are organizing workshop on Dealing with Novelty in Open Worlds (DNOW) at WACV 2022.
07/21:

Five papers accepted at ICCV 2021 (details).
05/21:

We are organizing workshop on Open World Vision at CVPR 2021, including the challenge on Open World Image Classification.
02/21:

Seven papers accepted at CVPR 2021 (details).
02/21:

One paper accepted at ICRA 2021.
01/21:

One paper accepted at ICLR 2021.
10/20:

Two papers accepted at 3DV 2020.
08/20:

Serving as an Area Chair (SPC) for AAAI 2021.
07/20:

Three papers accepted at ECCV 2020.
07/20:

One paper accepted at ICIP 2020.
05/20:

Serving as an Area Chair for WACV 2021.
02/20:

PatchVAE accepted at CVPR 2020.
02/20:

Kyungjun's paper won Best Paper Award (Applications) at WACV 2020!
01/20:

Serving as an Area Chair for CVPR 2021.
12/19:

One paper accepted at ICLR 2020.
11/19:

Two papers accepted at AAAI 2020.
10/19:

Two papers accepted at WACV 2020.
07/19:

EvalNorm accepted at ICCV 2019.
02/19:

One paper accepted at CVPR 2019.
08/18:

Started as Assitant Professor at University of Maryland, College Park.
07/18:

Two papers accepted at ECCV 2018.
07/18:

Google AI blog post on Self-Supervised Tracking via Video Colorization.
05/18:

Serving as an Area Chair for CVPR 2019.
02/18:

Serving as an Area Chair for ECCV 2018.
08/17:

Started as Visiting Research Scientist at Google.
08/17:

Successfully defended my thesis & Graduated!
07/17:

Google Research blog post on Revisiting the Unreasonable Effectiveness of Data
06/17:

Accepted an Assistant Professor position at UMD (starting in Fall 2018).
06/17:

Paper accepted at ICCV 2017:
Revisiting Unreasonable Effectiveness of Data in Deep Learning Era (spotlight).
04/17:

Serving as an Area Chair for CVPR 2018.
03/17:

Paper accepted at CVPR 2017:
A-Fast-RCNN: Hard Positive Generation via Adversary for Object Detection.
12/16:

Our work on Top-down Modulation achieves state-of-the-art single model performance on COCO detection!
10/16:

Our team stood 4th in the 2016 COCO object detection challenge (leaderboard, see Challenge2016), using the Priming and Feedback model from our ECCV paper (with some bells and whistles). It is the best VGG16 single-model entry, above a couple of ResNet entries!
08/16:

Code released for OHEM.
07/16:

Paper accepted at ECCV 2016:
Contextual Priming and Feedback for Faster R-CNN.
03/16:

Two papers accepted at CVPR 2016:
Training Region-based Object Detectors with Online Hard Example Mining (oral), and
Cross-stitch Networks for Multi-task Learning (spotlight).
03/16:

A hackathon project during my internship at Microsoft Research is the basis of the 'Seeing AI' product. During my Masters, I worked on a similar project on Assistive Technologies using a first person vision device (read more).
12/15:

Our team stood 4th in the 2015 MS COCO object detection challenge (leaderboard, see Challenge2015). Our entry used hard example mining to train Fast R-CNN (and added some bells and whistles).

About me

I am an Assistant Professor in the Department of Computer Science at University of Maryland, College Park, with a joint appointment in the Institute of Advanced Computer Studies (UMIACS). Before this, I spent 1 year as a Visiting Research Scientist at Google Research.

In August 2017, I received my PhD in Robotics and Artificial Intelligence from the Robotics Institute, Carnegie Mellon University, where I was advised by Abhinav Gupta. My PhD thesis, Discovering and Leveraging Visual Structure for Large-scale Recognition, was supported by Microsoft Research PhD Fellowship for 2014-16.

Before joining PhD, I received my Masters from the Robotics Institute, under the supervision of Alyosha Efros and Martial Hebert. Prior to that, I received my BTech in Computer Science and Engineering from JIIT (Noida, India).

I have also enjoyed working with awesome researchers and engineers in industry, including internships at Google Research and Microsoft Research (details).

Download CV (pdf)

Research Experience

August, 2018 - present

Assistant Professor

University of Maryland, College Park

Joint appointments in Department of Computer Science and Institute of Advanced Computer Studies (UMIACS).

September, 2017 - August, 2018

Visiting Research Scientist - Google Research

August, 2016 - July, 2017

Research Assistant - Google Research

Working with Abhinav Gupta, Rahul Sukthankar, and Jitendra Malik on incorporating feedback in object detection models.

Summer, 2015

Research Intern - Microsoft Research

Worked with Ross Girshick and Larry Zitnick on object detection and semi-supervised learning.

Summer, 2013

Research Intern - Google Research

Worked with Mark Segal, Rahul Sukthankar and Thomas Leung on incorporating image geometry in deep neural networks.

Summer, 2012

Research Intern -Microsoft Research

Worked on large-scale indexing and nearest-neighbor search for high-dimensional data with Sanjeev Mehrotra and Jin Li.

Fall, 2010

Research Associate III -- Robotics Institute, Carnegie Mellon University

Continued Masters research on image matching and retrieval, real-time assistive systems, and object detection; and worked on large-scale semi-supervised learning algorithm.

Education

August, 2012 - August, 2017

PhD, Artificial Intelligence

Robotics Institute, Carnegie Mellon University

Working on discovering the underlying regularities, or structure, in our visual world and leveraging it in large-scale recognition algorithms and systems. This work spans a wide range of recognition tasks, and includes frequent collaborations with researchers from both academia and industry.
Find my dissertation here.

August, 2010 - December, 2011

M.S., Aritificial Intelligence

Robotics Institute, Carnegie Mellon University

Worked on data-driven visual similarity for image matching and retrieval, real-time assistive systems, and object detection.

July, 2006 - May, 2010

BTech., Computer Science and Engineering

Jaypee Institute of Information Technology

Thesis on 'A Hypermedia-development Tool for Movie-based Comic-strip Rendering'.

Teaching Experience

Introduction to Deep Learning: CMSC428L, Spring 2019
Advanced Techniques in Visual Recognition and Learning: CMSC828I, Fall 2018

Teaching Assistant Experience

Teaching Assistant, Geometry-based Methods in Vision, CMU; Spring 2013
Teaching Assistant, Data Structures, JIIT; 2008-09
Teaching Assistant, Microprocessors and Controllers, JIIT; 2008-09

Area Chair

Conferences: ICCV'23, CVPR'23, CVPR'18, ECCV'18, CVPR'19, CVPR'21, AAAI'21, WACV'21

Reviewer

Conferences: CVPR'12-17/20, NIPS'12-15, ECCV'12/14/16/20, ICCV'11/13/15/17/19, ACCV'12-16, SIGGRAPH'14, AAAI'15, 3DV'14-15
Journals: IJCV, TPAMI, CVIU, TKDE

Department Services (Carnegie Mellon University)

Master's Admissions Committee, Robotics Institute; 2015-16
Master's Thesis Committee: Shreyansh Daftry, Krishna Kumar Singh; 2014-17
Ph.D. Qualifier Committee: Aayush Bansal, Ishan Misra, Xiaolong Wang; 2015-17

Interests

I enjoy working on artificial intelligence, particularly computer vision and machine learning; and my research interests include related fields such as robotics, graphics, natural language processing, human-computer interaction, systems, data mining, and cognitive and computational neuroscience.

My long term goal is to equip machines with visual perception abilities, which enables them to understand and respond to their surroundings.

Publications

2023

Chop & Learn: Recognizing and Generating Object-State Compositions Nirat Saini*, Hanyu Wang*, Archana Swaminathan, Vinoj Jayasundara, Bo He, Kamal Gupta, Abhinav Shrivastava IEEE/CVF International Conference on Computer Vision (ICCV), 2023 new pdf / webpage / data

MOST: Multiple Object Localization with Self-Supervised Transformers for Object Discovery Saketh Rambhatla, Ishan Misra, Rama Chellappa, Abhinav Shrivastava IEEE/CVF International Conference on Computer Vision (ICCV), 2023 new Oral Presentation pdf / webpage / poster / code

SparseDet: Improving Sparsely Annotated Object Detection with Pseudo-positive Mining Saksham Suri*, Saketh Rambhatla*, Rama Chellappa, Abhinav Shrivastava IEEE/CVF International Conference on Computer Vision (ICCV), 2023 new pdf / webpage / poster / code

SHACIRA: Scalable HAsh-grid Compression for Implicit Neural Representations Sharath Girish, Abhinav Shrivastava, Kamal Gupta IEEE/CVF International Conference on Computer Vision (ICCV), 2023 new pdf / webpage / poster / video / code

ASIC: Aligning Sparse in-the-wild Image Collections Kamal Gupta, Varun Jampani, Carlos Esteves, Abhinav Shrivastava, Ameesh Makadia, Noah Snavely, Abhishek Kar IEEE/CVF International Conference on Computer Vision (ICCV), 2023 new Oral Presentation pdf / webpage / video

BT²: Backward-compatible Training with Basis Transformation Yifei Zhou, Zilu Li, Abhinav Shrivastava, Hengshuang Zhao, Antonio Torralba, Taipeng Tian, Ser-Nam Lim IEEE/CVF International Conference on Computer Vision (ICCV), 2023 new pdf

A Frequency Perspective of Adversarial Robustness Shishira R Maiya, Max Ehrlich, Vatsal Agarwal, Ser-Nam Lim, Tom Goldstein, Abhinav Shrivastava British Machine Vision Conference (BMVC), 2023 new pdf

Teaching Matters: Investigating the Role of Supervision in Vision Transformers Matthew Walmer*, Saksham Suri*, Kamal Gupta, Abhinav Shrivastava IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023 pdf / webpage / code

NIRVANA: Neural Implicit Representations of Videos with Adaptive Networks and Autoregressive Patch-wise Modeling Shishira R Maiya*, Sharath Girish*, Max Ehrlich , Hanyu Wang, Kwot Sin Lee, Patrick Poirson, Pengxiang Wu, Chen Wang, Abhinav Shrivastava IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023 pdf / webpage

Towards Scalable Neural Representation for Diverse Videos Bo He, Xitong Yang, Hanyu Wang, Zuxuan Wu, Hao Chen, Shuaiyi Huang, Yixuan Ren, Ser-Nam Lim, Abhinav Shrivastava IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023 pdf / webpage / code

Align and Attend: Multimodal Summarization with Dual Contrastive Losses Bo He, Jun Wang, Jielin Qiu, Trung Bui, Abhinav Shrivastava, Zhaowen Wang IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023 pdf / webpage / code

HNeRV: A Hybrid Neural Representation for Videos Hao Chen, Matt Gwilliam, Ser-Nam Lim, Abhinav Shrivastava IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023 pdf / webpage / code

FlexNeRF: Photorealistic Free-viewpoint Rendering of Moving Humans from Sparse Views Vinoj Jayasundara, Amit Agrawal, Nicolas Heron, Abhinav Shrivastava, Larry S. Davis IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023 pdf / webpage

SimpSON: Simplifying Photo Cleanup With Single-Click Distracting Object Segmentation Network Chuong Huynh, Yuqian Zhou, Zhe Lin, Connelly Barnes, Eli Shechtman, Sohrab Amirghodsi, Abhinav Shrivastava IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023 pdf / webpage / code / video / poster

LilNetX: Lightweight Networks with EXtreme Model Compression and Structured Sparsification Sharath Girish, Kamal Gupta, Saurabh Singh, Abhinav Shrivastava International Conference on Learning Representations (ICLR), 2023 bibtex / pdf / webpage / code

COVID-VTS: Fact Extraction and Verification on Short Video Platforms Fuxiao Liu, Yaser Yacoob, Abhinav Shrivastava EACL, 2023 bibtex

2022

Improving Closed and Open Set Attribute Prediction using Transformers Khoi Pham, Kushal Kafle, Zhe Lin, Zhihong Ding, Scott Cohen, Quan Hung Tran, Abhinav Shrivastava European Conference on Computer Vision (ECCV), 2022 bibtex / pdf / webpage / code

Learning Semantic Correspondence with Sparse Annotations Shuaiyi Huang, Luyu Yang, Bo He, Songyang Zhang, Xuming He, Abhinav Shrivastava European Conference on Computer Vision (ECCV), 2022 bibtex / pdf / webpage / code

Neural Space-Filling Curves Hanyu Wang, Kamal Gupta, Larry Davis, Abhinav Shrivastava European Conference on Computer Vision (ECCV), 2022 bibtex / pdf / webpage / code / poster

Burn After Reading: Online Adaptation for Cross-domain Streaming Data Luyu Yang, Mingfei Gao, Zeyuan Chen, Ran Xu, Abhinav Shrivastava, Chetan Ramaiah European Conference on Computer Vision (ECCV), 2022 bibtex / pdf / webpage / code

ASM-Loc: Action-aware Segment Modeling for Weakly-Supervised Temporal Action Localization Bo He, Xitong Yang, Le Kang, Zhiyu Cheng, Xin Zhou, Abhinav Shrivastava IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022 bibtex / pdf / webpage / code

Disentangling Visual Embeddings for Attributes and Objects Nirat Saini, Khoi Pham, Abhinav Shrivastava IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022 Oral Presentation bibtex / pdf / webpage / code

Beyond Supervised vs. Unsupervised: Representative Benchmarking and Analysis of Image Representation Learning Matthew Gwilliam, Abhinav Shrivastava IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022 bibtex / pdf / webpage / code

Dual-Key Multimodal Backdoors for Visual Question Answering Matthew Walmer, Karan Sikka, Indranil Sur, Abhinav Shrivastava, Susmit Jha IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022 bibtex / pdf / demo / code

ObjectFormer for Image Manipulation Detection and Localization Junke Wang, Zuxuan Wu, Jingjing Chen, Xintong Han, Abhinav Shrivastava, Ser-Nam Lim, Yu-Gang Jiang IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022 bibtex / pdf

Rethinking Pseudo Labels for Semi-Supervised Object Detection Hengduo Li, Zuxuan Wu, Abhinav Shrivastava, Larry S. Davis Thirty-Sixth AAAI Conference on Artificial Intelligence (AAAI), 2022 bibtex / pdf

Pose And Joint-Aware Action Recognition Anshul Shah, Shlok Mishra, Ankan Bansal, Jun-Cheng Chen, Rama Chellappa, Abhinav Shrivastava Winter Conference on Applications of Computer Vision (WACV), 2022 bibtex / pdf / video / code

2021

GTA: Global Temporal Attention for Video Action Understanding Bo He*, Xitong Yang*, Zuxuan Wu, Hao Chen, Ser-Nam Lim, Abhinav Shrivastava British Machine Vision Conference (BMVC), 2021 bibtex / pdf / teaser

HR-RCNN: Hierarchical Relational Reasoning for Object Detection Hao Chen, Abhinav Shrivastava British Machine Vision Conference (BMVC), 2021 bibtex / pdf / teaser

Deep Video Inpainting Detection Peng Zhou, Ning Yu, Zuxuan Wu, Larry Davis, Abhinav Shrivastava, Ser-Nam Lim British Machine Vision Conference (BMVC), 2021 bibtex / pdf / teaser

NeRV: Neural Representations for Videos Hao Chen, Bo He, Hanyu Wang, Yixuan Ren, Ser-Nam Lim, Abhinav Shrivastava Advances in Neural Information Processing Systems (NeurIPS), 2021 bibtex / website / pdf / code

PatchGame: Learning to Signal Mid-level Patches in Referential Games Kamal Gupta, Gowthami Somepalli, Anubhav Gupta, Vinoj Jayasundara, Matthias Zwicker, Abhinav Shrivastava Advances in Neural Information Processing Systems (NeurIPS), 2021 bibtex / website / pdf / video+slides / code

The Pursuit of Knowledge: Discovering and Localizing Novel Categories using Dual Memory Saketh Rambhatla, Rama Chellappa, Abhinav Shrivastava International Conference on Computer Vision (ICCV), 2021 bibtex / website / pdf

Learned Spatial Representations for Few-shot Talking-Head Synthesis Moustafa Mehshry, Saksham Suri, Larry Davis, Abhinav Shrivastava International Conference on Computer Vision (ICCV), 2021 bibtex / website / pdf / pdf+appendix / video / code

Towards Discovery and Attribution of Open-world GAN Generated Images Sharath Girish, Saksham Suri, Saketh Rambhatla, Abhinav Shrivastava International Conference on Computer Vision (ICCV), 2021 bibtex / pdf / website

Layout Generation and Completion with Self-attention Kamal Gupta, Alessandro Achille, Justin Lazarow, Larry Davis, Vijay Mahadevan, Abhinav Shrivastava International Conference on Computer Vision (ICCV), 2021 bibtex / pdf / website / code

Deep Co-Training with Task Decompositionfor Semi-Supervised Domain Adaptation Luyu Yang, Yan Wang, Mingfei Gao, Abhinav Shrivastava, Kilian Weinberger, Wei-Lun Chao, Ser-Nam Lim International Conference on Computer Vision (ICCV), 2021 bibtex / pdf / code

The Lottery Ticket Hypothesis for Object Recognition Sharath Girish*, Shishira Maiya*, Kamal Gupta, Hao Chen, Larry Davis, Abhinav Shrivastava IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2021 bibtex / pdf / website / code

Knowledge Evolution in Neural Networks Ahmed Taha, Abhinav Shrivastava, Larry Davis IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2021 oral presentation bibtex / pdf / website / code / blog

Style-based Encoder Pre-training for Multi-modal Image Synthesis Moustafa Mehshry, Yixuan Ren, Larry Davis, Abhinav Shrivastava IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2021 bibtex / pdf / website / code

Learning to Predict Visual Attributes in the Wild Khoi Pham, Kushal Kafle, Zhe Lin, Zhihong Ding, Scott Cohen, Quan Hung Tran, Abhinav Shrivastava IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2021 bibtex / pdf / website / code / demo / explore the VAW dataset

2D or not 2D? Adaptive 3D Convolution Selection for Efficient Video Recognition Hengduo Li, Zuxuan Wu, Abhinav Shrivastava, Larry Davis IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2021 bibtex / pdf

Hierarchical Video Prediction for Human Object Interaction Navaneeth Bodla, Gaurav Shrivastava, Rama Chellappa, Abhinav Shrivastava IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2021 bibtex / pdf / website / video

Learning Graphs for Knowledge Transfer with Limited Labels Pallabi Ghosh, Nirat Saini, Larry Davis, Abhinav Shrivastava IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2021 bibtex / pdf / website / video / code

Leveraging Hand-Object Interactions in Assistive Egocentric Vision Vision Kyungjun Lee, Abhinav Shrivastava, Hernisa Kacorri IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2021 oral presentation best paper award (applications) bibtex / pdf

No-frills Dynamic Planning using Static Planners Mara Levy, Vasista Ayyagari, Abhinav Shrivastava IEEE International Conference on Robotics and Automation (ICRA), 2021 bibtex / pdf / website / video

Diverse Video Generation using a Gaussian Process Trigger Gaurav Shrivastava, Abhinav Shrivastava International Conference on Learning Representations (ICLR), 2021 bibtex / pdf / website / code

A Unifying Framework for Formal Theories of Novelty T. E. Boult, P. A. Grabowicz, D. S. Prijatelj, R. Stern, L. Holder, J. Alspector, M. Jafarzadeh, T. Ahmad, A. R. Dhamija, C.Li, S. Cruz, A. Shrivastava, C. Vondrick, W. J. Scheirer Thirty-Fifth AAAI Conference on Artificial Intelligence (AAAI), 2021 BlueSky Talk bibtex / pdf / extended pdf

2020

Improved Modeling of 3D Shapes with Multi-view Depth Maps Kamal Gupta, Susmija Jabbireddy, Ketul Shah, Abhinav Shrivastava, Matthias Zwicker International Conference on 3D Vision (3DV), 2020 oral presentation bibtex / pdf / website / code / video

Depth Completion using a View-constrained Deep Prior Pallabi Ghosh, Vibhav Vineet, Larry S. Davis, Abhinav Shrivastava, Sudipta Sinha, Neel Joshi International Conference on 3D Vision (3DV), 2020 bibtex / pdf

Quantization Guided JPEG Artifact Correction Max Ehrlich, Ser-Nam Lim, Larry Davis, Abhinav Shrivastava European Conference on Computer Vision (ECCV), 2020 bibtex / pdf / code / teaser video / technical video

A Generic Visualization Approach for Convolutional Neural Networks Ahmed Taha, Xitong Yang, Abhinav Shrivastava, Larry Davis European Conference on Computer Vision (ECCV), 2020 bibtex / pdf / code / project page / video

Curriculum Manager for Source Selection in Multi-Source Domain Adaptation Luyu Yang, Yogesh Balaji, Ser-Nam Lim, Abhinav Shrivastava European Conference on Computer Vision (ECCV), 2020 bibtex / pdf

PatchVAE: Learning Local Latent Codes for Recognition Kamal Gupta, Saurabh Singh, Abhinav Shrivastava IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2020 bibtex / pdf / code / project page / video

Group Ensemble: Learning an Ensemble of ConvNets in a single ConvNet Hao Chen, Abhinav Shrivastava arXiv, 2020 bibtex / pdf / code

All About Knowledge Graphs for Actions Pallabi Ghosh, Nirat Saini, Larry Davis, Abhinav Shrivastava arXiv, 2020 bibtex / pdf

End-to-end Learning of Compressible Features Saurabh Singh, Sami Abu-El-Haija, Nick Johnston, Johannes Ballé, Abhinav Shrivastava, George Toderici International Conference on Image Processing (ICIP), 2020 bibtex / pdf

Scalable Model Compression by Entropy Penalized Reparameterization Deniz Oktay, Johannes Ballé, Saurabh Singh, Abhinav Shrivastava International Conference on Learning Representations (ICLR), 2020 bibtex / pdf

Detecting Human-Object Interactions via Functional Generalization Ankan Bansal, Saketh Rambhatla, Abhinav Shrivastava, Rama Chellappa Thirty-Fourth AAAI Conference on Artificial Intelligence (AAAI), 2020 bibtex / pdf

Generate, Segment and Refine: Towards Generic Manipulation Segmentation Peng Zhou, Bor-Chun Chen, Xintong Han, Mahyar Najibi, Abhinav Shrivastava, Ser-Nam Lim, Larry Davis Thirty-Fourth AAAI Conference on Artificial Intelligence (AAAI), 2020 bibtex / pdf / code

Hand-Priming in Object Localization for Assistive Egocentric Vision Kyungjun Lee, Abhinav Shrivastava, Hernisa Kacorri IEEE & CVF Winter Conference on Applications of Computer Vision (WACV), 2020 oral presentation best paper award (applications) bibtex / pdf / video

Boosting Standard Classification Architectures Through a Ranking Regularizer Ahmed Taha, Yi-Ting Chen, Teruhisa Misu, Abhinav Shrivastava, Larry Davis IEEE & CVF Winter Conference on Applications of Computer Vision (WACV), 2020 bibtex / pdf / project page / code

2019 and earlier

EvalNorm: Estimating Batch Normalization Statistics for Evaluation Saurabh Singh, Abhinav Shrivastava IEEE International Conference on Computer Vision (ICCV), 2019 bibtex / pdf

Render4Completion: Synthesizing Multi-view Depth Maps for 3D Shape Completion Tao Hu, Zhizhong Han, Abhinav Shrivastava, Matthias Zwicker ICCV Workshops, Geometry Meets Deep Learning, 2019 bibtex / pdf

Relational Action Forecasting Chen Sun, Abhinav Shrivastava, Carl Vondrick, Rahul Sukthankar, Kevin Murphy, Cordelia Schmid IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019 bibtex / pdf

Actor-centric Relation Network Chen Sun, Abhinav Shrivastava, Carl Vondrick, Kevin Murphy, Rahul Sukthankar, Cordelia Schmid European Conference on Computer Vision (ECCV), 2018 bibtex / pdf

Tracking Emerges by Colorizing Videos Carl Vondrick, Abhinav Shrivastava, Alireza Fathi, Sergio Guadarrama, Kevin Murphy European Conference on Computer Vision (ECCV), 2018 bibtex / pdf
In Media: Google AI Blog

Revisiting Unreasonable Effectiveness of Data in Deep Learning Era Chen Sun, Abhinav Shrivastava, Saurabh Singh, Abhinav Gupta IEEE International Conference on Computer Vision (ICCV), 2017 spotlight presentation bibtex / pdf
In Media: Google Research Blog, Wired

Beyond Skip Connections: Top-Down Modulation for Object Detection Abhinav Shrivastava, Rahul Sukthankar, Jitendra Malik, Abhinav Gupta arXiv [cv.CV], 2016 bibtex / pdf

A-Fast-RCNN: Hard Positive Generation via Adversary for Object Detection Xiaolong Wang, Abhinav Shrivastava, Abhinav Gupta IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017 bibtex / pdf / code

Contextual Priming and Feedback for Faster R-CNN Abhinav Shrivastava, Abhinav Gupta European Conference on Computer Vision (ECCV), 2016 bibtex / pdf / poster

Training Region-based Object Detectors with Online Hard Example Mining Abhinav Shrivastava, Abhinav Gupta, Ross Girshick IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016 oral presentation bibtex / pdf / code / video / poster / slides (pptx)

Cross-stitch Networks for Multi-task Learning Ishan Misra*, Abhinav Shrivastava*, Abhinav Gupta, Martial Hebert (*equal contribution) IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016 spotlight presentation bibtex / pdf / poster / slides

Mid-level Elements for Object Detection Aayush Bansal, Abhinav Shrivastava, Carl Doersch, Abhinav Gupta arXiv [cs.CV], 2015 bibtex / pdf / analysis

Watch and Learn: Semi-supervised Learning of Object Detectors from Videos Ishan Misra, Abhinav Shrivastava, Martial Hebert IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015 bibtex / pdf / project page / poster

Applying artificial vision models to human scene understanding Elissa M. Aminoff, Mariya Toneva, Abhinav Shrivastava, Xinlei Chen, Ishan Misra, Abhinav Gupta, Michael Tarr Frontiers in Computational Neuroscience, 2015 bibtex / pdf

Enriching Visual Knowledge Bases via Object Discovery and Segmentation Xinlei Chen, Abhinav Shrivastava, Abhinav Gupta IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2014 bibtex / pdf / project page / code / poster / supplement

Data-driven Exemplar Model Selection Ishan Misra, Abhinav Shrivastava, Martial Hebert IEEE Winter Conference on Applications of Computer Vision (WACV), 2014 oral presentation best student paper award bibtex / pdf / project page / slides (pptx)

Building Part-based Object Detectors via 3D Geometry Abhinav Shrivastava, Abhinav Gupta IEEE International Conference on Computer Vision (ICCV), 2013 bibtex / pdf / project page

NEIL: Extracting Visual Knowledge from Web Data Xinlei Chen, Abhinav Shrivastava, Abhinav Gupta IEEE International Conference on Computer Vision (ICCV), 2013 oral presentation bibtex / pdf / project page / code / test code / video / poster / slides (pptx) In Media: CNN, Discover Magazine, Newsweek, Forbes, Yahoo! News, BBC News, AP, Business Insider, Slashdot, Engadget, Techradar

Constrained Semi-Supervised Learning using Attributes and Comparative Attributes Abhinav Shrivastava, Saurabh Singh, Abhinav Gupta European Conference on Computer Vision (ECCV), 2012 oral presentation bibtex / pdf / project page / video / slides (pptx)

Data-driven Visual Similarity for Cross-domain Image Matching Abhinav Shrivastava, Tomasz Malisiewicz, Abhinav Gupta, Alexei A. Efros ACM Transaction of Graphics, (Proceedings of SIGGRAPH Asia), 2011 oral presentation bibtex / pdf / project page / code / video / supplement / data / slides (pptx) In Media: Techcrunch, Science Daily, Y! Hacker News, New Atlas (formerly Gizmag)

Invited Papers and Technical Reports

Real-time Household Object Detection from First-person's view using Exemplar-SVMs Abhinav Shrivastava, Abhinav Gupta, Alexei A. Efros In IEEE Workshop on Egocentric Vision at CVPR, 2012 extended abstract & poster project page, code and demo

Exemplar-SVMs for Visual Object Detection, Label Transfer and Image Retrieval Tomasz Malisiewicz, Abhinav Shrivastava, Abhinav Gupta, Alexei A. Efros In International Conference on Machine Learning (ICML), 2012 invited applications talk & extended abstract pdf / slides

Measuring and Increasing the capacity of Natural HOG Statistics Tinghui Zhou, Abhinav Shrivastava, Guillaume Obozinski, Abhinav Gupta, Alexei A. Efros Technical Report, Carnegie Mellon University MS thesis (T. Zhou) pdf / supplement

HOG and Spatial Convolution on SIMD Architecture Ishan Misra, Abhinav Shrivastava, Martial Hebert Technical Report, Carnegie Mellon University pdf / code

Selected Awards and Honors

Best Paper Award (Applications), IEEE Winter Conference on Applications of Computer Vision; 2020
Outstanding Reviewer Award, IEEE CVPR; 2015
Microsoft Research Ph.D. Fellowship; 2014-16
CNNs Top-10 Ideas 2013 (Thinking Tech)
Best Student Paper Award, IEEE Winter Conference on Applications of Computer Vision; 2014
Selected for Google Graduate CS Forum; 2012
Research Highlight of the week, Computing Community Consortium; 2011
Vice Chancellor Gold Medal (awarded to Rank 1 out of 120), Dept. of Computer Science and Engineering, JIIT; 2006-10

Selected Media Coverage

Self-Supervised Tracking via Video Colorization, Google AI Blog; 2018
Revisiting the Unreasonable Effectiveness of Data, Google Research Blog; 2017
AI And 'Enormous Data' Could Make Tech Giants Harder to Topple, Wired; 2017
Thinking Tech (Top-10 Ideas), CNN; 2013
The Greatest Hits, and Misses, of an Image-Learning AI, Discover Magazine; April 2015
Watch out, WATSON. You've got competition, Newsweek; 2013
Computer Learns Common Sense From The Internet, Forbes; 2013
New research aims to teach computers common sense, Yahoo! News; 2013
Computer uses images to teach itself common sense, BBC News; 2013
New research aims to teach computers common sense, AP; 2013
Researchers Are Trying To Teach Computers Common Sense, Business Insider; 2013
CMU AI Learning Common Sense By Watching the Internet, Slashdot; 2013
Carnegie Mellon computer learns common sense through pictures, shows what it's thinking, Engadget; 2013
Meet NEIL, the computer that thinks like you do, Techradar; 2013
CMU Researchers One-Up Google Image Search And Photosynth With Visual Similarity Engine, Techcrunch; 2011
Computerized method for matching images in photos, paintings, sketches created, Science Daily; 2011
A better search for visually similar images, Y! Hacker News; 2011
CMU algorithm matches sketches, paintings to photographs, New Atlas (formerly Gizmag); 2011

Selected Talks, Seminars and Lectures

Top-down Mechanisms in Bottom-up Deep Networks

workshop

Workshop on Deep Learning, University of Maryland, College Park; May 2017

The Small and the Rare: the Twin Menace of Visual Recognition

research tech talk

Faceook AI Research (FAIR); Jun. 2017

research tech talk

4Catalyzer; Jun. 2017

colloqium

CS Colloqium, University of Maryland, College Park; Mar. 2017

seminar

GRASP Seminar, University of Pennsylvania; Feb. 2017

Training Region-based Object Detectors with Online Hard Example Mining

conference

CVPR; Jun. 2016; video

NEIL: Extracting Visual Knowledge from Web Data

CMU VASC Seminar; Nov. 2013

conference

ICCV; Dec. 2013; video

course

Guest Lecture: Visual Recognition, University of Pittsburgh; Feb. 2015

Constrained Semi-Supervised Learning using Attributes and Comparative Attributes

CMU VASC Seminar; Sep. 2012

conference

ECCV; Dec. 2012; video

course

Guest Lecture: Visual Recognition, University of Pittsburgh; Feb. 2015

Data-driven Visual Similarity for Cross-domain Image Matching

conference

SIGGRAPH Asia; Dec. 2011

course

Guest Lecture: Visual Recognition, University of Pittsburgh; Feb. 2015

Overview of Object Detection with historical context

course req.

Learning-based Methods in Vision, CMU; Oct. 2013

Semantic vs. Visual Subcategories in Computer Vision and Neuroscience

course req.

The Visual World as seen by the Neurons and Machines; Mar. 2014

Building Part-based Object Detectors via 3D Geometry

CMU VASC Seminar; Nov. 2013

Tutorial on Caffe toolbox

course req.

Big Data Approaches in Vision, CMU; Sep. 2014

Vanishing Point Estimation, and applications to Scene-layout Estimation

course

Guest Lecture, Geometry-based Methods in Vision, CMU; 2013-16

Indexing in High-dimensional spaces (for large-scale nearest neighbor search)

industry

Bing, Microsoft; Aug. 2012

Tutorial, CMU; Sep. 2012

Tutorial and Workshop on Automated Robotics (Micro-mouse)

course

Microprocessors and Controllers, JIIT; 2008-09

Guest Lecture, Computer Society of India (CSI) Week, IGIT, Indraprastha (IP) University; 2008

Guest Lecture, IEEE Week, NIEC; 2008

Workshop, IEEE Winter Academic Program, JIIT; 2008

Selected Robotics Competitions (undergrad)

Finalists, Robo-Relay, IIT, Kharagpur; 2008
Runner-up, Line Follower, Delhi College of Engineering; 2008
Finalist, Maze Ablaze, Delhi College of Engineering; 2008
Winner, Cross Terrain Racing, USIT, Indraprastha (IP) University (New Delhi); 2007
Winner, Trash Collection, IGIT, Indraprastha (IP) University (New Delhi); 2007
Runner-up, Chequered Flag, IGIT, Indraprastha (IP) University (New Delhi); 2007

Selected Positions Held (undergrad)

Technical Research Coordinator, Creativity and Innovation Cell in Robotics, JIIT; 2008-09
Sun Campus Ambassador (for Sun Microsystems Inc.), JIIT; 2008
President, JIIT Youth Club (student union), JIIT, 2008-09
Team Leader, Microsoft Go-Alive Challenge, JIIT; 2008
Treasurer, EBULLIENCE, JIIT; 2007
Chief Project Coordinator, Multimedia Project (2D Graphics) (managing more than 800 students), JIIT; 2007