Datasets

• AirSim-MAP - Multi-agent perception dataset based on AirSim. Available here.
• PCB component detection datasets as part of our WACV 2019 paper is available here.

Code

We are strong proponents of reproducible research and open-source. Upcoming projects by the group will be released at our RIPL github.

General Frameworks we have released include:

• Continual learning framework as part of our NeurIPS Continual Learning Workshop paper.
• Framework for learning with weaker pair-wise information

Code for publications:

• ECCV 2024: Code for NeRF-MAE: Masked AutoEncoders for Self-Supervised 3D Representation Learning for Neural Radiance Fields
• CVPR 2024: Diffuse, Attend, and Segment: Unsupervised Zero-Shot Segmentation using Stable Diffusion
• CVPR 2024: Seeing the Unseen: Visual Common Sense for Semantic Placement
• CVPR 2024: GOAT-Bench: A Benchmark for Multi-modal Lifelong Navigation
• WACV 2023: Missing Modality Robustness in Semi-Supervised Multi-Modal Semantic Segmentation
• NeurIPS 2023: Fast Trainable Projection for Robust Fine-tuning
• NeurIPS 2023: DAMEX: Dataset-aware Mixture-of-Experts for visual understanding of mixture-of-datasets
• NeurIPS 2023: Training Energy-Based Normalizing Flow with Score-Matching Objectives
• CoRL 2023: HomeRobot: Open-Vocabulary Mobile Manipulation
• ICCV 2023: NeO 360: Neural Fields for Sparse View Synthesis of Outdoor Scenes
• CVPR 2023: Trainable Projected Gradient Method for Robust Fine-tuning
• CVPR 2023: CODA-Prompt: COntinual Decomposed Attention-based Prompting for Rehearsal-Free Continual Learning
• CVPR 2023: HAAV: Hierarchical Aggregation of Augmented Views for Image Captioning
• CVPR 2023: ConStruct-VL: Data-Free Continual Structured VL Concepts Learning
• ECCV 2022: ShAPO: Implicit Representations for Multi-Object Shape, Appearance, and Pose Optimization
• CVPR 2022: Beyond a Pre-Trained Object Detector: Cross-Modal Textual and Visual Context for Image Captioning
• CVPR 2022: Unbiased Teacher v2: Semi-supervised Object Detection for Anchor-free and Anchor-based Detectors
• ICRA 2022: Striking the Right Balance: Recall Loss for Semantic Segmentation
• ICRA 2022: CenterSnap: Single-Shot Multi-Object 3D Shape Reconstruction and Categorical 6D Pose and Size Estimation
• NeurIPS 2021: A Geometric Perspective towards Neural Calibration via Sensitivity Decomposition
• ICCV 2021: Always Be Dreaming: A New Approach for Data-Free Class-Incremental Learning
• IJCNN 2021: Memory-Efficient Semi-Supervised Continual Learning: The World is its Own Replay Buffer
• ICRA 2021: Hierarchical Cross-Modal Agent for Robotics Vision-and-Language Navigation
• ICRA 2021: LRGNet: Learnable Region Growing for Class-Agnostic Point Cloud Segmentation
• ICLR 2021: Unbiased Teacher for Semi-Supervised Object Detection
• NeurIPS 2020: Posterior Re-calibration for Imbalanced Datasets
• ICLR 2021: Code for Unbiased Teacher for semi-supervised object detection
• NeurIPS 2020: Code for posterior re-calibration for imbalanced learning
• ECCV 2020: Code for FeatMatch for semi-supervised image classification.
• CVPR 2019: Code for action segmentation
• ICCV 2019: Code for our video domain adaptation method
• ICLR and CVPR 2019: Code for Self-monitoring navigation agent and Regretful navigation agent, achieving state of art on the Room 2 Room task
• ICLR 2019: Framework for learning with weaker pair-wise information
• ICLR 2019: Few-shot learning framework (collaboration with VT) can be found here.
• NIPS Continual Learning Workshop 2018: Continual learning framework as part of our NeurIPS Continual Learning Workshop paper.
• ICLR 2018: Neural network clustering and learning with pair-wise constraints in PyTorch (corresponding to our ICLR 2018 and 2019 papers). We also have older code from our ICLR 2016 workshop track paper in lua torch.
• DRAGAN: Notebook example for our DRAGAN paper.