EVA Series: Visual Representation Fantasies from BAAI

Ongoing research training transformer models at scale

[Preprint] ViT-Lens: Towards Omni-modal Representations

Emu: An Open Multimodal Generalist

PandaGPT: One Model To Instruction-Follow Them All

ImageBind One Embedding Space to Bind Them All

A general representation modal across vision, audio, language modalities. Paper: ONE-PEACE: Exploring One General Representation Model Toward Unlimited Modalities

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

An open-source framework for training large multimodal models.

An open source implementation of CLIP.

Large Language-and-Vision Assistant built towards multimodal GPT-4 level capabilities.

Painter & SegGPT Series: Vision Foundation Models from BAAI

LAVIS - A One-stop Library for Language-Vision Intelligence

OpenMMLab Multimodal Advanced, Generative, and Intelligent Creation Toolbox. Unlock the magic 🪄: Generative-AI (AIGC), easy-to-use APIs, awsome model zoo, diffusion models, image/video restoration/…

Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

Awesome papers about Multi-Camera 3D Object Detection and Segmentation in Bird-Eye-View, such as DETR3D, BEVDet, BEVFormer

BEVFusion: Multi-Task Multi-Sensor Fusion with Unified Bird's-Eye View Representation

Deformable DETR: Deformable Transformers for End-to-End Object Detection.

A curated list of awesome neural radiance fields papers