Collections

8

LinFusion: 1 GPU, 1 Minute, 16K Image

Paper • 2409.02097 • Published Sep 3, 2024 • 33
Phidias: A Generative Model for Creating 3D Content from Text, Image, and 3D Conditions with Reference-Augmented Diffusion

Paper • 2409.11406 • Published Sep 17, 2024 • 26
Diffusion Models Are Real-Time Game Engines

Paper • 2408.14837 • Published Aug 27, 2024 • 123
Segment Anything with Multiple Modalities

Paper • 2408.09085 • Published Aug 17, 2024 • 22

1

LongVILA: Scaling Long-Context Visual Language Models for Long Videos

Paper • 2408.10188 • Published Aug 19, 2024 • 51
xGen-MM (BLIP-3): A Family of Open Large Multimodal Models

Paper • 2408.08872 • Published Aug 16, 2024 • 98
Building and better understanding vision-language models: insights and future directions

Paper • 2408.12637 • Published Aug 22, 2024 • 124
Show-o: One Single Transformer to Unify Multimodal Understanding and Generation

Paper • 2408.12528 • Published Aug 22, 2024 • 51

LinFusion: 1 GPU, 1 Minute, 16K Image

Phidias: A Generative Model for Creating 3D Content from Text, Image, and 3D Conditions with Reference-Augmented Diffusion

Diffusion Models Are Real-Time Game Engines

Segment Anything with Multiple Modalities

LongVILA: Scaling Long-Context Visual Language Models for Long Videos

xGen-MM (BLIP-3): A Family of Open Large Multimodal Models

Building and better understanding vision-language models: insights and future directions

Show-o: One Single Transformer to Unify Multimodal Understanding and Generation

gryannote

Mulberry: Empowering MLLM with o1-like Reasoning and Reflection via Collective Monte Carlo Tree Search

LlamaV-o1: Rethinking Step-by-step Visual Reasoning in LLMs

MambaVision: A Hybrid Mamba-Transformer Vision Backbone

Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Model

The Mamba in the Llama: Distilling and Accelerating Hybrid Models

Fine-Tuning Image-Conditional Diffusion Models is Easier than You Think

SPIQA: A Dataset for Multimodal Question Answering on Scientific Papers

MAVIS: Mathematical Visual Instruction Tuning

Kvasir-VQA: A Text-Image Pair GI Tract Dataset

MMEvol: Empowering Multimodal Large Language Models with Evol-Instruct

iVideoGPT: Interactive VideoGPTs are Scalable World Models

Meteor: Mamba-based Traversal of Rationale for Large Language and Vision Models

An Introduction to Vision-Language Modeling

Matryoshka Multimodal Models

Towards Modular LLMs by Building and Reusing a Library of LoRAs

Self-MoE: Towards Compositional Large Language Models with Self-Specialized Experts

FunAudioLLM: Voice Understanding and Generation Foundation Models for Natural Interaction Between Humans and LLMs

OLMoE: Open Mixture-of-Experts Language Models

LoRA+: Efficient Low Rank Adaptation of Large Models

The FinBen: An Holistic Financial Benchmark for Large Language Models

TofuEval: Evaluating Hallucinations of LLMs on Topic-Focused Dialogue Summarization

TrustLLM: Trustworthiness in Large Language Models

Snap Video: Scaled Spatiotemporal Transformers for Text-to-Video Synthesis

Subobject-level Image Tokenization

MobileLLM: Optimizing Sub-billion Parameter Language Models for On-Device Use Cases

GPTVQ: The Blessing of Dimensionality for LLM Quantization

EVA-CLIP-18B: Scaling CLIP to 18 Billion Parameters

Vision Superalignment: Weak-to-Strong Generalization for Vision Foundation Models

ScreenAI: A Vision-Language Model for UI and Infographics Understanding

EfficientViT-SAM: Accelerated Segment Anything Model Without Performance Loss