FoundationVision

All

12 repositories

VAR
Public
[NeurIPS 2024 Oral][GPT beats diffusion🔥] [scaling laws in visual generation📈] Official impl. of "Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Prediction". An *ultra-simple, user-friendly yet state-of-the-art* codebase for autoregressive image generation!
transformers generative-model image-generation auto-regressive-model gpt neurips gpt-2 diffusion-models autoregressive-models vision-transformer
Jupyter Notebook
•
MIT License
•427•6.4k•37•0•Updated Dec 22, 2024Dec 22, 2024
Liquid
Public
Liquid: Language Models are Scalable Multi-modal Generators
generative text-to-image image-gen text-to-image-generation llms generative-ai
MIT License
•0•39•1•0•Updated Dec 12, 2024Dec 12, 2024
Infinity
Public
Infinity ∞ : Scaling Bitwise AutoRegressive Modeling for High-Resolution Image Synthesis
transformers generative-model image-generation auto-regressive-model gpt text-to-image gpt-2 autoregressive-models text-to-image-generation
MIT License
•1•393•6•0•Updated Dec 11, 2024Dec 11, 2024
infinity.project
Public
HTML
•0•0•0•0•Updated Dec 11, 2024Dec 11, 2024
GLEE
Public
[CVPR2024 Highlight]GLEE: General Object Foundation Model for Images and Videos at Scale
tracking open-world object-detection interactive-segmentation video-object-segmentation referring-expression-segmentation referring-expression-comprehension video-instance-segmentation zero-shot-object-detection referring-video-object-segmentation
Python
•
MIT License
•86•1.1k•39•2•Updated Oct 21, 2024Oct 21, 2024
LlamaGen
Public
Autoregressive Model Beats Diffusion: 🦙 Llama for Scalable Image Generation
image-generation llama auto-regressive-model diffusion text2image diffusion-models llm
Python
•
MIT License
•57•1.4k•50•0•Updated Aug 15, 2024Aug 15, 2024
OmniTokenizer
Public
[NeurIPS 2024]OmniTokenizer: one model and one weight for image-video joint tokenization.
vae image-generation auto-regressive-model tokenization video-generation vqvae
Python
•
MIT License
•7•272•8•0•Updated Jul 9, 2024Jul 9, 2024
vaex
Public
🔥stable, simple, state-of-the-art VQVAE toolkit & cookbook
Python
•
MIT License
•3•62•2•0•Updated Jun 23, 2024Jun 23, 2024
Groma
Public
[ECCV2024] Grounded Multimodal Large Language Model with Localized Visual Tokenization
llama multimodal grounding foundation-models large-language-models llm mllm vision-language-model llama2
Python
•
Apache License 2.0
•61•585•8•1•Updated Jun 7, 2024Jun 7, 2024
GenerateU
Public
[CVPR2024] Generative Region-Language Pretraining for Open-Ended Object Detection
open-world object-detection multimodality open-vocabulary mllm open-vocabulary-detection
Python
•6•150•14•0•Updated Mar 25, 2024Mar 25, 2024
UniRef
Public
[ICCV2023] Segment Every Reference Object in Spatial and Temporal Spaces
object-segmentation unified-model
Python
•
MIT License
•15•235•4•0•Updated Jan 10, 2024Jan 10, 2024
.github
Public
0•0•0•0•Updated Dec 16, 2023Dec 16, 2023