Repositories list

• ShowUI

  Public
  Open-source, End-to-end, Vision-Language-Action model for GUI Agent & Computer Use.

  agentvision-language-modelvision-language-action+ 2computer-usegui-agent

  Jupyter Notebook

  •

  Apache License 2.0

  •40•774•0•0•Updated Jan 4, 2025Jan 4, 2025

• Awesome-GUI-Agent

  Public
  💻 A curated list of papers and resources for multi-modal Graphical User Interface (GUI) agents.

  awesomegraphical-user-interfaceai-assistant+ 2llm-agentgui-agents

  22•388•0•0•Updated Jan 4, 2025Jan 4, 2025

• computer_use_ootb

  Public
  Out-of-the-box (OOTB) GUI Agent for Windows and macOS

  Python

  •

  Apache License 2.0

  •98•1.1k•27•4•Updated Jan 1, 2025Jan 1, 2025

• Awesome-Video-Diffusion

  Public
  A curated list of recent diffusion models for video generation, editing, restoration, understanding, etc.

  awesomevideo-editingvideo-understanding+ 5video-generationdiffusion-modelstext-to-videovideo-restorationtext-to-motion

  211•3.7k•1•0•Updated Dec 29, 2024Dec 29, 2024

• VideoLISA

  Public
  [NeurlPS 2024] One Token to Seg Them All: Language Instructed Reasoning Segmentation in Videos

  Python

  •

  Apache License 2.0

  •2•93•8•0•Updated Dec 26, 2024Dec 26, 2024

• FQGAN

  Public
  FQGAN: Factorized Visual Tokenization and Generation

  Python

  •

  Other

  •0•38•0•0•Updated Dec 26, 2024Dec 26, 2024

• Show-o

  Public
  Repository for Show-o, One Single Transformer to Unify Multimodal Understanding and Generation.

  multimodaldiffusion-modelslarge-language-models

  Python

  •

  Apache License 2.0

  •46•1.1k•34•1•Updated Dec 26, 2024Dec 26, 2024

• Awesome-Robotics-Diffusion

  Public
  A curated list of recent robot learning papers incorporating diffusion models for robotics tasks.

  1•12•0•0•Updated Dec 25, 2024Dec 25, 2024

• MovieBench

  Public
  Python

  •1•35•0•0•Updated Dec 24, 2024Dec 24, 2024

• Awesome-Unified-Multimodal-Models

  Public
  📖 This is a repository for organizing papers, codes and other resources related to unified multimodal models.

  13•302•0•1•Updated Dec 23, 2024Dec 23, 2024

• Awesome-MLLM-Hallucination

  Public
  📖 A curated list of resources dedicated to hallucination of multimodal large language models (MLLM).

  20•538•1•0•Updated Dec 23, 2024Dec 23, 2024

• DiffSim

  Public
  Official repository of DiffSim: Taming Diffusion Models for Evaluating Visual Similarity

  Python

  •0•7•0•0•Updated Dec 20, 2024Dec 20, 2024

• IDProtector

  Public
  The code implementation of **IDProtector: An Adversarial Noise Encoder to Protect Against ID-Preserving Image Generation**.

  0•4•0•0•Updated Dec 16, 2024Dec 16, 2024

• ROICtrl

  Public
  Code for ROICtrl: Boosting Instance Control for Visual Generation

  Python

  •0•99•0•0•Updated Dec 10, 2024Dec 10, 2024

• videogui

  Public
  [NeurIPS2024] VideoGUI: A Benchmark for GUI Automation from Instructional Videos

  guivideo-languagellm-agent

  JavaScript

  •1•24•0•0•Updated Dec 10, 2024Dec 10, 2024

• VideoSwap

  Public
  Code for [CVPR 2024] VideoSwap: Customized Video Subject Swapping with Interactive Semantic Point Correspondence

  Python

  •14•365•1•0•Updated Dec 6, 2024Dec 6, 2024

• Show-1

  Public
  [IJCV] Show-1: Marrying Pixel and Latent Diffusion Models for Text-to-Video Generation

  Python

  •

  Other

  •61•1.1k•8•7•Updated Nov 15, 2024Nov 15, 2024

• BoxDiff

  Public
  [ICCV 2023] BoxDiff: Text-to-Image Synthesis with Training-Free Box-Constrained Diffusion

  text-to-image-synthesisdiffusion-models

  Python

  •18•254•7•0•Updated Nov 12, 2024Nov 12, 2024

• sparseformer

  Public
  (ICLR 2024, CVPR 2024) SparseFormer

  computer-visiontransformerefficient-neural-networks+ 2vision-transformersparseformer

  Python

  •

  MIT License

  •2•65•1•0•Updated Nov 10, 2024Nov 10, 2024

• LOVA3

  Public
  (NeurIPS 2024) Learning to Visual Question Answering, Asking and Assessment

  benchmarkvisual-question-answeringmultimodal-deep-learning+ 3visual-question-generationmultimodal-large-language-modelsdata-asse

  Python

  •2•79•0•0•Updated Nov 7, 2024Nov 7, 2024

• VisInContext

  Public
  Official implementation of Leveraging Visual Tokens for Extended Text Contexts in Multi-Modal Learning

  efficientin-context-learningllm+ 1mllm

  Python

  •2•14•1•0•Updated Oct 30, 2024Oct 30, 2024

• Exo2Ego-V

  Public
  0•10•1•0•Updated Oct 29, 2024Oct 29, 2024

• watermark-steganalysis

  Public
  Python

  •0•3•0•0•Updated Oct 24, 2024Oct 24, 2024

• EvolveDirector

  Public
  [NeurIPS 2024] EvolveDirector: Approaching Advanced Text-to-Image Generation with Large Vision-Language Models.

  Python

  •0•44•0•0•Updated Oct 14, 2024Oct 14, 2024

• MovieSeq

  Public
  [ECCV2024] Learning Video Context as Interleaved Multimodal Sequences

  Jupyter Notebook

  •1•32•1•0•Updated Oct 1, 2024Oct 1, 2024

• GUI-Narrator

  Public
  Repository of GUI Action Narrator

  JavaScript

  •0•5•0•0•Updated Sep 22, 2024Sep 22, 2024

• RingID

  Public
  Python

  •0•22•1•0•Updated Aug 30, 2024Aug 30, 2024

• MotionDirector

  Public
  [ECCV 2024 Oral] MotionDirector: Motion Customization of Text-to-Video Diffusion Models.

  video-generationdiffusion-modelstext-to-video+ 3text-to-motiontext-to-video-generationmotion-customization

  Python

  •

  Apache License 2.0

  •54•861•23•0•Updated Aug 21, 2024Aug 21, 2024

• videollm-online

  Public
  VideoLLM-online: Online Video Large Language Model for Streaming Video (CVPR 2024)

  Python

  •

  Apache License 2.0

  •32•272•21•0•Updated Aug 15, 2024Aug 15, 2024

• X-Adapter

  Public
  [CVPR 2024] X-Adapter: Adding Universal Compatibility of Plugins for Upgraded Diffusion Model

  Python

  •

  Apache License 2.0

  •42•749•17•3•Updated Aug 14, 2024Aug 14, 2024