Awesome-AI-Generated-Image-Tasks

A collection of AI-generated images papers and corresponding source code/demo program, including text-to-image, image translation (e.g., text-, image, or other multimodality-guided), image inpainting, image colorization, and image editing.

Feel free to create a PR or an issue. (Pull Request is preferred)

Outline

• Awesome-AI-Generated-Image-Tasks
  • 1. Text-to-Image
  • 2. Image Translation
  • 3. Image Inpainting
  • 4. Image Colorization
  • 5. Image Editing

---

1. Text-to-Image

Paper	Source	Code/Project Link
High-Resolution Image Synthesis with Latent Diffusion Models	CVPR 2022	[project] [code]
Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding	NeurIPS 2022	[code]
GLIDE: towards photorealistic image generation and editing with text-guided diffusion models	ICML 2022	[code]
LAFITE: Towards language-free training for text-to-image generation	CVPR 2022	[code]
Subject-diffusion: Open domain personalized text-to-image generation without test-time fine-tuning	arxiv 2023	[project] [code]
BoxDiff: Text-to-Image Synthesis with Training-Free Box-Constrained Diffusion	ICCV 2023	[code]
Adding Conditional Control to Text-to-Image Diffusion Models	ICCV 2023	[code]

2. Image Translation

Paper	Source	Code/Project Link
Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks	ICCV 2017	[project] [code]
Image-to-Image Translation with Conditional Adversarial Networks	CVPR 2017	[project] [code]
DeepFaceDrawing: Deep generation of face images from sketches	SIGGRAPH/TOG 2020	[project] [code]
CoCosNet: Cross-domain Correspondence Learning for Exemplar-based Image Translation	CVPR 2020	[project] [code]
CoCosNet v2: Full-Resolution Correspondence Learning for Image Translation	CVPR 2021	[code]
StyleCLIP: Text-Driven Manipulation of StyleGAN Imagery	ICCV 2021	[code]
Encoding in Style: a StyleGAN Encoder for Image-to-Image Translation	CVPR 2021	[code]
RABIT: Bi-level Feature Alignment for Versatile Image Translation and Manipulation	ECCV 2022	[code]
DynaST: Dynamic Sparse Transformer for Exemplar-Guided Image Generation	ECCV 2022	[code]
DiffusionCLIP: Text-Guided Diffusion Models for Robust Image Manipulation	CVPR 2022	[code]
CLIP-PAE: Projection-Augmentation Embedding to Extract Relevant Features for a Disentangled, Interpretable and Controllable Text-Guided Face Manipulation	SIGGRAPH 2023	[project] [code]
Masked and Adaptive Transformer for Exemplar Based Image Translation	CVPR 2023	[code]
Diffusion-based Image Translation using Disentangled Style and Content Representation	ICLR 2023	[code]

3. Image Inpainting

Paper	Source	Code/Project Link
RePaint: Inpainting using Denoising Diffusion Probabilistic Models	CVPR 2022	[code]
MAT: Mask-Aware Transformer for Large Hole Image Inpainting	CVPR 2022	[code]
Imagen Editor and EditBench: Advancing and Evaluating Text-Guided Image Inpainting	CVPR 2023	[project]
SmartBrush: Text and Shape Guided Object Inpainting with Diffusion Model	CVPR 2023	Not open-sourced

4. Image Colorization

Paper	Source	Code/Project Link
Disentangled Image Colorization via Global Anchors	SIGGRAPH Asia/TOG 2022	[project] [code] [demo]
BigColor:Colorization using a Generative Color Prior for Natural Images	ECCV 2022	[code]
Unsupervised Deep Exemplar Colorization via Pyramid Dual Non-local Attention	TIP 2023	[code]
DDColor: Towards Photo-Realistic Image Colorization via Dual Decoders	ICCV 2023	[code] [demo]

5. Image Editing

Paper	Source	Code/Project Link
User-Controllable Latent Transformer for StyleGAN Image Layout Editing	Computer Graphics Forum 2022	[code]
InstructPix2Pix: Learning to Follow Image Editing Instructions	CVPR 2023	[code]
MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editing	NeurIPS 2023	[project] [code]
Diffusion Self-Guidance for Controllable Image Generation	NeurIPS 2023	[project] [demo]
Drag Your GAN: Interactive Point-based Manipulation on the Generative Image Manifold	SIGGRAPH 2023	[project] [code]
DragDiffusion: Harnessing Diffusion Models for Interactive Point-based Image Editing	arxiv 2023	[code]
DragonDiffusion: Enabling Drag-style Manipulation on Diffusion Models	arxiv 2023	[project] [code]
FreeDrag: Point Tracking is Not What You Need for Interactive Point-based Image Editing	arxiv 2023	[project] [code] [demo]