Papers about deep learning ordered by task, date. Current state-of-the-art papers and papers useful for getting started are labelled. For each paper there is a permanent link, which is either to Arxiv.org or to a copy of the original paper in this repository.
-
1.1. Code Generation
-
2.1. Summarization
2.2. Taskbots
2.3. Classification
2.4. Question Answering
2.5. Sentiment Analysis
2.6. Translation
2.7. Chatbots
2.8. Reasoning
-
3.1. Gaming
3.2. Style Transfer
3.3. Object Tracking
3.4. Visual Question Answering
3.5. Image Segmentation
3.6. Text (in the Wild) Recognition
3.7. Brain Computer Interfacing
3.8. Self-Driving Cars
3.9. Object Recognition
3.10. Logo Recognition
3.11. Super Resolution
3.12. Pose Estimation
3.13. Image Captioning
3.14. Image Compression
3.15. Image Synthesis
3.16. Face Recognition
-
4.1. Audio Synthesis
-
5.1. Unclassified
5.2. Regularization
5.3. Neural Network Compression
5.4. Optimizers
| Title | Date | Paper | Code | Labels |
|---|---|---|---|---|
| DeepAM: Migrate APIs with Multi-modal Sequence to Sequence Learning | 25 apr 2017 | arxiv | None | |
| A Syntactic Neural Model for General-Purpose Code Generation | 6 apr 2017 | arxiv | None | |
| RobustFill: Neural Program Learning under Noisy I/O | 21 mar 2017 | arxiv | None | |
| DeepFix: Fixing Common C Language Errors by Deep Learning | 12 feb 2017 | paper | None | |
| DeepCoder: Learning to Write Programs | 7 nov 2016 | arxiv | None | |
| Neuro-Symbolic Program Synthesis | 6 nov 2016 | arxiv | None | |
| Deep API Learning | 27 may 2016 | arxiv | None |
| Title | Date | Paper | Code | Labels |
|---|---|---|---|---|
| PassGAN: A Deep Learning Approach for Password Guessing | 1 sep 2017 | arxiv | None | |
| Deep Android Malware Detection | 22 mar 2016 | paper | github | None |
| Droid-Sec: Deep Learning in Android Malware Detection | 17 aug 2014 | paper | github | None |
| Title | Date | Paper | Code | Labels |
|---|---|---|---|---|
| A Deep Reinforced Model for Abstractive Summarization | 11 may 2017 | arxiv | None | |
| Get To The Point: Summarization with Pointer-Generator Networks | 14 apr 2017 | arxiv | None | |
| SummaRuNNer: A Recurrent Neural Network based Sequence Model for Extractive Summarization of Documents | 14 nov 2016 | arxiv | None |
| Title | Date | Paper | Code | Labels |
|---|---|---|---|---|
| Composite Task-Completion Dialogue Policy Learning via Hierarchical Deep Reinforcement Learning | 10 apr 2017 | arxiv | github | None |
| End-to-End Task-Completion Neural Dialogue Systems | 3 mar 2017 | arxiv | github | None |
| Title | Date | Paper | Code | Labels |
|---|---|---|---|---|
| A Large Self-Annotated Corpus for Sarcasm | 19 apr 2017 | arxiv | None | |
| ConceptNet at SemEval-2017 Task 2: Extending Word Embeddings with Multilingual Relational Knowledge | 11 apr 2017 | arxiv | None | |
| Bilateral Multi-Perspective Matching for Natural Language Sentences | 13 feb 2017 | arxiv | None | |
| FastText.zip: Compressing text classification models | 12 dec 2016 | arxiv | None | |
| ConceptNet 5.5: An Open Multilingual Graph of General Knowledge | 12 dec 2016 | arxiv | None | |
| A Simple but Tough-to-Beat Baseline for Sentence Embeddings | 4 nov 2016 | paper | github | None |
| Enriching Word Vectors with Subword Information | 15 jul 2016 | arxiv | None | |
| From Word Embeddings To Document Distances | 6 jul 2016 | paper | github | None |
| Bag of Tricks for Efficient Text Classification | 6 jul 2016 | arxiv | None | |
| Character-level Convolutional Networks for Text Classification | 4 sep 2015 | arxiv | None | |
| GloVe: Global Vectors for Word Representation | 25 may 2015 | paper | github | None |
| Improved Semantic Representations From Tree-Structured Long Short-Term Memory Networks | 28 feb 2015 | arxiv | None | |
| Distributed Representations of Sentences and Documents | 16 may 2014 | arxiv | None | |
| Efficient Estimation of Word Representations in Vector Space | 16 jan 2013 | arxiv | None | |
| SimHash: Hash-based Similarity Detection | 13 dec 2007 | paper | None |
| Title | Date | Paper | Code | Labels |
|---|---|---|---|---|
| IRGAN: A Minimax Game for Unifying Generative and Discriminative Information Retrieval Models | 30 may 2017 | arxiv | github |  |
| Title | Date | Paper | Code | Labels |
|---|---|---|---|---|
| Rationalizing Neural Predictions | 13 jun 2016 | arxiv | None | |
| Recursive Deep Models for Semantic Compositionality Over a Sentiment Treebank | 18 okt 2013 | paper | None |
| Title | Date | Paper | Code | Labels |
|---|---|---|---|---|
| Attention Is All You Need | 12 jun 2017 | arxiv | |
|
| Convolutional Sequence to Sequence Learning | 8 may 2017 | arxiv | github | |
| Google's Multilingual Neural Machine Translation System: Enabling Zero-Shot Translation | 14 nov 2016 | arxiv | None | |
| A Convolutional Encoder Model for Neural Machine Translation | 7 nov 2016 | arxiv | None | |
| Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation | 26 sep 2016 | arxiv | None | |
| Neural Machine Translation by Jointly Learning to Align and Translate | 1 sep 2014 | arxiv | None |
| Title | Date | Paper | Code | Labels |
|---|---|---|---|---|
| A Deep Reinforcement Learning Chatbot | 7 sep 2017 | arxiv | None | |
| A Neural Conversational Model | 19 jun 2015 | arxiv | github | None |
| Title | Date | Paper | Code | Labels |
|---|---|---|---|---|
| Tracking the World State with Recurrent Entity Networks | 12 dec 2016 | arxiv | None |
| Title | Date | Paper | Code | Labels |
|---|---|---|---|---|
| Phase-Functioned Neural Networks for Character Control | 1 may 2017 | paper | None | |
| Equivalence Between Policy Gradients and Soft Q-Learning | 21 apr 2017 | arxiv |  |
|
| Beating Atari with Natural Language Guided Reinforcement Learning | 18 apr 2017 | arxiv | |
|
| Learning from Demonstrations for Real World Reinforcement Learning | 12 apr 2017 | arxiv | |
|
| FeUdal Networks for Hierarchical Reinforcement Learning | 3 mar 2017 | arxiv | |
|
| Overcoming catastrophic forgetting in neural networks | 2 dec 2016 | arxiv | |
|
| Playing Doom with SLAM-Augmented Deep Reinforcement Learning | 1 dec 2016 | arxiv | None | |
| Playing FPS Games with Deep Reinforcement Learning | 18 sep 2016 | arxiv | None | |
| DeepChess: End-to-End Deep Neural Network for Automatic Learning in Chess | 16 aug 2016 | paper | None | |
| Generative Adversarial Imitation Learning | 10 jun 2016 | arxiv | None | |
| Dueling Network Architectures for Deep Reinforcement Learning | 20 nov 2015 | arxiv | |
|
| Prioritized Experience Replay | 18 nov 2015 | arxiv | None | |
| Human-level control through deep reinforcement learning | 26 feb 2015 | paper | |
|
| Playing Atari with Deep Reinforcement Learning | 19 dec 2013 | arxiv | |
| Title | Date | Paper | Code | Labels |
|---|---|---|---|---|
| Deep Photo Style Transfer | 22 mar 2017 | arxiv | None | |
| Arbitrary Style Transfer in Real-time with Adaptive Instance Normalization | 20 mar 2017 | arxiv | github | None |
| A Learned Representation For Artistic Style | 24 okt 2016 | arxiv | None | |
| Instance Normalization: The Missing Ingredient for Fast Stylization | 27 jul 2016 | arxiv | None | |
| Perceptual Losses for Real-Time Style Transfer and Super-Resolution | 27 mar 2016 | arxiv | github | None |
| A Neural Algorithm of Artistic Style | 26 aug 2015 | arxiv | github | None |
| Title | Date | Paper | Code | Labels |
|---|---|---|---|---|
| End-to-end representation learning for Correlation Filter based tracking | 20 apr 2017 | arxiv | github | None |
| Title | Date | Paper | Code | Labels |
|---|---|---|---|---|
| VQA: Visual Question Answering | 3 may 2015 | arxiv | None |
| Title | Date | Paper | Code | Labels |
|---|---|---|---|---|
| Dilated Residual Networks | 22 jul 2017 | paper | None | |
| SfM-Net: Learning of Structure and Motion from Video | 25 apr 2017 | arxiv | None | |
| Semi and Weakly Supervised Semantic Segmentation Using Generative Adversarial Network | 28 mar 2017 | arxiv | None | |
| Mask R-CNN | 20 mar 2017 | arxiv | |
|
| Learning Features by Watching Objects Move | 19 dec 2016 | arxiv | |
|
| RefineNet: Multi-Path Refinement Networks for High-Resolution Semantic Segmentation | 20 nov 2016 | arxiv | github | None |
| UberNet: Training a `Universal' Convolutional Neural Network for Low-, Mid-, and High-Level Vision using Diverse Datasets and Limited Memory | 7 sep 2016 | arxiv | None | |
| DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs | 2 jun 2016 | arxiv | None | |
| Fully Convolutional Networks for Semantic Segmentation | 20 may 2016 | arxiv | github | None |
| Instance-aware Semantic Segmentation via Multi-task Network Cascades | 14 dec 2015 | arxiv | None | |
| Multi-Scale Context Aggregation by Dilated Convolutions | 23 nov 2015 | arxiv | None | |
| SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation | 2 nov 2015 | arxiv | None | |
| U-Net: Convolutional Networks for Biomedical Image Segmentation | 18 may 2015 | arxiv | None | |
| Semantic Image Segmentation with Deep Convolutional Nets and Fully Connected CRFs | 22 dec 2014 | arxiv | None | |
| Learning Rich Features from RGB-D Images for Object Detection and Segmentation | 22 jul 2014 | arxiv | None |
| Title | Date | Paper | Code | Labels |
|---|---|---|---|---|
| OCR Error Correction Using Character Correction and Feature-Based Word Classification | 21 apr 2016 | arxiv | None | |
| Recursive Recurrent Nets with Attention Modeling for OCR in the Wild | 9 mar 2016 | arxiv | None | |
| COCO-Text: Dataset and Benchmark for Text Detection and Recognition in Natural Images | 26 jan 2016 | arxiv | None | |
| Efficient Scene Text Localization and Recognition with Local Character Refinement | 14 apr 2015 | arxiv | None | |
| Reading Text in the Wild with Convolutional Neural Networks | 4 dec 2014 | arxiv | None | |
| Synthetic Data and Artificial Neural Networks for Natural Scene Text Recognition | 9 jun 2014 | arxiv | None |
| Title | Date | Paper | Code | Labels |
|---|---|---|---|---|
| Deep learning with convolutional neural networks for brain mapping and decoding of movement-related information from the human EEG | 15 mar 2017 | arxiv | None | |
| Encoding Voxels with Deep Learning | 2 dec 2015 | paper | None | |
| Deep Neural Networks Reveal a Gradient in the Complexity of Neural Representations across the Ventral Stream | 8 jul 2015 | paper | None |
| Title | Date | Paper | Code | Labels |
|---|---|---|---|---|
| Computer Vision for Autonomous Vehicles: Problems, Datasets and State-of-the-Art | 18 apr 2017 | arxiv | None | |
| End to End Learning for Self-Driving Cars | 25 apr 2016 | arxiv | None |
| Title | Date | Paper | Code | Labels |
|---|---|---|---|---|
| Focal Loss for Dense Object Detection | 7 aug 2017 | arxiv | None | |
| Introspective Classifier Learning: Empower Generatively | 25 apr 2017 | arxiv | None | |
| Learning Chained Deep Features and Classifiers for Cascade in Object Detection | 23 feb 2017 | arxiv | None | |
| DSSD : Deconvolutional Single Shot Detector | 23 jan 2017 | arxiv |  |
|
| YOLO9000: Better, Faster, Stronger | 25 dec 2016 | arxiv | github | |
| Feature Pyramid Networks for Object Detection | 9 dec 2016 | arxiv | |
|
| Speed/accuracy trade-offs for modern convolutional object detectors | 30 nov 2016 | arxiv | None | |
| Aggregated Residual Transformations for Deep Neural Networks | 16 nov 2016 | arxiv | None | |
| Aggregated Residual Transformations for Deep Neural Networks | 16 nov 2016 | arxiv | None | |
| Hierarchical Object Detection with Deep Reinforcement Learning | 11 nov 2016 | arxiv | |
|
| Xception: Deep Learning with Depthwise Separable Convolutions | 7 okt 2016 | arxiv | None | |
| Learning to Make Better Mistakes: Semantics-aware Visual Food Recognition | 1 okt 2016 | paper | None | |
| Densely Connected Convolutional Networks | 25 aug 2016 | arxiv | None | |
| Residual Networks of Residual Networks: Multilevel Residual Networks | 9 aug 2016 | arxiv | None | |
| Context Matters: Refining Object Detection in Video with Recurrent Neural Networks | 15 jul 2016 | arxiv | None | |
| R-FCN: Object Detection via Region-based Fully Convolutional Networks | 20 may 2016 | arxiv | None | |
| Training Region-based Object Detectors with Online Hard Example Mining | 12 apr 2016 | arxiv | None | |
| T-CNN: Tubelets with Convolutional Neural Networks for Object Detection from Videos | 9 apr 2016 | arxiv | None | |
| Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning | 23 feb 2016 | arxiv | None | |
| Deep Residual Learning for Image Recognition | 10 dec 2015 | arxiv | None | |
| SSD: Single Shot MultiBox Detector | 8 dec 2015 | arxiv | |
|
| Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs) | 23 nov 2015 | arxiv | None | |
| ParseNet: Looking Wider to See Better | 15 jun 2015 | arxiv | None | |
| You Only Look Once: Unified, Real-Time Object Detection | 8 jun 2015 | arxiv | |
|
| Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks | 4 jun 2015 | arxiv | |
|
| Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification | 6 feb 2015 | arxiv | None | |
| Deep Image: Scaling up Image Recognition | 13 jan 2015 | arxiv | None | |
| Rich feature hierarchies for accurate object detection and semantic segmentation | 11 nov 2013 | arxiv | None | |
| Selective Search for Object Recognition | 11 mar 2013 | paper | None | |
| ImageNet Classification with Deep Convolutional Neural Networks | 3 dec 2012 | paper |  |
| Title | Date | Paper | Code | Labels |
|---|---|---|---|---|
| Deep Learning Logo Detection with Data Expansion by Synthesising Context | 29 dec 2016 | arxiv | None | |
| Automatic Graphic Logo Detection via Fast Region-based Convolutional Networks | 20 apr 2016 | arxiv | None | |
| LOGO-Net: Large-scale Deep Logo Detection and Brand Recognition with Deep Region-based Convolutional Networks | 8 nov 2015 | arxiv | None | |
| DeepLogo: Hitting Logo Recognition with the Deep Neural Network Hammer | 7 okt 2015 | arxiv | None |
| Title | Date | Paper | Code | Labels |
|---|---|---|---|---|
| Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Network | 16 sep 2016 | arxiv | None | |
| Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network | 15 sep 2016 | arxiv | None | |
| RAISR: Rapid and Accurate Image Super Resolution | 3 jun 2016 | arxiv | None | |
| Perceptual Losses for Real-Time Style Transfer and Super-Resolution | 27 mar 2016 | arxiv | github | None |
| Image Super-Resolution Using Deep Convolutional Networks | 31 dec 2014 | arxiv | None |
| Title | Date | Paper | Code | Labels |
|---|---|---|---|---|
| Forecasting Human Dynamics from Static Images | 11 apr 2017 | arxiv | None | |
| Fast Single Shot Detection and Pose Estimation | 19 sep 2016 | arxiv | None | |
| Convolutional Pose Machines | 30 jan 2016 | arxiv | None | |
| Flowing ConvNets for Human Pose Estimation in Videos | 9 jun 2015 | arxiv | None |
| Title | Date | Paper | Code | Labels |
|---|---|---|---|---|
| Actor-Critic Sequence Training for Image Captioning | 29 jun 2017 | arxiv | None | |
| Detecting and Recognizing Human-Object Interactions | 24 apr 2017 | arxiv | None | |
| Deep Reinforcement Learning-based Image Captioning with Embedding Reward | 12 apr 2017 | arxiv | |
|
| Towards Diverse and Natural Image Descriptions via a Conditional GAN | 17 mar 2017 | arxiv | None | |
| Temporal Tessellation: A Unified Approach for Video Analysis | 21 dec 2016 | arxiv | github | None |
| Self-critical Sequence Training for Image Captioning | 2 dec 2016 | arxiv | None | |
| Generation and Comprehension of Unambiguous Object Descriptions | 7 nov 2015 | arxiv | None | |
| Show, Attend and Tell: Neural Image Caption Generation with Visual Attention | 10 feb 2015 | arxiv | None | |
| Long-term Recurrent Convolutional Networks for Visual Recognition and Description | 17 nov 2014 | arxiv | None |
| Title | Date | Paper | Code | Labels |
|---|---|---|---|---|
| Full Resolution Image Compression with Recurrent Neural Networks | 18 aug 2016 | arxiv | None |
| Title | Date | Paper | Code | Labels |
|---|---|---|---|---|
| A Neural Representation of Sketch Drawings | 11 apr 2017 | arxiv | None | |
| BEGAN: Boundary Equilibrium Generative Adversarial Networks | 31 mar 2017 | arxiv | github | None |
| Improved Training of Wasserstein GANs | 31 mar 2017 | arxiv | None | |
| Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks | 30 mar 2017 | arxiv | github | None |
| Wasserstein GAN | 26 jan 2017 | arxiv | None | |
| RenderGAN: Generating Realistic Labeled Data | 4 nov 2016 | arxiv | None | |
| Conditional Image Generation with PixelCNN Decoders | 16 jun 2016 | arxiv | None | |
| Pixel Recurrent Neural Networks | 25 jan 2016 | arxiv | None | |
| Generative Adversarial Networks | 10 jun 2014 | arxiv | None |
| Title | Date | Paper | Code | Labels |
|---|---|---|---|---|
| Accessorize to a Crime: Real and Stealthy Attacks on State-of-the-Art Face Recognition | 24 okt 2016 | paper | None | |
| OpenFace: A general-purpose face recognition library with mobile applications | 1 jun 2016 | paper | None | |
| Emotion Recognition in the Wild via Convolutional Neural Networks and Mapped Binary Patterns | 9 nov 2015 | paper | None | |
| Deep Face Recognition | 7 sep 2015 | paper | None | |
| Compact Convolutional Neural Network Cascade for Face Detection | 6 aug 2015 | arxiv | None | |
| Learning Robust Deep Face Representation | 17 jul 2015 | arxiv | None | |
| Facenet: A unified embedding for face recognition and clustering | 12 jun 2015 | paper | None | |
| Multi-view Face Detection Using Deep Convolutional Neural Networks | 10 feb 2015 | arxiv | None |
| Title | Date | Paper | Code | Labels |
|---|---|---|---|---|
| Deep Cross-Modal Audio-Visual Generation | 26 apr 2017 | arxiv | None | |
| A Neural Parametric Singing Synthesizer | 12 apr 2017 | arxiv | None | |
| Neural Audio Synthesis of Musical Notes with WaveNet Autoencoders | 5 apr 2017 | arxiv | github | None |
| Tacotron: Towards End-to-End Speech Synthesis | 29 mar 2017 | arxiv | github | None |
| Deep Voice: Real-time Neural Text-to-Speech | 25 feb 2017 | arxiv | None | |
| WaveNet: A Generative Model for Raw Audio | 12 sep 2016 | arxiv | github | None |
| Title | Date | Paper | Code | Labels |
|---|---|---|---|---|
| A simple neural network module for relational reasoning | 5 jun 2017 | arxiv | |
|
| Deep Complex Networks | 27 may 2017 | arxiv | github | None |
| Learning to Fly by Crashing | 19 apr 2017 | arxiv | None | |
| Who Said What: Modeling Individual Labelers Improves Classification | 26 mar 2017 | arxiv | None | |
| Semi-supervised Knowledge Transfer for Deep Learning from Private Training Data | 18 okt 2016 | arxiv | None | |
| DeepMath - Deep Sequence Models for Premise Selection | 14 jun 2016 | arxiv | None | |
| Unsupervised CNN for Single View Depth Estimation: Geometry to the Rescue | 16 mar 2016 | arxiv | None | |
| Long Short-Term Memory | 15 nov 1997 | paper | None |
| Title | Date | Paper | Code | Labels |
|---|---|---|---|---|
| Self-Normalizing Neural Networks | 8 jun 2017 | arxiv | |
|
| Concrete Dropout | 22 may 2017 | arxiv | github | None |
| Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learning | 6 jun 2015 | arxiv | None | |
| Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift | 11 feb 2015 | arxiv | None |
| Title | Date | Paper | Code | Labels |
|---|---|---|---|---|
| Design of Efficient Convolutional Layers using Single Intra-channel Convolution, Topological Subdivisioning and Spatial "Bottleneck" Structure | 15 aug 2016 | arxiv | None | |
| SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5MB model size | 24 feb 2016 | arxiv | None | |
| Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and Huffman Coding | 1 okt 2015 | arxiv | None |
| Title | Date | Paper | Code | Labels |
|---|---|---|---|---|
| Accurate, Large Minibatch SGD: Training ImageNet in 1 Hour | 8 jun 2017 | arxiv | |
|
| Equilibrated adaptive learning rates for non-convex optimization | 15 feb 2015 | arxiv | None | |
| Adam: A Method for Stochastic Optimization | 22 dec 2014 | arxiv | None | |
| Deep learning with Elastic Averaging SGD | 20 dec 2014 | arxiv | None | |
| ADADELTA: An Adaptive Learning Rate Method | 22 dec 2012 | arxiv | None | |
| Advances in Optimizing Recurrent Networks | 4 dec 2012 | arxiv | None | |
| Efficient Backprop | 1 jul 1998 | paper | |