Skip to content

This repository contain various types of attention mechanism like Bahdanau , Soft attention , Additive Attention , Hierarchical Attention etc in Pytorch, Tensorflow, Keras

Notifications You must be signed in to change notification settings

monk1337/Various-Attention-mechanisms

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

59 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Various-Attention-mechanisms

This repository contain various types of attention mechanism like Bahdanau , Soft attention , Additive Attention , Hierarchical Attention etc in Pytorch & Tensorflow, Keras

Papers, research and study

Research Paper Python Code
Paper Code

Luong attention and Bahdanau attention

My cool logo

My cool logo

My cool logo

working on an attetion module for tensorflow where you can just import the attention, check it out and contribute :

https://github.com/monk1337/Tensorflow-Attention-mechanisms

#Images source : http://cnyah.com/2017/08/01/attention-variants/