Skip to content

Light weight convolutional neural networks and Keras based ELM (extreme learning machine)

License

Notifications You must be signed in to change notification settings

radu-dogaru/LightWeight_Binary_CNN_and_ELM_Keras

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

5 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

LightWeight_Binary_CNN_and_ELM_Keras

Three notebooks are stored in this repository, related to the following paper:

[1] Radu Dogaru and Ioana Dogaru, "BCONV-ELM: Binary Weights Convolutional Neural Network Simulator based on Keras/Tensorflow, for Low Complexity Implementations", Proceedings of the ISEEE 2019 conference, submitted.

Please cite the above paper if you find this code useful.

A brief decription of the notebooks (all were tested under the Kaggle platform but may run on any other providing a Python environment with TENSORFLOW, KERAS, NUMPY installed):

  1. BCONV_ELM - allows the design of a lightweight CNN with 2 convolutional+pooling layers. The optimization of the binary kernels is done while maximizing the accuracy of an extreme learning machine (used here for its fast learning). After that, a linear (optionally up to 2 hidden layers may be added) perceptron network (for reduced complexity) is trained at the output of the convolutional expander. The resulting model is well suited for hardware orineted implementations (e.g. FPGA, microcontrollers etc.)

  2. ELM_Keras: a convenient implementation of the Extreme Learning Machine including the case with no hidden layer and quantization of weights for resource-constrained platforms). This cell is extracted from the above notebook and to be used independently on any desired dataset. Since it supports GPU, very fast learning (under one minute) is achieved for medium sized datasest. It is not recommended for very big data since it requires a lot of RAM on the device.

  3. L-CNN: the trainable version of the BCONV-ELM: it trains standard Keras/Tensorflow models for a lightweight CNN (L-CNN) with up to 3 convolution layers and a linear output perceptron (2 more hidden layers could be added but the lowest complexity implementation is achieved for no hidden layers). Some cells for loading various datasetes are provided inside

About

Light weight convolutional neural networks and Keras based ELM (extreme learning machine)

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published