Inception V3 by Google is the 3rd version in a series of Deep Learning Convolutional Architectures. Inception V3 was trained using a dataset of 1,000 classes (See the list of classes here) from the original ImageNet dataset which was trained with over 1 million training images, the Tensorflow version has 1,001 classes which is due to an additional "background' class not used in the original ImageNet. Inception V3 was trained for the ImageNet Large Visual Recognition Challenge where it was a first runner up.
This article will take you through some information about Inception V3, transfer learning, and how we use these tools in the Acute Myeloid & Lymphoblastic Leukemia AI Research Project.
Convolutional neural networks are a type of deep learning neural network. These types of neural nets are widely used in computer vision and have pushed the capabilities of computer vision over the last few years, performing exceptionally better than older, more traditional neural networks; however, studies show that there are trade-offs related to training times and accuracy.
Figure 2. Inception V3 Transfer Learning (Source).
Transfer learning allows you to retrain the final layer of an existing model, resulting in a significant decrease in not only training time, but also the size of the dataset required. One of the most famous models that can be used for transfer learning is the Inception V3 model created by Google This model was trained on thousands of images from 1,001 classes on some very powerful devices. Being able to retrain the final layer means that you can maintain the knowledge that the model had learned during its original training and apply it to your smaller dataset, resulting in highly accurate classifications without the need for extensive training and computational power.
TF-Slim is a high-level API for Tensorflow that allows you to program, train and evaluate Convolutional Neural Networks. TF-Slim is a lightweight API so is well suited for lower powered devices.
Github: TensorFlow-Slim image classification model library
The Acute Myeloid & Lymphoblastic Leukemia AI Research Project Movidius NCS1 Classifier uses the following classes from the TensorFlow-Slim image classification model library:
In the project you will find these files in the https://github.com/AMLResearchProject/AML-ALL-Classifiers/tree/master/Python/_Movidius/NCS/Classes directory.
The inception_preprocessing file provides the tools required to preprocess both training and evaluation images allowing them to be used with Inception Networks.
Project Location: AML-ALL-Classifiers/Python/_Movidius/NCS/Classes/inception_preprocessing.py
The inception_utils class file utility code that is common across all Inception versions.
Project Location: AML-ALL-Classifiers/Python/_Movidius/NCS/Classes/inception_utils.py
The inception_v3 file provides the code required to create an Inception V3 network.
Project Location: AML-ALL-Classifiers/Python/_Movidius/NCS/Classes/inception_v3.py
In this file you will find the inception_v3 function provided by Tensorflow, this function produces the exact Inception model from Rethinking the Inception Architecture for Computer Vision written by Christian Szegedy, Vincent Vanhoucke, Sergey Ioffe, Jonathon Shlens, Zbigniew Wojna.
In projects that use Intel Movidius NCS/NC2, it is required to freeze the model, a technique mostly used for deploying Tensorflow models to mobile devices. Freezing a model basically removes unrequired/unused nodes such as training specific nodes etc. To find out more about model freezing, you can visit the Preparing models for mobile deployment Tensorflow tutorial, to find the related project code you can check out the Movidius NCS training program. The training program uses TF-Slim to produce a graph and uses graph_util.convert_variables_to_constants to create a Tensorflow GraphDef, saves it as a .pb file in the model directory.
The Peter Moss Acute Myeloid & Lymphoblastic Leukemia AI Research project encourages and welcomes code contributions, bug fixes and enhancements from the Github.
Please read the CONTRIBUTING document for a full guide to forking our repositories and submitting your pull requests. You will also find information about our code of conduct on this page.
The following Peter Moss Acute Myeloid & Lymphoblastic Leukemia AI Research project team members have contributed towards this repository:
- Adam Milton-Barker - Bigfinite IoT Network Engineer & Intel Software Innovator, Barcelona, Spain
- Salvatore Raieli - PhD Immunolgy / Bioinformaticia, Bologna, Italy
- Dr Amita Kapoor - Delhi University, Delhi, India
The following AML/ALL AI Student Program Students & Research Interns have contributed towards this repository:
- Taru Jain - Pre-final year undergraduate pursuing B.Tech in IT
We use SemVer for versioning. For the versions available, see Releases.
This project is licensed under the MIT License - see the LICENSE file for details.
We use the repo issues to track bugs and general requests related to using this project.