TensorFlow Model Optimization 0.8.0

TFMOT 0.8.0 forces users to use the keras v2 version.

• Fix structural pruning sparsity notebook
• Remove private Keras imports.
• Redirect TF references.
• Fix broken tests.
• Tested against TensorFlow 2.14.1, and nightly on Python 3.

TensorFlow Model Optimization 0.7.5

TFMOT 0.7.5 fixes compatibility issues with new keras.

• Fixed improper serialization code route for functional models.
• Created a local copy of keras.utils.generic_utils.to_snake_case.
• Handled the error type reflect to the keras update.
• Fixed compatibility issues for the TF/Keras 2.13.

TensorFlow Model Optimization 0.7.4

TFMOT 0.7.4 add from_config method to QuantizeConfig class since the new keras serialization enforces it.

TensorFlow Model Optimization 0.7.3

TFMOT 0.7.3 add remove_input_range method that removes input range after apply quantize.

TensorFlow Model Optimization 0.7.2

TFMOT 0.7.2 removes support for the PeepholeLSTMCell layer, that was removed in Keras.

TensorFlow Model Optimization 0.7.1

TFMOT 0.7.1 fixes a bug in tensor_encoding in 9e4c106.

TensorFlow Model Optimization 0.7.0

TFMOT 0.7.0 adds updates for Quantization Aware Training (QAT) and Pruning API. Adds support for structured (MxN) pruning.
QAT now also has support for layers with swish activations and ability to disable per-axis quantization in the default 8bit scheme.
Adds support for combining pruning, QAT and weight clustering.

Keras Quantization API:
Tested against TensorFlow 2.6.0, 2.5.1 and nightly with Python 3.

• Added QuantizeWrapperV2 class which preserves order of weights is the default for quantize_apply.
• Added a flag to disable per-axis quantizers in default8_bit scheme.
• Added swish as supported activation.

Keras pruning API:
Tested against TensorFlow 2.6.0, 2.5.1 and nightly with Python 3.

• Added structural pruning with MxN sparsity.

Keras clustering API:

• Added support for RNNSimple, LSTM, GRU, StackedRNNCells, PeepholeLSTMCell, and Bidirectional layers.
• Updated and fixed sparsity-preserving clustering.
• Added an experimental quantization schemes for Quantization Aware Training for collaborative model.optimization:
  • Pruning-Clustering-preserving QAT: pruned and clustered model can be QAT trained with preserved sparsity and the number of clusters.
• Updated Clustering initialization default to KMEANS_PLUS_PLUS.

TensorFlow Model Optimization 0.6.0

Actual commit for release: d6556c2

TFMOT 0.6.0 adds some additional features for Quantization Aware Training.
Adds support for overriding and subclassing default quantization
schemes. Adds input quantizer for annotated quantized layers without annotated
input layers. Also adds pruning policy for pruning registries
for different hardware supports. Also adds Conv2DTranspose support and tanh
activations.

Keras quantization API:
Tested against TensorFlow 2.4.2, 2.5.0 and nightly with Python 3.

Keras pruning API:
Tested against TensorFlow 2.4.2, 2.5.0 and nightly with Python 3.

Keras clustering API:

• Added ClusteringSummaries to create additional output for the clustering
  progress for TensorBoard.
• Added ClusterableLayer API to support clustering of a keras custom layer.
  In addition, now clustering can be done for bias of the layer.
• Introduced two new experimental quantization schemes for Quantization Aware Training
  for collaborative model optimization:
  • Prune Preserve QAT: pruned model can be QAT trained with preserved sparsity;
  • Cluster Preserve QAT: clustered model can be QAT trained with preserved clustering;
• Added a new feature to clustering: average gradient aggregation, which can
  improve performance for some models.
• Updated clustering results in the documentation.
• Tested against TensorFlow 1.14.0, 2.0.0, and nightly, and Python 3.

TensorFlow Model Optimization 0.5.0

Actual commit for release: 525accb.

TFMOT 0.5.0 adds some additional features for Quantization Aware Training. QAT now supports Keras layers SeparableConv2D and SeparableConv1D. It also provides a new Quantizer AllValuesQuantizer which allows for more flexibility with range selection.

Keras clustering API:
Tested against TensorFlow 1.14.0 and 2.3.0 with Python 3.

Keras quantization API:
Tested against TensorFlow 2.3.0 with Python 3.

Keras pruning API:
Tested against TensorFlow 1.14.0 and 2.3.0 with Python 3.

TensorFlow Model Optimization 0.4.1

TFMOT 0.4.1 fixes a bug which makes 0.4.0 quantization code fail when run against tf-nightly since July 31, 2020. The code now works against different versions on TF, and is not broken by changes to smart_cond in core TF.

Keras clustering API:

• Tested against TensorFlow 1.14.0, 2.0.0, and nightly, and Python 3.

Keras quantization API:

• Tested against TensorFlow nightly, and Python 3.

Keras pruning API:

• Tested against TensorFlow 1.14.0, 2.0.0, and nightly, and Python 3.