From 27331cb245add08251ace74c1e6b3b8572fe36e9 Mon Sep 17 00:00:00 2001 From: Xinyu Chen Date: Wed, 26 Feb 2020 06:56:55 +0800 Subject: [PATCH] [DOC] add int8 command (#1174) --- scripts/bert/index.rst | 24 ++++++++++++------------ 1 file changed, 12 insertions(+), 12 deletions(-) diff --git a/scripts/bert/index.rst b/scripts/bert/index.rst index 0b92d59b0f..09125cf607 100644 --- a/scripts/bert/index.rst +++ b/scripts/bert/index.rst @@ -223,22 +223,22 @@ version of `mxnet-mkl `__ | ++-----------+-------------------+---------------+---------------+---------+---------+------------------------------------------------------------------------------------------------------------------------+ +| SST-2 | bert_12_768_12 | 93.23 | 93.00 | | |`command `__ | ++-----------+-------------------+---------------+---------------+---------+---------+------------------------------------------------------------------------------------------------------------------------+ Question Answering ++++++++++++++++++ -+-----------+-------------------+---------+---------+---------+---------+-----+---------+ -| Dataset | Model | FP32 EM | INT8 EM | FP32 F1 | INT8 F1 | Log | Command | -+===========+===================+=========+=========+=========+=========+=====+=========+ -| SQuAD 1.1 | bert_12_768_12 | 81.18 | 80.32 | 88.58 | 88.10 | | | -+-----------+-------------------+---------+---------+---------+---------+-----+---------+ ++-----------+-------------------+---------+---------+---------+---------+----------------------------------------------------------------------------------------------------------------------------+ +| Dataset | Model | FP32 EM | INT8 EM | FP32 F1 | INT8 F1 | Command | ++===========+===================+=========+=========+=========+=========+============================================================================================================================+ +| SQuAD 1.1 | bert_12_768_12 | 81.18 | 80.32 | 88.58 | 88.10 |`command `__ | ++-----------+-------------------+---------+---------+---------+---------+----------------------------------------------------------------------------------------------------------------------------+ For all model settings above, we use a subset of evaluation dataset for calibration.