You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/articles_en/learn-openvino/openvino-samples/benchmark-tool.rst
+20-19Lines changed: 20 additions & 19 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -68,39 +68,36 @@ Basic Usage
68
68
./benchmark_app -m model.xml
69
69
70
70
71
-
By default, the application will load the specified model onto the CPU and perform
72
-
inference on batches of randomly-generated data inputs for 60 seconds. As it loads,
73
-
it prints information about the benchmark parameters. When the benchmark is completed,
74
-
it reports the minimum, average, and maximum inference latency and the average throughput.
71
+
By default, the application loads the specified model and performs
72
+
inference on batches of randomly-generated data inputs on CPU for 60 seconds.
73
+
It displays information about the benchmark parameters as it loads the model.
74
+
When the benchmark is completed, it reports the minimum, average, and maximum inference
75
+
latency and the average throughput.
75
76
76
77
You may be able to improve benchmark results beyond the default configuration by
77
78
configuring some of the execution parameters for your model. For example, you can
78
79
use "throughput" or "latency" performance hints to optimize the runtime for higher
79
80
FPS or reduced inference time. Read on to learn more about the configuration
80
-
options available with ``benchmark_app``.
81
+
options available for ``benchmark_app``.
81
82
82
83
Configuration Options
83
84
#####################
84
85
85
-
The benchmark app provides various options for configuring execution parameters.
86
-
This section covers key configuration options for easily tuning benchmarks to
87
-
achieve better performance on your device. A list of all configuration options
86
+
You can easily configure and fine-tune benchmarks with various execution parameters,
87
+
for example to achieve better performance on your device. The list of all configuration options
88
88
is given in the :ref:`Advanced Usage <advanced-usage-benchmark>` section.
89
89
90
90
Performance hints: latency and throughput
91
91
+++++++++++++++++++++++++++++++++++++++++
92
92
93
-
The benchmark app allows users to provide high-level "performance hints" for
94
-
setting latency-focused or throughput-focused inference modes. This hint causes
95
-
the runtime to automatically adjust runtime parameters, such as the number of
96
-
processing streams and inference batch size, to prioritize for reduced latency
97
-
or high throughput.
93
+
With high-level "performance hints", which automatically adjust parameters such as the
94
+
number of processing streams and inference batch size, you can aim for low-latency
95
+
or high-throughput inference.
98
96
99
97
The performance hints do not require any device-specific settings and they are
100
-
completely portable between devices. Parameters are automatically configured
101
-
based on whichever device is being used. This allows users to easily port
102
-
applications between hardware targets without having to re-determine the best
103
-
runtime parameters for the new device.
98
+
completely portable between devices. The parameters are automatically configured
99
+
based on the device. Therefore, you can easily port applications between hardware targets
100
+
without having to re-determine the best runtime parameters for a new device.
104
101
105
102
If not specified, throughput is used as the default. To set the hint explicitly,
106
103
use ``-hint latency`` or ``-hint throughput`` when running ``benchmark_app``:
@@ -125,8 +122,12 @@ use ``-hint latency`` or ``-hint throughput`` when running ``benchmark_app``:
125
122
126
123
.. note::
127
124
128
-
It is up to the user to ensure the environment on which the benchmark is running is optimized for maximum performance. Otherwise, different results may occur when using the application in different environment settings (such as power optimization settings, processor overclocking, thermal throttling).
129
-
When you specify single options multiple times, only the last value will be used. For example, the ``-m`` flag:
125
+
Make sure the environment is optimized for maximum performance when benchmark is running.
126
+
Otherwise, different environment settings, such as power optimization settings, processor
127
+
overclocking, or thermal throttling may give different results.
128
+
129
+
When you specify single options multiple times, only the last value will be used.
0 commit comments