This notebook shows how to do inference with Automatic Device Selection (AUTO). To learn more about the logic of this mode, refer to the Automatic device selection article.
A basic introduction to use Auto Device Selection with OpenVINO.
This notebook demonstrates how to compile a model with AUTO device, compare the first inference latency (model compilation time + 1st inference time) between GPU device and AUTO device, show the difference in performance hints (THROUGHPUT and LATENCY) with significant performance results towards the desired metric.
If you have not installed all required dependencies, follow the Installation Guide.