Skip to content

Latest commit

 

History

History
13 lines (7 loc) · 1 KB

File metadata and controls

13 lines (7 loc) · 1 KB

Working with GPUs in OpenVINO™

This notebook shows how to do inference with Graphic Processing Units (GPUs). To learn more about GPUs in OpenVINO, refer to the GPU Device section in the docs.

Notebook Contents

This notebook provides a high-level overview of working with Intel GPUs in OpenVINO. It shows how to use Query Device to list system GPUs and check their properties, and it explains some of the key properties. It shows how to compile a model on GPU with performance hints and how to use multiple GPUs using MULTI or CUMULATIVE_THROUGHPUT.

The notebook also presents example commands for benchmark_app that can be run to compare GPU performance in different configurations. It also provides the code for a basic end-to-end application that compiles a model on GPU and uses it to run inference.

Installation Instructions

If you have not installed all required dependencies, follow the Installation Guide.