Skip to content

v1.18.0: Arctic, Jais, OpenVINO pipelines

Compare
Choose a tag to compare
@echarlaix echarlaix released this 26 Jun 23:21
· 175 commits to main since this release

OpenVINO

from optimum.intel.pipelines import pipeline

# Load openvino model
ov_pipe = pipeline("text-generation", "helenai/gpt2-ov", accelerator="openvino")
# Load pytorch model and convert it to openvino before inference
pipe = pipeline("text-generation", "gpt2", accelerator="openvino")

IPEX