RunInfra SDK

Official client SDKs for RunInfra, the optimized inference platform for serving open-source models on GPU backends that fit your workload.

Install

# TypeScript / JavaScript
npm install @runinfra/sdk

# Python
pip install runinfra

Quick start

import { RunInfra } from "@runinfra/sdk";

const apiKey = process.env.RUNINFRA_API_KEY;
if (!apiKey) throw new Error("Set RUNINFRA_API_KEY before running this snippet.");

const client = new RunInfra({ apiKey });

const response = await client.chat.completions.create({
  model: "your-deployed-model-id",
  messages: [{ role: "user", content: "Hello!" }],
});

console.log(response.choices?.[0]?.message?.content);

import os
from runinfra import RunInfra

api_key = os.environ.get("RUNINFRA_API_KEY")
if not api_key:
    raise RuntimeError("Set RUNINFRA_API_KEY before running this snippet.")

client = RunInfra(api_key=api_key)

response = client.chat.completions.create(
    model="your-deployed-model-id",
    messages=[{"role": "user", "content": "Hello!"}],
)

print(response["choices"][0]["message"]["content"])

Packages

Package	Registry	Source	Status
@runinfra/sdk	npm	typescript/	Beta
runinfra	PyPI	python/	Beta

See each package's own README + CHANGELOG for surface-level docs.

Modality status (v0.2.0)

Surface	Status
Chat completions, Responses	Beta. Typed helpers for verified LLM and vision-language deployments.
Embeddings	Beta. Typed helper for verified embedding deployments.
Images, Audio TTS/ASR	Preview. Available when the selected deployment exposes the matching route.
Voice pipeline	Preview. Pipeline-scoped helper for co-located audio-to-response deployments.
Webhook verification	Local signature verification helpers are available in both SDKs. Delivery management is handled outside the public SDK surface.

See each package README and changelog for language-specific examples and exact helper names.

Browser security

RunInfra API keys are bearer secrets. Do not put RUNINFRA_API_KEY in browser code. Browser apps should call your server route or backend proxy first, then your server calls RunInfra with the workspace or pipeline-scoped key. Direct browser token flows are not supported by the public SDK.

License

Proprietary, source-available. See LICENSE. For commercial licensing inquiries, contact licensing@runinfra.ai.

Package provenance

RunInfra publishes SDK packages through trusted publishing where the registry supports it. npm releases include provenance metadata, and PyPI releases use the configured trusted publisher chain.

You can inspect npm provenance with:

npm view @runinfra/sdk@latest dist.attestations

For PyPI, open the release page at https://pypi.org/project/runinfra/ and inspect the publishing details for the selected version.

Issues + contributing

Open an issue or pull request against this repo. See CONTRIBUTING.md for the workflow + style rules.

For security issues, do NOT open a GitHub issue - see SECURITY.md for disclosure process.

For RunInfra service issues (deployments, billing, account), email support@runinfra.ai.

---