Inference.net API Examples

Welcome to the Inference.net API examples repository! This collection provides code samples and guides for common tasks using the Inference.net API.

Getting Started

To run these examples, you'll need:

1. An Inference.net account - Create a free account here
2. An API key from your account dashboard

Setting Up Your API Key

You can set up your API key in one of two ways:

1. Environment Variable:

   export INFERENCE_API_KEY=your_api_key_here

2. .env File (recommended for development): Create a .env file in your project root:

   INFERENCE_API_KEY=your_api_key_here

   Most IDEs (like VS Code) will automatically load this file.

Available Resources

Most examples are written in Python, but the concepts can be applied to any language.

Featured Examples

Example Notebooks

• Webhook Example - A minimalistic API that uses Inference.net to detect Magnus Carlsen in images using webhooks
• RAG with ChromaDB, Chonkie, and Paul Graham's Essays - End-to-end Retrieval-Augmented Generation pipeline using Inference.net, ChromaDB, and Chonkie
• ClipTagger-12B Semantic Video Search With Chroma - Semantic search and filtering over video frames using ClipTagger-12B and ChromaDB
• Video Captioning with VLMs: Generic Model Example
• Sentiment Analysis with Structured Outputs

API Features & Resources

• Batch Processing - Process multiple asynchronous requests in a single API call
• Function Calling - Give your models tools
• Structured Outputs - Have your models output structured outputs
• Vision - Process images with AI models
• Background Inference - Use the asynchronous API for cost-effective processing

License

MIT License