Gen AI applications that deliver value, not surprises.
The Rhesis SDK enables developers to access curated test sets and generate dynamic ones for GenAI applications. It provides tools to tailor validations to your needs and integrate seamlessly to keep your Gen AI robust, reliable & compliant.
The Rhesis SDK currently provides functionality to work with Rhesis test sets through routine operations:
- List Test Sets: Browse through available curated test sets
- Load Test Sets: Load specific test sets for your use case
- Download Test Sets: Download test set data for offline use
- Generate Test Sets: Generate new test sets from basic prompts
Install the Rhesis SDK using pip:
pip install rhesis-sdk
- Visit https://app.rhesis.ai
- Sign up for a Rhesis account
- Navigate to your account settings
- Generate a new API key
Your API key will be in the format rh-XXXXXXXXXXXXXXXXXXXX
. Keep this key secure and never share it publicly.
Note: On the Rhesis App, you can also create test sets for your own use cases and access them via the SDK. You only need to connect your GitHub account to create a test set.
You can configure the Rhesis SDK either through environment variables or direct configuration:
export RHESIS_API_KEY="your-api-key"
export RHESIS_BASE_URL="https://api.rhesis.ai" # optional
import rhesis
# Set configuration directly
rhesis.base_url = "https://api.rhesis.ai" # optional
rhesis.api_key = "rh-XXXXXXXXXXXXXXXXXXXX"
Before you start, you can configure the Rhesis SDK either through environment variables or direct configuration, as described above.
from rhesis.entities import TestSet
# List all test sets
for test_set in TestSet().all():
print(test_set)
# Load a specific test set
test_set = TestSet(id="agent-or-industry-fraud-harmful")
test_set.load()
# Download test set data
test_set.download()
# Generate a new test set
prompt_synthesizer = PromptSynthesizer(prompt="Generate tests for an insurance chatbot that can answer questions about the company's policies.")
test_set = prompt_synthesizer.generate(num_tests=5)
For more detailed examples, check out our example notebooks.
If none of the existing test sets fit your needs, you can generate your own.
You can check out app.rhesis.ai. There you can define requirements, scenarios and personas, and even import your existing GitHub repository.
Rhesis AI helps organizations build Gen AI applications that deliver value, not surprises. Our platform enables you to:
- Access curated test sets
- Generate dynamic test sets
- Tailor validations to your specific needs
- Integrate testing seamlessly into your workflow
- Keep your Gen AI applications robust, reliable & compliant
Made in Potsdam, Germany 🇩🇪
Visit rhesis.ai to learn more about our platform and services.
Join our Discord server to connect with other users and developers.
You can also find us on Hugging Face. There, you can find our test sets across multiple use cases.
For questions, issues, or feature requests:
- Visit our documentation
- Contact us at [email protected]
- Create an issue in this repository
This project is licensed under the MIT License - see the LICENSE file for details.