More info about deploying Agenta as middleware? #1783
-
|
The docs are every thin on this. Doe it do caching? Does it track the costs/token usage for OpenAI/Other providers? Is there and example of how to use this? |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment
-
|
Hi @whillas-yabble thank you for the feedback. We'll try to improve this part of the documentation asap.
No, not currently. We are considering this feature in the future.
Yes, we instrument the calls and track the usage that you can find in the observability view (in cloud and enterprise version)
It's the default use from the UI. If you create an app from the UI (by clicking create app), and go to the endpoints view, you can find an endpoint where you'd be using agenta as a middleware |
Beta Was this translation helpful? Give feedback.
Hi @whillas-yabble thank you for the feedback. We'll try to improve this part of the documentation asap.
No, not currently. We are considering this feature in the future.
Yes, we instrument the calls and track the usage that you can find in the observability view (in cloud and enterprise version)
It's the default use from the UI. If you create an app from the UI (by clicking create app), and go to the endpoints view, you can find an endpoint where you'd be using agenta as a middleware