Chat Abilities
Chat abilities are functions that can be activated while interactive with the AI assistant if they are enabled and configured. The currently implemented abilities interact with loaded AI models and external APIs to bring real time information into the assistant experience.
Uses Bing News API to search for current news stories, will attempt to read and summarize the news articles.
Uses Accuweater API to get the current conditions for a location by name
The dynamic function ability allows you to create simple TypeScript functions using GPT-4 that are then stored and accessed when you ask similar questions, the OOB database includes 35+ generated function to solve common math problems, something small LLMs are terrible at. To use the skill just append the 🧪 the question and GPT-4 will try to generate a function to solve the problem instead of the language model handling it.
This chat ability can upload files from the workspace to a sever using the FTP protocol.
The image analyzer ability lets you run classification and object detection on images in the chat session. If no file name is given the ability will use the last image in the chat session.
This ability allows users to generate images based on prompts. The quality and accuracy of the generated images are dependent on the provided negative prompt and settings such as steps, guidance scale, height, and width.
The translator ability uses the Alma models to preform translation from one language to another. Specify the text you want to translate and the language you want to transfer it to, the model can correctly guess the input language reliably.
This ability uses the MusicGen models from Meta to create music clips up to 30 seconds based off a text prompt.
The Telenyx SMS and MMS ability allows you to send outgoing SMS and MMS messages using the Telenyx API. This ability requires you have a Telenyx API key and outgoing phone number configured.
The text to speech ability can take a text string as input and output a wav file with a human voice of the input text.
