TypeAgent allows you to create a LLM agent,which has complete memory module (long-term memory, short-term memory) and knowledge module（Various knowledge bases）,eventually become an agent with both EQ and IQ.Another most important thing is that he can use various tools and become a real tool man AND Open Source.IT can also create various types of agents,IT also called LLM OS.
中文版本(中文版MemGPT)或高级版MemGPT，完全开源
Are there any friends who are interested in developing LLM agent together? Please contact me
TypeAgent makes it easy to build and deploy stateful LLM agents with support for:
- Long term memory/state managemet,short term memory,knowledge base long term memory
- Basic RAG workflow for knowledge base which created by external data sources (e.g. PDF files)
- Intelligent switching knowledge base
- Defining and calling custom tools，then help you do something(take action)
- Changing personas settings and role-playing
You can also use TypeAgent to deploy agents as a service. You can use a TypeAgent server to run a multi-user, multi-agent application on top of supported LLM providers.
IF you have any questions about using typeagent ,you can make a issues
IF you clone this repo or are interesting ,please click star ,which will make more people to see
- Clone the repo
- Run
typeagent configure - Run
typeagent server - Go to
localhost:8283in the browser to view the developer portal
Once the server is running, you can use the [REST API] to connect to localhost:8283 (if you're running with the CLI) to create users, agents, and more. The service requires authentication with a TypeAgent admin password, which can be set with running export TYPEAGENT_SERVER_PASS=password.
coming......
TypeAgent is designed to be model and provider agnostic. The following LLM and embedding endpoints are supported:
| Provider | LLM Endpoint | Embedding Endpoint |
|---|---|---|
| OpenAI | ✅ | ✅ |
| Azure OpenAI | ✅ | ✅ |
| Google AI (Gemini) | ✅ | ❌ |
| Anthropic (Claude) | ✅ | ❌ |
| Groq | ✅ (alpha release) | ❌ |
| Cohere API | ✅ | ❌ |
| vLLM | ✅ | ❌ |
| Ollama | ✅ | ✅ |
| LM Studio | ✅ | ❌ |
| koboldcpp | ✅ | ❌ |
| oobabooga web UI | ✅ | ❌ |
| llama.cpp | ✅ | ❌ |
| HuggingFace TEI | ❌ | ✅ |
| baichuan LLM | ❌ | ❌ |
| qianwen LLM | ❌ | ❌ |
When using TypeAgent with open LLMs (such as those downloaded from HuggingFace), the performance of TypeAgent will be highly dependent on the LLM's function calling ability ,Language understanding and reasoning skills.
As you can see, typeagent will intelligently change the memory
- Add typeagent client
- Add other type agent
- test vectordb and other llms
- add baichuan/qianwen etc LLM
- add prompt poet
- This project is a Leisure time hobby，If you are interested in the project ,you can make a issue.
- Our codebase for the TypeAgent builds heavily on MemGPT codebase,Thanks for open-sourcing!
- The difference of MemGPT and Typeagent is that typeagent optimizes the entire memgpt code structure and creatively adds a complete memory module and knowledge base module
goal: EQ and IQ AGENT or a tool man
