A list of released OPEA docker images in https://hub.docker.com/, contains all relevant images from the GenAIExamples, GenAIComps and GenAIInfra projects. Please expect more public available images in the future release.
Take ChatQnA for example. ChatQnA is a chatbot application service based on the Retrieval Augmented Generation (RAG) architecture. It consists of opea/embedding-tei, opea/retriever-redis, opea/reranking-tei, opea/llm-tgi, opea/dataprep-redis, opea/chatqna, opea/chatqna-ui and opea/chatqna-conversation-ui (Optional) multiple microservices. Other services are similar, see the corresponding README for details.
| Example Images | Dockerfile | Description |
|---|---|---|
| opea/audioqna | Link | The docker image served as a chatqna gateway and using language modeling to generate answers to user queries by converting audio input to text, and then using text-to-speech (TTS) to convert those answers back to speech for interaction. |
| opea/chatqna | Link | The docker image served as a chatqna gateway and interacted with users by understanding their questions and providing relevant answers. |
| opea/chatqna-ui | Link | The docker image acted as the chatqna UI entry for facilitating interaction with users for question answering |
| opea/chatqna-conversation-ui | Link | The purpose of the docker image is to provide a user interface for chat-based Q&A using React. It allows for interaction with users and supports continuing conversations with a history that is stored in the browser's local storage. |
| opea/chatqna-guardrails | Link | This docker image is used to encapsulate chatqna's LLM service to secure model inputs and outputs. Guardrails proactively prevents models from interacting with insecure content and signals in time to stop insecure behavior. |
| opea/chatqna-without-rerank | ||
| opea/chat-conversation-service | ||
| opea/chat-conversation-ui-service | ||
| opea/chat-history-service | ||
| opea/codegen | Link | The docker image served as the codegen gateway to provide service of the automatic creation of source code from a higher-level representation |
| opea/codegen-ui | Link | The docker image acted as the codegen UI entry for facilitating interaction with users for automatically generating code from user's description |
| opea/codegen-react-ui | Link | The purpose of the docker image is to provide a user interface for Codegen using React. It allows generating the appropriate code based on the current user input. |
| opea/codetrans | Link | The docker image served as a codetrans gateway to provide service of converting source code written in one programming language into an equivalent version in another programming language |
| opea/codetrans-ui | Link | The docker image acted as the codetrans UI entry for facilitating interaction with users for translating one programming language to another one |
| opea/docsum | Link | The docker image served as a docsum gateway to provide service of capturing the main points and essential details of the original text |
| opea/docsum-ui | Link | The docker image acted as the docsum UI entry for facilitating interaction with users for document summarization |
| opea/docsum-react-ui | Link | The purpose of the docker image is to provide a user interface for document summary using React. It allows upload a file or paste text and then click on “Generate Summary” to get a condensed summary of the generated content and automatically scroll to the bottom of the summary. |
| opea/faqgen | Link | The docker image served as a faqgen gateway and automatically generating comprehensive, natural sounding Frequently Asked Questions (FAQs) from documents, legal texts, customer inquiries and other sources. |
| opea/faqgen-ui | Link | The docker image serves as the docsum UI entry point for easy interaction with users, generating FAQs by pasting in question text. |
| opea/faqgen-react-ui | Link | The purpose of the docker image is to provide a user interface for Generate FAQs using React. It allows generating FAQs by uploading files or pasting text. |
| opea/searchqna | Link | The docker image served as the searchqna gateway to provide service of retrieving accurate and relevant answers to user queries from a knowledge base or dataset |
| opea/searchqna-ui | Link | The docker image acted as the searchqna UI entry for facilitating interaction with users for question answering |
| opea/translation | Link | The docker image served as the translation gateway to provide service of language translation |
| opea/translation-ui | Link | The docker image acted as the translation UI entry for facilitating interaction with users for language translation |
| Microservice Images | Dockerfile | Description |
|---|---|---|
| opea/asr | Link | The docker image exposed the OPEA Audio-Speech-Recognition microservice for GenAI application use |
| opea/comps-agent-langchain | Link | The docker image exposed the OPEA agent microservice for GenAI application use |
| opea/dataprep-on-ray-redis | Link | The docker image exposed the OPEA dataprep microservice based on redis vectordb and optimized ray for GenAI application use |
| opea/dataprep-qdrant | Link | The docker image exposed the OPEA dataprep microservice based on qdrant vectordb for GenAI application use |
| opea/dataprep-redis | Link | The docker image exposed the OPEA dataprep microservice based on redis vectordb for GenAI application use |
| opea/embedding-tei | Link | The docker image exposed the OPEA embedding microservice upon tei docker image for GenAI application use |
| opea/gmcrouter | Link | The docker image served as one of key parts of the OPEA GenAI Microservice Connector(GMC) to route the traffic among the microservices defined in GMC |
| opea/gmcmanager | Link | The docker image served as one of key parts of the OPEA GenAI Microservice Connector(GMC) to be controller manager to handle GMC CRD |
| opea/guardrails-tgi | Link | The docker image exposed the OPEA guardrail microservice to provide content review for GenAI application use |
| opea/guardrails-pii-detection | Link | The docker image exposed the OPEA guardrail microservice to provide PII detection for GenAI application use |
| opea/habanalabs | ||
| opea/knowledge_graphs | Link | The docker image served as knowledge graph gateway to enhance question answering with graph knowledge searching. |
| opea/llm-docsum-tgi | Link | This docker image is designed to build a document summarization microservice using the HuggingFace Text Generation Inference(TGI) framework. The microservice accepts document input and generates a document summary. |
| opea/llm-faqgen-tgi | Link | This docker image is designed to build a frequently asked questions microservice using the HuggingFace Text Generation Inference(TGI) framework. The microservice accepts document input and generates a FAQ. |
| opea/llm-ollama | Link | The docker image exposed the OPEA LLM microservice based on ollama for GenAI application use |
| opea/llm-ray | Link | The docker image exposed the OPEA LLM microservice based on Ray for GenAI application use |
| opea/llm-tgi | Link | The docker image exposed the OPEA LLM microservice upon TGI docker image for GenAI application use |
| opea/llm-vllm | Link | The docker image exposed the OPEA LLM microservice upon vLLM docker image for GenAI application use |
| opea/llm-vllm-hpu | Link | The docker image exposed the OPEA LLM microservice upon vLLM docker image for use by GenAI apps on the Gaudi |
| opea/llm-vllm-ray | Link | The docker image exposes the OPEA LLM microservices Ray-based upon the vLLM Docker image for GenAI application use |
| opea/llm-vllm-ray-hpu | Link | The docker image exposes Ray-based OPEA LLM microservices upon the vLLM Docker image for use by GenAI applications on the Gaudi |
| opea/prompt-registry-service | ||
| opea/reranking-tei | Link | The docker image exposed the OPEA reranking microservice based on tei docker image for GenAI application use |
| opea/retriever-qdrant | Link | The docker image exposed the OPEA retrieval microservice based on qdrant vectordb for GenAI application use |
| opea/retriever-redis | Link | The docker image exposed the OPEA retrieval microservice based on redis vectordb for GenAI application use |
| opea/speecht5 | Link | The docker image exposed the OPEA SpeechT5 service for GenAI application use |
| opea/speecht5-gaudi | Link | The docker image exposed the OPEA SpeechT5 service on Gaudi2 for GenAI application use |
| opea/tei-gaudi | Link | The docker image powered by HuggingFace Text Embedding Inference (TEI) on Gaudi2 for deploying and serving Embedding Models |
| opea/tts | Link | The docker image exposed the OPEA Text-To-Speech microservice for GenAI application use |
| opea/vllm | Link | The docker image powered by vllm-project for deploying and serving vllm Models |
| opea/web-retriever-chroma | Link | The docker image exposed the OPEA retrieval microservice based on chroma vectordb for GenAI application use |
| opea/whisper | Link | The docker image exposed the OPEA Whisper service for GenAI application use |
| opea/whisper-gaudi | Link | The docker image exposed the OPEA Whisper service on Gaudi2 for GenAI application use |