Skip to content

Commit

Permalink
Merge branch 'main' into beta
Browse files Browse the repository at this point in the history
  • Loading branch information
actions-user committed Dec 1, 2023
2 parents e629bb9 + e892381 commit 146c5bb
Show file tree
Hide file tree
Showing 2 changed files with 19 additions and 3 deletions.
11 changes: 9 additions & 2 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,6 +1,13 @@
# Netec Large Language Models
# Hybrid Search Retriever

A Python [LangChain](https://www.langchain.com/) - [Pinecone](https://docs.pinecone.io/docs/python-client) proof of concept Retrieval Augmented Generation (RAG) models using sales support PDF documents.
A Python [OpenAI](https://openai.com/) / [LangChain](https://www.langchain.com/) / [Pinecone](https://docs.pinecone.io/docs/python-client) proof of concept Retrieval Augmented Generation (RAG) model using PDF documents as the embeddings data source.

Implements the following:

- a command-line pdf loader program that extracts text, vectorizes, and
loads into a Pinecone dot product vector database that is dimensioned to match OpenAI embeddings.

- a hybrid search retriever that locates relevant documents from the vector database and includes these in OpenAI prompts.

See:

Expand Down
11 changes: 10 additions & 1 deletion models/hybrid_search_retreiver.py
Original file line number Diff line number Diff line change
@@ -1,7 +1,16 @@
# -*- coding: utf-8 -*-
# pylint: disable=too-few-public-methods
"""
Sales Support Model (SSM) for the LangChain project.
Hybrid Search Retriever. A class that combines the following:
- OpenAI prompting and ChatModel
- PromptingWrapper
- Vector embedding with Pinecone
- Hybrid Retriever to combine vector embeddings with text search
Provides a pdf loader program that extracts text, vectorizes, and
loads into a Pinecone dot product vector database that is dimensioned
to match OpenAI embeddings.
See: https://python.langchain.com/docs/modules/model_io/llms/llm_caching
https://python.langchain.com/docs/modules/data_connection/document_loaders/pdf
https://python.langchain.com/docs/integrations/retrievers/pinecone_hybrid_search
Expand Down

0 comments on commit 146c5bb

Please sign in to comment.