Skip to content

Commit 1860680

Browse files
committed
add ToC
1 parent 20a0774 commit 1860680

File tree

1 file changed

+11
-2
lines changed

1 file changed

+11
-2
lines changed

README.md

Lines changed: 11 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -29,7 +29,7 @@ The Transformer architecture, introduced in 2017 by Google and University of Tor
2929
In this notebook, we'll explore how (multi-head) self-attention is implemented and visualize the patterns that are typically learned using [bertviz](https://pypi.org/project/bertviz/), an interactive tool for visualizing attention in Transformer models:
3030

3131
<p align="center">
32-
<img src="./static/self_attention_s1.png" width="400">
32+
<img src="./static/self_attention_s1.png">
3333
</p>
3434
<p align="center">Self-Attention Visualization in the BERT model</p>
3535

@@ -45,7 +45,16 @@ In Progress
4545

4646
## 03. Retrieval Augmented Generation
4747

48-
In Progress
48+
Retrieval Augmented Generation (RAG) is an advanced NLP technique that enhances the quality and reliability of Large Language Models (LLMs) by grounding them in external knowledge sources. This approach combines information retrieval with text generation to produce more factual and specific responses. RAG works by retrieving relevant passages from a knowledge base based on a user query, augmenting the original prompt with this information, and then generating a response using both the query and the augmented context. This method offers several advantages, including improved accuracy, easy incorporation of updated knowledge, and enhanced interpretability through citation of retrieved passages.
49+
50+
In this notebook, we'll build a basic knowledge base with exemplary documents, apply chunking, index the embedded splits into a vector storage, and build a conversational chain with history.
51+
52+
<p align="center">
53+
<img src="./static/rag_chunking.png" width="400">
54+
</p>
55+
<p align="center">Exemplary Document Chunking for a RAG-based Conversational Chain</p>
56+
57+
`RAG` `Chunking` `FAISS` `LangChain`
4958

5059
## 04. Knowledge Graphs
5160

0 commit comments

Comments
 (0)