Skip to content

Commit

Permalink
Update example-llm-workflows/README.md
Browse files Browse the repository at this point in the history
Co-authored-by: Brian Ginsburg <[email protected]>
Signed-off-by: Zeeshan Lakhani <[email protected]>
  • Loading branch information
Zeeshan Lakhani and bgins committed May 1, 2024
1 parent bf63e7b commit 352f623
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion example-llm-workflows/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -426,7 +426,7 @@ Regarding further alignment with our class, the rise of LLMs has made the transp

![3 connected notes, but only 1 host with bindings for LLaMA 3](./llama_host.png)

In the [video walkthrough][video] we showcase how one node built without LLM features and LLaMA bindings can receive receipts for a workflow run on a node it's connected with over the LAN (local-area network) that was compiled with the features and bindings. Imagine finely tuning a LLaMA model on custom healthcare data (which is doable) and wanting certain users to run prompt chains against it. You wouldn't want the users of the platform to access the model itself, but you'd like for them to interact with it with clear separation. These on-prem models are becoming more and more important for companies, countries, and the people in between them.
In the [video walkthrough][video] we showcase how one node built without LLM features and LLaMA bindings can receive receipts for a workflow run on a node it's connected to over the LAN (local-area network) that was compiled with the features and bindings. Imagine finely tuning a LLaMA model on custom healthcare data (which is doable) and wanting certain users to run prompt chains against it. You wouldn't want the users of the platform to access the model itself, but you'd like for them to interact with it with clear separation. These on-prem models are becoming more and more important for companies, countries, and the people in between them.

### Running LLM Tasks Offline

Expand Down

0 comments on commit 352f623

Please sign in to comment.