Merge pull request #44 from macrocosm-os/update_install_instructions

Update flash-attn install instructions.
macrocosm-os · Jun 22, 2024 · 2fee2ba · 2fee2ba
2 parents 96d5605 + 8cbe716
commit 2fee2ba
Show file tree

Hide file tree

Showing 2 changed files with 14 additions and 0 deletions.
diff --git a/docs/miner.md b/docs/miner.md
@@ -39,6 +39,13 @@ cd finetuning
 python -m pip install -e .
 ```
 
+Note: flash-attn may not have their dependencies set up correctly. If you run into issues try installing those requirements separately first:
+```shell
+pip install packaging
+pip install wheel
+pip install torch
+```
+
 6. Make sure you've [created a Wallet](https://docs.bittensor.com/getting-started/wallets) and [registered a hotkey](https://docs.bittensor.com/subnets/register-and-participate).
 
 7. (Optional) Run a Subtensor instance:

diff --git a/docs/validator.md b/docs/validator.md
@@ -88,6 +88,13 @@ cd finetuning
 python -m pip install -e .
 ```
 
+Note: flash-attn may not have their dependencies set up correctly. If you run into issues try installing those requirements separately first:
+```shell
+pip install packaging
+pip install wheel
+pip install torch
+```
+
 5. Make sure you've [created a Wallet](https://docs.bittensor.com/getting-started/wallets) and [registered a hotkey](https://docs.bittensor.com/subnets/register-and-participate).
 
 6. (Optional) Run a Subtensor instance: