Updating README.md

erfanzar · Oct 24, 2024 · 705e860 · 705e860
1 parent 834fcea
commit 705e860
Showing 1 changed file with 6 additions and 0 deletions.
diff --git a/README.md b/README.md
@@ -59,7 +59,13 @@ with mesh:
 		bias=with_sharding_constraint(bias, bps).astype(dtype),
 	)
 ```
+## 📊 Benchmarks
 
+- [Triton GPU MHA](https://github.com/erfanzar/jax-flash-attn2/tree/main/benchmarks/mha/triton)
+- Triton GPU MQA (comming soon...)
+- Pallas GPU MHA (comming soon...)
+- Pallas TPU MHA (comming soon...)
+- XLA CPU MHA (comming soon...)
 ## Supported Configurations
 
 ### Backends