Merge branch 'main' into support_latte

siliconflow · Jul 1, 2024 · 89525ff · 89525ff
2 parents 06545ce + c19064f
commit 89525ff
Showing 1 changed file with 8 additions and 8 deletions.
diff --git a/onediff_diffusers_extensions/examples/sd3/README.md b/onediff_diffusers_extensions/examples/sd3/README.md
@@ -42,7 +42,7 @@ python3 onediff_diffusers_extensions/examples/sd3/text_to_image_sd3.py \
 
 ```
 python3 onediff_diffusers_extensions/examples/sd3/text_to_image_sd3.py \
-    --compiler-config '{"mode": "max-optimize:max-autotune:low-precision:cache-all:freezing:benchmark", "memory_format": "channels_last"}' \
+    --compiler-config '{"mode": "max-optimize:max-autotune:low-precision:cache-all", "memory_format": "channels_last"}' \
     --saved-image sd3_compile.png
 ```
 
@@ -51,11 +51,11 @@ python3 onediff_diffusers_extensions/examples/sd3/text_to_image_sd3.py \
 Testing on H800-NVL-80GB, with image size of 1024*1024, iterating 28 steps:
 | Metric                                           |                                     |
 | ------------------------------------------------ | ----------------------------------- |
-| Data update date(yyyy-mm-dd)                     | 2024-06-24                          |
+| Data update date(yyyy-mm-dd)                     | 2024-06-29                          |
 | PyTorch iteration speed                          | 15.56 it/s                          |
-| OneDiff iteration speed                          | 25.91 it/s (+66.5%)                 |
+| OneDiff iteration speed                          | 24.12 it/s (+55.0%)                 |
 | PyTorch E2E time                                 | 1.96 s                              |
-| OneDiff E2E time                                 | 1.15 s (-41.3%)                     |
+| OneDiff E2E time                                 | 1.31 s (-33.2%)                     |
 | PyTorch Max Mem Used                             | 18.784 GiB                          |
 | OneDiff Max Mem Used                             | 18.324 GiB                          |
 | PyTorch Warmup with Run time                     | 2.86 s                              |
@@ -68,11 +68,11 @@ Testing on H800-NVL-80GB, with image size of 1024*1024, iterating 28 steps:
 Testing on 4090:
 | Metric                                           |                                     |
 | ------------------------------------------------ | ----------------------------------- |
-| Data update date(yyyy-mm-dd)                     | 2024-06-24                          |
+| Data update date(yyyy-mm-dd)                     | 2024-06-29                          |
 | PyTorch iteration speed                          | 6.67 it/s                           |
-| OneDiff iteration speed                          | 12.24 it/s (+83.3%)                 |
+| OneDiff iteration speed                          | 11.51 it/s (+72.6%)                 |
 | PyTorch E2E time                                 | 4.90 s                              |
-| OneDiff E2E time                                 | 2.48 s (-49.4%)                     |
+| OneDiff E2E time                                 | 2.67 s (-45.5%)                     |
 | PyTorch Max Mem Used                             | 18.799 GiB                          |
 | OneDiff Max Mem Used                             | 17.902 GiB                          |
 | PyTorch Warmup with Run time                     | 4.99 s                              |
@@ -89,7 +89,7 @@ Run:
 ```
 # The best practice mode configuration for dynamic shape is `max-optimize:max-autotune:low-precision`.
 python3 onediff_diffusers_extensions/examples/sd3/text_to_image_sd3.py \
-    --compiler-config '{"mode": "max-optimize:max-autotune:low-precision", "memory_format": "channels_last", "dynamic": true}' \
+    --compiler-config '{"mode": "max-optimize:max-autotune:low-precision:cache-all", "memory_format": "channels_last", "dynamic": true}' \
     --height 512 \
     --width 768 \
     --run_multiple_resolutions 1 \