We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent b3e48c7 commit 87510b3Copy full SHA for 87510b3
scripts/gcp/yi-1.5-9b.sh
@@ -75,7 +75,7 @@ NUM_GPUS=$((${NUM_NODES} * ${NUM_GPU_PER_NODE}))
75
SEQ_LENGTH=4096
76
DATA_PARALLEL_SIZE=$NUM_GPUS
77
78
-MICRO_BATCH_SIZE=4
+MICRO_BATCH_SIZE=8
79
GLOBAL_BATCH_SIZE=1024
80
TRAIN_STEPS=25000
81
0 commit comments