Skip to content

Commit

Permalink
Update bert.md
Browse files Browse the repository at this point in the history
Co-authored-by: YONGSANG <[email protected]>
  • Loading branch information
maximizemaxwell and 4N3MONE authored Nov 6, 2024
1 parent ab86202 commit 6f20f68
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion docs/source/ko/model_doc/bert.md
Original file line number Diff line number Diff line change
Expand Up @@ -77,7 +77,7 @@ model = BertModel.from_pretrained("bert-base-uncased", torch_dtype=torch.float16
|16 |256 |0.030 |0.024 |25.583 |2874.426 |2134.262 |34.680 |
|16 |512 |0.064 |0.044 |46.223 |6964.659 |3961.013 |75.830 |

#### Inference
#### 추론

|batch_size|seq_len|Per token latency eager (ms)|Per token latency SDPA (ms)|Speedup (%)|Mem eager (MB)|Mem BT (MB)|Mem saved (%)|
|----------|-------|----------------------------|---------------------------|-----------|--------------|-----------|-------------|
Expand Down

0 comments on commit 6f20f68

Please sign in to comment.