Skip to content

Commit

Permalink
Update README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
@imoneoi
imoneoi authored Sep 4, 2023
1 parent 75dfa69 commit f9995eb
Showing 1 changed file with 0 additions and 2 deletions.
2 changes: 0 additions & 2 deletions README.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -88,11 +88,9 @@ To ensure consistency, we used the same routine as ChatGPT / GPT-4 to run these
| **Model** | **Size** | **Context** | **Dataset Size** | **💲Free** | **AlpacaEval (win rate %)** | **MT-bench (win rate adjusted %)** | **MT-bench (score)** |
|----------------------------------|----------|-------------|------------------|-----------|-----------------------------|------------------------------------|----------------------|
| | | | | | **v.s. text-davinci-003** | **v.s. ChatGPT** | |
| 🔴 *Larger than 13B* | | | | | | | |
| GPT-4 | 1.8T* | 8K | | ❌ | 95.3 | 82.5 | 8.99 |
| ChatGPT | 175B* | 4K | | ❌ | 89.4 | 50.0 | 7.94 |
| Llama-2-70B-Chat | 70B | 4K | 2.9M | ✅ | 92.7 | 60.0 | 6.86 |
| 🔷 *Equal to 13B (Llama-2 based)* | | | | | | | |
| **OpenChat 3.2 SUPER** | **13B** | **4K** | **80K** | ✅ | **89.5** | **57.5** | **7.19** |
| Llama-2-13B-Chat | 13B | 4K | 2.9M | ✅ | 81.1 | 55.3 | 6.65 |
| WizardLM 1.2 | 13B | 4K | 196K | ✅ | 89.2 | 53.1 | 7.05 |
Expand Down

0 comments on commit f9995eb

Please sign in to comment.