|
| 1 | +## 马斯克开源3410亿参数大模型Grok |
| 2 | + |
| 3 | +### 作者 |
| 4 | +digoal |
| 5 | + |
| 6 | +### 日期 |
| 7 | +2024-03-18 |
| 8 | + |
| 9 | +### 标签 |
| 10 | +PostgreSQL , PolarDB , DuckDB , 大模型 , grok , 专家分类 |
| 11 | + |
| 12 | +---- |
| 13 | + |
| 14 | +## 背景 |
| 15 | +开源项目地址: |
| 16 | +- https://github.com/xai-org/grok-1 |
| 17 | + |
| 18 | +更多介绍: |
| 19 | +- https://finance.sina.com.cn/tech/roll/2024-03-18/doc-inansyiy2523231.shtml |
| 20 | + |
| 21 | +# Grok-1 |
| 22 | + |
| 23 | +This repository contains JAX example code for loading and running the Grok-1 open-weights model. |
| 24 | + |
| 25 | +Make sure to download the checkpoint and place `ckpt-0` directory in `checkpoint`. |
| 26 | +Then, run |
| 27 | + |
| 28 | +```shell |
| 29 | +pip install -r requirements.txt |
| 30 | +python run.py |
| 31 | +``` |
| 32 | + |
| 33 | +to test the code. |
| 34 | + |
| 35 | +The script loads the checkpoint and samples from the model on a test input. |
| 36 | + |
| 37 | +Due to the large size of the model (314B parameters), a machine with enough GPU memory is required to test the model with the example code. |
| 38 | +The implementation of the MoE layer in this repository is not efficient. The implementation was chosen to avoid the need for custom kernels to validate the correctness of the model. |
| 39 | + |
| 40 | +# Downloading the weights |
| 41 | + |
| 42 | +You can download the weights using a torrent client and this magnet link: |
| 43 | +``` |
| 44 | +magnet:?xt=urn:btih:5f96d43576e3d386c9ba65b883210a393b68210e&tr=https%3A%2F%2Facademictorrents.com%2Fannounce.php&tr=udp%3A%2F%2Ftracker.coppersurfer.tk%3A6969&tr=udp%3A%2F%2Ftracker.opentrackr.org%3A1337%2Fannounce |
| 45 | +``` |
| 46 | + |
| 47 | +# License |
| 48 | + |
| 49 | +The code and associated Grok-1 weights in this release are licensed under the |
| 50 | +Apache 2.0 license. The license only applies to the source files in this |
| 51 | +repository and the model weights of Grok-1. |
| 52 | + |
| 53 | + |
| 54 | +#### [期望 PostgreSQL|开源PolarDB 增加什么功能?](https://github.com/digoal/blog/issues/76 "269ac3d1c492e938c0191101c7238216") |
| 55 | + |
| 56 | + |
| 57 | +#### [PolarDB 开源数据库](https://openpolardb.com/home "57258f76c37864c6e6d23383d05714ea") |
| 58 | + |
| 59 | + |
| 60 | +#### [PolarDB 学习图谱](https://www.aliyun.com/database/openpolardb/activity "8642f60e04ed0c814bf9cb9677976bd4") |
| 61 | + |
| 62 | + |
| 63 | +#### [购买PolarDB云服务折扣活动进行中, 55元起](https://www.aliyun.com/activity/new/polardb-yunparter?userCode=bsb3t4al "e0495c413bedacabb75ff1e880be465a") |
| 64 | + |
| 65 | + |
| 66 | +#### [PostgreSQL 解决方案集合](../201706/20170601_02.md "40cff096e9ed7122c512b35d8561d9c8") |
| 67 | + |
| 68 | + |
| 69 | +#### [德哥 / digoal's Github - 公益是一辈子的事.](https://github.com/digoal/blog/blob/master/README.md "22709685feb7cab07d30f30387f0a9ae") |
| 70 | + |
| 71 | + |
| 72 | +#### [About 德哥](https://github.com/digoal/blog/blob/master/me/readme.md "a37735981e7704886ffd590565582dd0") |
| 73 | + |
| 74 | + |
| 75 | + |
| 76 | + |
0 commit comments