Code

Llm eloquence2#788

Code

Open

aleixsant wants to merge 124 commits intoalibaba:masteralibaba/FederatedScope:masterfrom jordiluque:llm-eloquence2jordiluque/FederatedScope:llm-eloquence2Copy head branch name to clipboard

+10,387-491

Commits

Commits on May 15, 2023

• Init for LLM (alibaba#592)

  rayrayraykk

  authored
  61e4b51

  Copy full SHA for 61e4b51

• update

  rayrayraykk

  committed
  b5ff4ab

  Copy full SHA for b5ff4ab

• Merge pull request alibaba#595 from rayrayraykk/dev_llm

  Show description for 144d79e
  qbc2016

  authored
  144d79e

  Copy full SHA for 144d79e

• add LICENSE

  rayrayraykk

  committed
  166c800

  Copy full SHA for 166c800

• merge

  rayrayraykk

  committed
  bf3ed37

  Copy full SHA for bf3ed37

Commits on May 16, 2023

• fix minor bugs

  rayrayraykk

  committed
  3980e3b

  Copy full SHA for 3980e3b

• add chatbot

  rayrayraykk

  committed
  669d1ac

  Copy full SHA for 669d1ac

• modify

  rayrayraykk

  committed
  8a98c79

  Copy full SHA for 8a98c79

• modify yaml

  rayrayraykk

  committed
  a1dd245

  Copy full SHA for a1dd245

• Merge pull request alibaba#596 from rayrayraykk/dev_llm

  Show description for b67d8ea
  qbc2016

  authored
  b67d8ea

  Copy full SHA for b67d8ea

• update

  rayrayraykk

  committed
  cba1cd4

  Copy full SHA for cba1cd4

• Merge pull request alibaba#597 from rayrayraykk/dev_llm

  Show description for e189689
  qbc2016

  authored
  e189689

  Copy full SHA for e189689

• fix

  rayrayraykk

  committed
  13e42bd

  Copy full SHA for 13e42bd

• fix

  rayrayraykk

  committed
  e3851aa

  Copy full SHA for e3851aa

• enable prompt

  rayrayraykk

  committed
  1dfeb0c

  Copy full SHA for 1dfeb0c

• Merge pull request alibaba#598 from rayrayraykk/dev_llm

  Show description for 41a2aca
  qbc2016

  authored
  41a2aca

  Copy full SHA for 41a2aca

Commits on May 29, 2023

• LLM Enhancement: model sharding (alibaba#599)

  rayrayraykk

  authored
  3ea0118

  Copy full SHA for 3ea0118

• Add adapters (alibaba#607)

  qbc2016

  authored
  a7232e5

  Copy full SHA for a7232e5

Commits on Jun 1, 2023

• [Feature] Offsite tuning (alibaba#610)

  rayrayraykk

  authored
  5fe8a49

  Copy full SHA for 5fe8a49

Commits on Jun 2, 2023

• [HotFix] Fix device map when transformer version mismatch (alibaba#619)

  rayrayraykk

  authored
  0328a63

  Copy full SHA for 0328a63

Commits on Jun 5, 2023

• igore eval in llm (alibaba#621)

  rayrayraykk

  authored
  535c84c

  Copy full SHA for 535c84c

• Add eval for MMLU (alibaba#618)

  qbc2016

  authored
  7032473

  Copy full SHA for 7032473

Commits on Jun 6, 2023

• [Feature] Add dataset dolly (alibaba#620)

  rayrayraykk

  authored
  97cb787

  Copy full SHA for 97cb787

• Clean & Merge master (alibaba#622)

  rayrayraykk

  authored
  027649a

  Copy full SHA for 027649a

Commits on Jun 7, 2023

• Eval llm for gsm8k (alibaba#624)

  rayrayraykk

  authored
  88f8075

  Copy full SHA for 88f8075

• Fix NaN in LLM train (alibaba#625)

  rayrayraykk

  authored
  963c66c

  Copy full SHA for 963c66c

Commits on Jun 8, 2023

• Optimize gsm8k evaluation (alibaba#626)

  rayrayraykk

  authored
  bff080d

  Copy full SHA for bff080d

Commits on Jun 12, 2023

• Fix offsite tuning (alibaba#629)

  HarliWu

  authored
  39e2920

  Copy full SHA for 39e2920

Commits on Jun 13, 2023

• Add code search net for SFT (alibaba#627)

  rayrayraykk

  authored
  ca804fb

  Copy full SHA for ca804fb

• update eval in gsm8k

  rayrayraykk

  committed
  a671ca3

  Copy full SHA for a671ca3

• remove

  rayrayraykk

  committed
  943c3ec

  Copy full SHA for 943c3ec

• Merge branch 'dev/llm' into new_gsm

  rayrayraykk

  authored
  441c622

  Copy full SHA for 441c622

Commits on Jun 14, 2023

• Merge pull request alibaba#630 from rayrayraykk/new_gsm

  Show description for 9bb350e
  qbc2016

  authored
  9bb350e

  Copy full SHA for 9bb350e

• Add HumanEval for Code (alibaba#631)

  rayrayraykk

  authored
  6c2c4b3

  Copy full SHA for 6c2c4b3

• add rosetta_alpaca

  rayrayraykk

  committed
  d96b9d1

  Copy full SHA for d96b9d1

• minor change

  rayrayraykk

  committed
  9b55a4a

  Copy full SHA for 9b55a4a

• format

  rayrayraykk

  committed
  039084f

  Copy full SHA for 039084f

• remove redundant

  rayrayraykk

  committed
  32a3407

  Copy full SHA for 32a3407

• update

  rayrayraykk

  committed
  35df393

  Copy full SHA for 35df393

• Add new fine-tune dataset (alibaba#632)

  Show description for 05a2c4a
  qbc2016

  authored
  05a2c4a

  Copy full SHA for 05a2c4a

Commits on Jun 15, 2023

• fix update

  rayrayraykk

  committed
  65c9687

  Copy full SHA for 65c9687

• remove final save

  rayrayraykk

  committed
  423f735

  Copy full SHA for 423f735

• Optimize llm setup (alibaba#635)

  rayrayraykk

  authored
  cf0c076

  Copy full SHA for cf0c076

Commits on Jun 16, 2023

• keep save final

  rayrayraykk

  committed
  263730c

  Copy full SHA for 263730c

• minor change to rosetta

  rayrayraykk

  committed
  e65e7f8

  Copy full SHA for e65e7f8

• [Hotfix]Save best model alibaba#637 from rayrayraykk

  Show description for 4832248
  qbc2016

  authored
  4832248

  Copy full SHA for 4832248

• Merge pull request alibaba#638 from rayrayraykk/ros

  Show description for 053cd73
  qbc2016

  authored
  053cd73

  Copy full SHA for 053cd73

Commits on Jun 19, 2023

• Offsite-tuning evaluation for raw/plugin model (alibaba#633)

  HarliWu

  authored
  2591d2e

  Copy full SHA for 2591d2e

• add Dockerfile

  rayrayraykk

  committed
  1830142

  Copy full SHA for 1830142

• update README

  rayrayraykk

  committed
  0cdab29

  Copy full SHA for 0cdab29

Commits on Jun 20, 2023

• Add exp yaml files (alibaba#623)

  qbc2016

  authored
  63b37e6

  Copy full SHA for 63b37e6

• update setup

  rayrayraykk

  committed
  458d42e

  Copy full SHA for 458d42e

• add README

  rayrayraykk

  committed
  9911f3a

  Copy full SHA for 9911f3a

• update conf

  rayrayraykk

  committed
  1bf2f44

  Copy full SHA for 1bf2f44

• add move to helm

  rayrayraykk

  committed
  5c31894

  Copy full SHA for 5c31894

• Eval HELM in LLM alibaba#643 from rayrayraykk/df_helm

  Show description for bc0f485
  qbc2016

  authored
  bc0f485

  Copy full SHA for bc0f485

Commits on Jun 21, 2023

• update readme for helm_fs and yaml for dolly meta (alibaba#645)

  qbc2016

  authored
  ed63f5b

  Copy full SHA for ed63f5b

Commits on Jun 26, 2023

• optimize memory usage (alibaba#646)

  rayrayraykk

  authored
  776f5d1

  Copy full SHA for 776f5d1

Commits on Jun 28, 2023

• update yaml parameters (alibaba#648)

  qbc2016

  authored
  680a763

  Copy full SHA for 680a763

• Fix issues in offsite tuning (alibaba#649)

  Show description for 09aa9d6
  

  rayrayraykk

  and

  HarliWu

  authored
  09aa9d6

  Copy full SHA for 09aa9d6

• optimize memory usage in offsite-tuning

  rayrayraykk

  committed
  0a765ed

  Copy full SHA for 0a765ed

• remove debug

  rayrayraykk

  committed
  24e5925

  Copy full SHA for 24e5925

• fix save_freq bug

  rayrayraykk

  committed
  2495519

  Copy full SHA for 2495519

Commits on Jun 29, 2023

• Merge pull request alibaba#650 from rayrayraykk/opt_ost

  Show description for e9d126a
  ZiTao-Li

  authored
  e9d126a

  Copy full SHA for e9d126a

Commits on Jul 3, 2023

• Support flops calculation on LLM (alibaba#651)

  HarliWu

  authored
  4c752f0

  Copy full SHA for 4c752f0

Commits on Jul 4, 2023

• update readme for docker (alibaba#654)

  qbc2016

  authored
  f9151d7

  Copy full SHA for f9151d7

• Update docker readme (alibaba#655)

  qbc2016

  authored
  3632d6f

  Copy full SHA for 3632d6f

Commits on Jul 5, 2023

• LLM readme & Dockerfile (alibaba#657)

  rayrayraykk

  authored
  eddd176

  Copy full SHA for eddd176

• add prefix tuning, prompt tuning and p-tuning (alibaba#658)

  qbc2016

  authored
  3314d76

  Copy full SHA for 3314d76

Commits on Jul 6, 2023

• Update docker readme (alibaba#656)

  qbc2016

  authored
  9cb009f

  Copy full SHA for 9cb009f

• fix save bug

  rayrayraykk

  committed
  6c74fb9

  Copy full SHA for 6c74fb9

• fix

  rayrayraykk

  committed
  4478209

  Copy full SHA for 4478209

• fix minor bugs

  rayrayraykk

  committed
  880d602

  Copy full SHA for 880d602

• Fix save path of ckpt alibaba#659 from rayrayraykk

  Show description for 634abad
  qbc2016

  authored
  634abad

  Copy full SHA for 634abad

• Fix share_local_model compatibility with model.half() (alibaba#660)

  rayrayraykk

  authored
  cdc17bb

  Copy full SHA for cdc17bb

Commits on Jul 10, 2023

• Update readme for fshelm (alibaba#662)

  qbc2016

  authored
  5b68918

  Copy full SHA for 5b68918

Commits on Jul 11, 2023

• README for LLM (alibaba#661)

  rayrayraykk

  authored
  f0c4e42

  Copy full SHA for f0c4e42

Commits on Jul 12, 2023

• fix minor bugs in fschat(alibaba#663)

  rayrayraykk

  authored
  bed8da9

  Copy full SHA for bed8da9

Commits on Jul 13, 2023

• fix share_local_model (alibaba#665)

  rayrayraykk

  authored
  31e707f

  Copy full SHA for 31e707f

Commits on Jul 14, 2023

• Fix yaml and add warnings for count flops (alibaba#666)

  rayrayraykk

  authored
  3a6a844

  Copy full SHA for 3a6a844

Commits on Jul 19, 2023

• Fix bugs for HumanEval (alibaba#667)

  HarliWu

  authored
  281d9d2

  Copy full SHA for 281d9d2

Commits on Jul 21, 2023

• reimplement pFedme (alibaba#669)

  rayrayraykk

  authored
  1073864

  Copy full SHA for 1073864

Commits on Jul 24, 2023

• Kd alignment for Offsite-tuning (alibaba#668)

  rayrayraykk

  authored
  0aad31e

  Copy full SHA for 0aad31e

Commits on Aug 1, 2023

• fix_div_by_zero (alibaba#673)

  rayrayraykk

  authored
  ec9026d

  Copy full SHA for ec9026d

• Fix offsite tuning eval (alibaba#674)

  rayrayraykk

  authored
  c09bfe0

  Copy full SHA for c09bfe0

Commits on Aug 3, 2023

• Fix and update distillation (alibaba#675)

  rayrayraykk

  authored
  366a180

  Copy full SHA for 366a180

Commits on Aug 8, 2023

• fix bugs for local train of ot (alibaba#678)

  qbc2016

  authored
  0cb5040

  Copy full SHA for 0cb5040

Commits on Aug 9, 2023

• Fix save best model(alibaba#679)

  rayrayraykk

  authored
  688b55d

  Copy full SHA for 688b55d

Commits on Aug 11, 2023

• Need keep raw model when kd applied (alibaba#680)

  rayrayraykk

  authored
  2805af0

  Copy full SHA for 2805af0

Commits on Aug 25, 2023

• modify mmlu eval in fs (alibaba#682)

  qbc2016

  authored
  56c6fec

  Copy full SHA for 56c6fec

Commits on Sep 4, 2023

• [Experimental Feature]DeepSpeed for LLM with standalone and distributed (alibaba#653) (alibaba#684)

  rayrayraykk

  authored
  d29161a

  Copy full SHA for d29161a

• docstring and README for FS-LLM (alibaba#685)

  rayrayraykk

  authored
  4076c16

  Copy full SHA for 4076c16

• Fix URL in LLM banch (alibaba#686)

  rayrayraykk

  authored
  29619c1

  Copy full SHA for 29619c1

Commits on Sep 5, 2023

• add llm part in readme in configuration (alibaba#687)

  qbc2016

  authored
  841d5dc

  Copy full SHA for 841d5dc

• fix half precision for helm (alibaba#690)

  qbc2016

  authored
  3b9e6ae

  Copy full SHA for 3b9e6ae

• change branch name to llm in README (alibaba#691)

  qbc2016

  authored
  68de68e

  Copy full SHA for 68de68e

Commits on Sep 6, 2023

• build paper list for fl-llm (alibaba#693)

  qbc2016

  authored
  3293871

  Copy full SHA for 3293871

• Add unit test for LLMs (alibaba#696)

  rayrayraykk

  authored
  a95bf28

  Copy full SHA for a95bf28

• Add HumanEvalX for eval (alibaba#692)

  rayrayraykk

  authored
  13d1b6d

  Copy full SHA for 13d1b6d

• Support fine-tune LLMs in ModelScope (alibaba#695)

  rayrayraykk

  authored
  28a6109

  Copy full SHA for 28a6109

Commits on Sep 11, 2023

• add retry option when loss is NaN in train and finetune (alibaba#697)

  rayrayraykk

  authored
  b963f62

  Copy full SHA for b963f62

Commits on Sep 20, 2023

• hotfix for get_tokenizer (alibaba#704)

  qbc2016

  authored
  8da9f9f

  Copy full SHA for 8da9f9f

Commits on Dec 25, 2023

• fix typo in readme for helm (alibaba#738)

  qbc2016

  authored
  7f08694

  Copy full SHA for 7f08694

Commits on Oct 6, 2024

• model_builder.py modified to work with bfloat16

  

  id05297

  committed
  d47149d

  Copy full SHA for d47149d

• model_builder.py modified to work with bfloat16

  aleixsant

  committed
  3d2a637

  Copy full SHA for 3d2a637

• Add config files (.yaml, .json...)

  aleixsant

  committed
  0945d7d

  Copy full SHA for 0945d7d

Commits on Oct 7, 2024

• Use_fast changed to True

  aleixsant

  committed
  bb8b6d3

  Copy full SHA for bb8b6d3

Commits on Oct 14, 2024

• New config files

  aleixsant

  committed
  4b4a03e

  Copy full SHA for 4b4a03e

• New readme

  aleixsant

  committed
  70466b3

  Copy full SHA for 70466b3

• New readme

  aleixsant

  committed
  c63b234

  Copy full SHA for c63b234

• New readme

  aleixsant

  committed
  6c1b313

  Copy full SHA for 6c1b313

• New readme

  aleixsant

  committed
  bdb1f3b

  Copy full SHA for bdb1f3b

• New readme

  aleixsant

  committed
  c605f72

  Copy full SHA for c605f72

• New readme

  aleixsant

  committed
  538bc2a

  Copy full SHA for 538bc2a

• New readme

  aleixsant

  committed
  2b47c9d

  Copy full SHA for 2b47c9d

• New readme

  aleixsant

  committed
  1fc5889

  Copy full SHA for 1fc5889

• New readme

  aleixsant

  committed
  04bd483

  Copy full SHA for 04bd483

• New readme

  aleixsant

  committed
  d90bd2f

  Copy full SHA for d90bd2f

• New readme

  aleixsant

  committed
  8f2c0d7

  Copy full SHA for 8f2c0d7

• New config files

  aleixsant

  committed
  a50da04

  Copy full SHA for a50da04

Commits on Oct 15, 2024

• Modifed README_setup.md

  aleixsant

  committed
  007b5d2

  Copy full SHA for 007b5d2

• Modifed README_setup.md

  aleixsant

  committed
  7c170a6

  Copy full SHA for 7c170a6

• Modifed README_setup.md

  aleixsant

  committed
  20fa2d5

  Copy full SHA for 20fa2d5

Commits on Jan 7, 2025

• Update setup.py

  Show description for 029ceeb
  aleixsant

  authored
  029ceeb

  Copy full SHA for 029ceeb