Skip to content

Commit

Permalink
Llm ppl workflow bug fix (#10128)
Browse files Browse the repository at this point in the history
* add llm-ppl workflow

* update the DATASET_DIR

* test multiple precisions

* modify nightly test

* match the updated ppl code

* add matrix.include

* fix the include error

* update the include

* add more model

* update the precision of include

* update nightly time and add more models

* fix the workflow_dispatch description, change default model of pr and modify the env

* modify workflow_dispatch language options

* modify options

* modify language options

* modeify workflow_dispatch type

* modify type

* modify the type of language

* change seq_len type
  • Loading branch information
hxsz1997 authored Feb 7, 2024
1 parent fe4f4da commit fb0dd7f
Showing 1 changed file with 5 additions and 9 deletions.
14 changes: 5 additions & 9 deletions .github/workflows/llm-ppl-evaluation.yml
Original file line number Diff line number Diff line change
Expand Up @@ -17,9 +17,9 @@ on:
workflow_dispatch:
inputs:
seq_len:
description: 'sequence length, input one number'
description: 'sequence length, input one number and must be quoted.'
required: true
type: number
type: string
model_name:
description: 'Model names, seperated by comma and must be quoted.'
required: true
Expand All @@ -29,13 +29,9 @@ on:
required: true
type: string
language:
description: 'language, can be en, zh, or all'
description: 'language, can be en, zh, or all and must be quoted.'
required: true
type: choice
options:
- "en"
- "zh"
- "all"
type: string
runs-on:
description: 'Labels to filter the runners, seperated by comma and must be quoted.'
default: "accuracy"
Expand Down Expand Up @@ -202,4 +198,4 @@ jobs:
--precisions ${{ matrix.precision }} \
--device ${{ matrix.device }} \
--dataset_path ${DATASET_DIR} \
--language ${{ matrix.language }}
--language ${{ matrix.language }}

0 comments on commit fb0dd7f

Please sign in to comment.