Skip to content

Commit 3db96ac

Browse files
committed
add acc test
Signed-off-by: MrZ20 <2609716663@qq.com>
1 parent 5db67df commit 3db96ac

File tree

3 files changed

+21
-2
lines changed

3 files changed

+21
-2
lines changed

.github/workflows/accuracy_test.yaml

Lines changed: 13 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -53,20 +53,31 @@ jobs:
5353
model_name: Qwen2-Audio-7B-Instruct
5454
- runner: a2-2
5555
model_name: Qwen3-30B-A3B
56-
- runner: a2-2
57-
model_name: Qwen3-VL-30B-A3B-Instruct
56+
# This model has a bug that needs to be fixed and re added
57+
# - runner: a2-2
58+
# model_name: Qwen3-VL-30B-A3B-Instruct
5859
- runner: a2-2
5960
model_name: DeepSeek-V2-Lite
6061
- runner: a2-4
6162
model_name: Qwen3-Next-80B-A3B-Instruct
63+
<<<<<<< HEAD
6264
- runner: a2-1
6365
model_name: Qwen3-8B-W8A8
66+
=======
67+
>>>>>>> a6f8422 (add acc test)
6468
- runner: a2-1
6569
model_name: Qwen3-VL-8B-Instruct
6670
- runner: a2-1
6771
model_name: Qwen2.5-Omni-7B
6872
- runner: a2-1
6973
model_name: Meta-Llama-3.1-8B-Instruct
74+
<<<<<<< HEAD
75+
=======
76+
- runner: a2-2
77+
model_name: ERNIE-4.5-21B-A3B-PT
78+
- runner: a2-1
79+
model_name: Mistral-7B-Instruct-v0.1
80+
>>>>>>> a6f8422 (add acc test)
7081
fail-fast: false
7182
# test will be triggered when tag 'accuracy-test' & 'ready-for-test'
7283
if: >-

tests/e2e/models/configs/ERNIE-4.5-21B-A3B-PT.yaml

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,8 @@
11
model_name: "PaddlePaddle/ERNIE-4.5-21B-A3B-PT"
2+
<<<<<<< HEAD
23
hardware: "Atlas A2 Series"
4+
=======
5+
>>>>>>> a6f8422 (add acc test)
36
tasks:
47
- name: "gsm8k"
58
metrics:

tests/e2e/models/configs/Mistral-7B-Instruct-v0.1.yaml

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,4 +1,9 @@
1+
<<<<<<< HEAD
12
model_name: "mistralai/Mistral-7B-Instruct-v0.1"
3+
=======
4+
model_name: "AI-ModelScope/Mistral-7B-Instruct-v0.1"
5+
runner: "linux-aarch64-a2-1"
6+
>>>>>>> a6f8422 (add acc test)
27
hardware: "Atlas A2 Series"
38
tasks:
49
- name: "gsm8k"

0 commit comments

Comments
 (0)