Skip to content

Commit 2101463

Browse files
author
Lu, Ken
committed
Update the CPU_ISA and ATEN_CPU_CAPABILITY to avx512
Signed-off-by: Lu, Ken <ken.lu@intel.com>
1 parent 2653e77 commit 2101463

File tree

1 file changed

+3
-2
lines changed

1 file changed

+3
-2
lines changed

deployment/cse-aigc-worker-non.yaml

Lines changed: 3 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -28,10 +28,11 @@ spec:
2828
protocol: TCP
2929
env:
3030
- name: MODEL_NAME
31-
#value: "vicuna-7b-v1.3"
3231
value: "Llama-2-7b-chat-hf-sharded-bf16"
3332
- name: CPU_ISA
34-
value: "avx2"
33+
value: "avx512"
34+
- name: ATEN_CPU_CAPABILITY
35+
value: "avx512"
3536
- name: DEPLOY_TYPE
3637
value: "model"
3738
- name: FASTCHAT_ROOT

0 commit comments

Comments
 (0)