Skip to content

Commit 3a33a96

Browse files
author
Paweł Kędzia
committed
Merge branch 'features/quickstart'
2 parents 05b60f1 + 49dc019 commit 3a33a96

File tree

1 file changed

+3
-1
lines changed

1 file changed

+3
-1
lines changed

examples/quickstart/speakleash-bielik-11b-v2_3-Instruct/run-bielik-11b-v2_3-vllm.sh

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -10,5 +10,7 @@ vllm serve \
1010
--host 0.0.0.0 \
1111
--quantization bitsandbytes \
1212
--load-format bitsandbytes \
13-
--max-model-len=56000 \
1413
--gpu-memory-utilization=0.80
14+
15+
16+
# --max-model-len=56000 \

0 commit comments

Comments
 (0)