Skip to content

Commit 49dc019

Browse files
author
Paweł Kędzia
committed
Disable --max-model-len option in the Bielik‑11B‑v2.3‑Instruct vLLM quick‑start script.
1 parent f69999d commit 49dc019

File tree

1 file changed

+3
-1
lines changed

1 file changed

+3
-1
lines changed

examples/quickstart/speakleash-bielik-11b-v2_3-Instruct/run-bielik-11b-v2_3-vllm.sh

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -10,5 +10,7 @@ vllm serve \
1010
--host 0.0.0.0 \
1111
--quantization bitsandbytes \
1212
--load-format bitsandbytes \
13-
--max-model-len=56000 \
1413
--gpu-memory-utilization=0.80
14+
15+
16+
# --max-model-len=56000 \

0 commit comments

Comments
 (0)