Skip to content

Commit fcd915a

Browse files
mgoinjingyu
authored andcommitted
[CI Bugfix] Fix CI OOM for test_shared_storage_connector_hashes (vllm-project#21973)
Signed-off-by: mgoin <[email protected]> Signed-off-by: jingyu <[email protected]>
1 parent 9139458 commit fcd915a

File tree

1 file changed

+3
-1
lines changed

1 file changed

+3
-1
lines changed

tests/v1/kv_connector/unit/test_shared_storage_connector.py

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -10,7 +10,7 @@
1010
from vllm.config import KVTransferConfig
1111
from vllm.multimodal.utils import encode_image_base64
1212

13-
MODEL_NAME = "Qwen/Qwen2.5-VL-3B-Instruct"
13+
MODEL_NAME = "RedHatAI/Qwen2.5-VL-3B-Instruct-quantized.w4a16"
1414

1515
SAMPLING_PARAMS = SamplingParams(temperature=0.0, top_k=1, max_tokens=128)
1616

@@ -130,6 +130,8 @@ def test_shared_storage_connector_hashes(tmp_path):
130130
model=MODEL_NAME,
131131
max_model_len=8192,
132132
max_num_seqs=1,
133+
gpu_memory_utilization=0.4,
134+
enforce_eager=True,
133135
kv_transfer_config=kv_transfer_config,
134136
limit_mm_per_prompt={"image": 2},
135137
)

0 commit comments

Comments
 (0)