Skip to content

Commit ee8217e

Browse files
authored
Add Mistral to quantization model list (#1278)
1 parent 980dd4a commit ee8217e

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

vllm/model_executor/model_loader.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -35,6 +35,7 @@
3535
# FIXME(woosuk): Remove this once all models support quantization.
3636
_MODEL_CLASSES_SUPPORT_QUANTIZATION = [
3737
LlamaForCausalLM,
38+
MistralForCausalLM,
3839
]
3940

4041

0 commit comments

Comments
 (0)