Skip to content

Commit 9559897

Browse files
committed
fix docs
Signed-off-by: okada shintarou <[email protected]>
1 parent f2bc427 commit 9559897

File tree

1 file changed

+8
-0
lines changed

1 file changed

+8
-0
lines changed

docs/features/tool_calling.md

Lines changed: 8 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -97,6 +97,14 @@ vLLM supports the `tool_choice='required'` option in the chat completion API. Si
9797

9898
When tool_choice='required' is set, the model is guaranteed to generate one or more tool calls based on the specified tool list in the `tools` parameter. The number of tool calls depends on the user's query. The output format strictly follows the schema defined in the `tools` parameter.
9999

100+
## None Function Calling
101+
102+
vLLM supports the `tool_choice='none'` option in the chat completion API. When this option is set, the model will not generate any tool calls and will respond with regular text content only, even if tools are defined in the request.
103+
104+
By default, when `tool_choice='none'` is specified, vLLM excludes tool definitions from the prompt to optimize context usage. To include tool definitions even with `tool_choice='none'`, use the `--expand-tools-even-if-tool-choice-none` option.
105+
106+
Note: This behavior will change in v0.10.0, where tool definitions will be included by default even with `tool_choice='none'`.
107+
100108
## Automatic Function Calling
101109

102110
To enable this feature, you should set the following flags:

0 commit comments

Comments
 (0)