Skip to content

feat: Add streaming support for Mistral v11 tool format #20503

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 12 commits into
base: main
Choose a base branch
from
Open

feat: Add streaming support for Mistral v11 tool format #20503

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
12 commits
Select commit Hold shift + click to select a range
976dc82
feat: Add streaming support for v11 tool format in Mistral parser
sjuxax Jul 4, 2025
c78d1fb
Bring in tests from #19425
avigny Jul 4, 2025
2dedc6e
Update vllm/entrypoints/openai/tool_parsers/mistral_tool_parser.py
sjuxax Jul 12, 2025
5966d37
fix: prevent infinite loop in Mistral tool parsing by removing proces…
sjuxax Jul 4, 2025
9670aee
refactor: improve JSON parsing for Mistral tool calls with robust reg…
sjuxax Jul 4, 2025
f280821
refactor: Improve quote normalization in tool call parsing to prevent…
sjuxax Jul 4, 2025
ed3dc1d
refactor: remove quote normalization from Mistral tool parser
sjuxax Jul 4, 2025
d089554
refactor: optimize tool call parsing by removing substring operations…
sjuxax Jul 4, 2025
dee4d43
refactor: Replace `X | Y` union syntax with `Union` for Python 3.9 co…
sjuxax Jul 4, 2025
b521f50
feat: add comprehensive tests for Mistral v11 tool format
sjuxax Jul 4, 2025
2966baa
ruff/yapf
sjuxax Jul 13, 2025
ef4d46c
Via Grok4: attempt to fix non-streaming and multiple tool calls
sjuxax Jul 13, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Loading
Loading