Skip to content

Allow streamed responses with Ollama tools #904

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

timfel
Copy link
Contributor

@timfel timfel commented Jun 11, 2025

As of https://github.com/ollama/ollama/releases/tag/v0.8.0 Ollama allows streaming responses with tool calls.

@karthink
Copy link
Owner

Thanks for the PR. The line you changed just removes the check to disable streaming when using tools with Ollama. There is no actual logic in gptel-ollama.elfor parsing streaming tool calls.

Have you tried testing your change?

@timfel
Copy link
Contributor Author

timfel commented Jun 12, 2025

I don't seem to be getting very consistent streaming with any ollama model with or without tools, unfortunately. I'll try to figure that out and then try to find a bit of time to work on making this actually work.

@karthink karthink added the waiting Waiting for a response from another party. label Jul 9, 2025
@karthink
Copy link
Owner

@timfel Did you have any luck getting streaming + tools to work with Ollama?

@timfel
Copy link
Contributor Author

timfel commented Jul 29, 2025

@timfel Did you have any luck getting streaming + tools to work with Ollama?

Sorr, no, I did not have much time to try it. Feel free to close.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
waiting Waiting for a response from another party.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants