Skip to content

Conversation

Czaki
Copy link

@Czaki Czaki commented Jul 20, 2025

Purpose

As tasks split for parallel processing may not have the same length, the hard split on chunks may lead to a situation when most calculations belong to one worker; then, speedup for parallelization may be smaller than expected.

References

fixes #6330

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
internals:parallel sprint For work completed at a conference or similar event.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

use a queue for reading files in parallel
3 participants