Skip to content

[Bugfix] Fix early return in CustomDeepseekV2MoE.forward during profile_run #682

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
Apr 29, 2025

Conversation

ApsarasX
Copy link
Contributor

What this PR does / why we need it?

Fix #674

Does this PR introduce any user-facing change?

No

How was this patch tested?

@ApsarasX ApsarasX force-pushed the fix-moe-attn_metadata branch from 7d2f8bb to 1dbaa8d Compare April 27, 2025 12:00
@ApsarasX ApsarasX marked this pull request as ready for review April 27, 2025 13:05
Copy link
Collaborator

@ganyi1996ppo ganyi1996ppo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good to me, please double confirm this @wangxiyuan

@wangxiyuan wangxiyuan merged commit 87975fa into vllm-project:main Apr 29, 2025
14 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
3 participants