Skip to content

Issues: InternLM/lmdeploy

Beta
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

445 Open 1,465 Closed
445 Open 1,465 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

如何设置显存占比
#3588 opened May 25, 2025 by jarry126
how to calculate number of token
#3586 opened May 23, 2025 by Kenneth-X
[Bug] 高并发下请求异常
#3585 opened May 23, 2025 by czcl
3 tasks
[Bug] run glm4 error
#3583 opened May 23, 2025 by datalee
3 tasks done
[Bug] pytorch后端 结构化输出报错
#3581 opened May 22, 2025 by ZanePoe
3 tasks done
[Bug] Failed to create QP when running in PD disaggregation mode
#3579 opened May 21, 2025 by Risc-lt
3 tasks done
[Bug] internvl3-8b cannot be quantized on 3090.
#3576 opened May 20, 2025 by zhulinJulia24
3 tasks
[Feature] qwen3可以关闭think吗？
#3574 opened May 19, 2025 by anrgct
[Bug] Stress test memory error
#3571 opened May 17, 2025 by bltcn
3 tasks
2
[Feature] require support Qwen2.5-Omni-7B backlog
#3569 opened May 17, 2025 by bltcn
[Bug] V100服务启动时卡住没有反应
#3568 opened May 17, 2025 by muziyongshixin
3 tasks
transform部署和lmdeploy部署结果不一致
#3565 opened May 16, 2025 by gitmhg
[Feature] 是否有计划将convert逻辑优化成多进程(非多线程，依然是单核跑满)，希望能CPU多核跑满
#3558 opened May 14, 2025 by Gierry
[Bug] 使用Turbomind启动服务，当并发过多的时候会导致OOM，然后服务直接自杀了，希望能改进成OOM之前判断是否能处理，不能处理就一个个处理，不要服务直接自杀，非常感谢
#3557 opened May 14, 2025 by Gierry
3 tasks
[Bug] qwen3-awq internal error happened
#3554 opened May 14, 2025 by maxin9966
2 of 3 tasks
4
turbomind attention算子接口求助
#3553 opened May 14, 2025 by Lubenwei-nb123
5
[Bug] 请问lmdeploy支持k8s方式在昇腾机器上的多节点部署吗
#3551 opened May 14, 2025 by winni0
3 tasks done
@jinminxi104
[Bug] install with pip will reinstall cpu version of torch
#3549 opened May 14, 2025 by kaiwang0112006
3 tasks done
[Bug] RuntimeError: yaml-cpp: error at line 13, column 30: bad conversion awaiting response
#3544 opened May 13, 2025 by wwwwk123
3 tasks done
1
@lvhan028
6
[Bug] Qwen3-235B-A22B-FP8 cannot be loaded using pytorch
#3542 opened May 13, 2025 by Juniper1021
3 tasks done
@CUHKSZzxy
8
[Bug] InternVL2.5 78B stuck during inference
#3529 opened May 8, 2025 by Bezdarnost
3 tasks done
1
[Bug] 使用lmdeploy部署internvl-38b-mpo-awq，在dify上使用接口的时候报错，是什么原因导致？ awaiting response Stale
#3528 opened May 8, 2025 by lmingze
3 tasks
2
[Feature] turbomind for qwen2.5VL backlog
#3525 opened May 7, 2025 by BoweiPu
1
[Bug] lora微调internvl2.58B并合并后，无法推理，报错 awaiting response Stale
#3524 opened May 7, 2025 by fighterzzzh
1 of 3 tasks
2
[Bug] Qwen2.5-VL-7B-Instruct-AWQ，Asecnd 910B，Inference BUG
#3521 opened May 7, 2025 by daiqifeng-sys
3 tasks done
@jinminxi104
ProTip! Follow long discussions with comments:>50.