Skip to content

Issues: InternLM/lmdeploy

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

374 Open 1,382 Closed
374 Open 1,382 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

[Bug] gemm_config.in is not found; using default GEMM algo awaiting response
#3259 opened Mar 14, 2025 by winni0
3 tasks
1
[Bug] RuntimeError: CUDA error: an illegal memory access was encountered
#3258 opened Mar 14, 2025 by github-eliviate
2 of 3 tasks
@grimoire
1
[Bug] Vulnerability Report: load_weight_ckpt function vulnerable to arbitrary code execution via untrusted (.pt) file deserialization
#3255 opened Mar 14, 2025 by ybdesire
3 tasks done
[Bug] Vulnerability Report: Code Injection Risk Due to Unsafe Usage of 'exec' and 'compile' in Code
#3254 opened Mar 14, 2025 by ybdesire
3 tasks done
@lvhan028
2
[Bug] bug for qwen-2.5-vl-7B-AWQ ,transformers &LMDeploy version conflict
#3250 opened Mar 13, 2025 by Kenneth-X
3 tasks done
@CUHKSZzxy
1
[Bug] 部署qwen2.5-vl-7b之后，如果想传入视频的话，部署命令需要调整什么吗？
#3249 opened Mar 13, 2025 by lmingze
3 tasks
1
[Bug] InternVL_2.5-78B-MPO-AWQ parallel run failed
#3248 opened Mar 13, 2025 by philipwan
3 tasks
1
[Bug] 部署的qwen2.5 vl 7b之后，跑着跑着报错，接口调用失败怎么回事？
#3244 opened Mar 12, 2025 by lmingze
3 tasks
@CUHKSZzxy
1
是否支持VLM 输出logprobs
#3243 opened Mar 12, 2025 by hxyghostor
@CUHKSZzxy
6
使用batch推理进行多轮对话
#3238 opened Mar 11, 2025 by 2kxx
1
[Bug] NPU下Qwen2.5-VL推理报错
#3237 opened Mar 10, 2025 by tcye
3 tasks done
@jinminxi104 @yao-fengchen
5
[Bug] 批量推理时显示eos stop_words_list 长度超限，最后(core dumped)
#3233 opened Mar 8, 2025 by Kismeu
1 of 3 tasks
@irexyc
1
Support for Flash Attention 3 for Ampere, Ada, and Hopper in LMDeploy
#3232 opened Mar 8, 2025 by radna0
@lzhangzz
[Bug] 使用profile_restful_api.py测试api_server时出现若干bug
#3231 opened Mar 8, 2025 by cccccya
3 tasks
@grimoire
1
[Bug] 使用lmdeploy serve proxy 分发服务管理下游服务，导致stream模式丢失
#3227 opened Mar 7, 2025 by Gierry
3 tasks
@AllentDan
3
VLM的serve支持请求分发/负载均衡吗？
#3226 opened Mar 7, 2025 by yaogang2060
@AllentDan
7
[Bug]使用wsl的Ubuntu22.04系统，lmdeploy任何版本使用pytorch引擎部署，加载权重文件非常卡，单个权重文件(144s/it),32B-AWQ启动 一次需要10分钟
#3225 opened Mar 6, 2025 by Gierry
3 tasks done
@grimoire
8
[Bug] no chat-template for QwQ 32B AWQ
#3224 opened Mar 6, 2025 by HuChundong
3 tasks
@AllentDan
4
lmdeploy + batch inference是推理加速的极限吗？
#3222 opened Mar 6, 2025 by nzomi
@lvhan028
1
[Bug] libharpcuda.so.0: cannot open shared object file: No such file or directory
#3211 opened Mar 4, 2025 by 3mpt
3 tasks
@RunningLeon
1
[Bug]在910B上量化后部署好无法正常访问
#3201 opened Mar 3, 2025 by jxz542189
3 tasks done
@jinminxi104
1
[HELP] 求好心人帮忙量化 DeepSeek-R1-Distill-Qwen-32B 到 int8
#3200 opened Mar 1, 2025 by SolomonLeon
1
LMDeploy Lite vs LLM Compressor
#3199 opened Mar 1, 2025 by radna0
3
[Feature] 看起来ledeploy好像天然支持替换矩阵乘法的计算。deepGEMM 刚刚发布了。怎么用
#3191 opened Feb 26, 2025 by xiezhipeng-git
[Feature] accelerate QwenEncoder
#3185 opened Feb 25, 2025 by abc8350712
ProTip! Type g i on any issue or pull request to go back to the issue listing page.