Skip to content

推理速度很慢 #4

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
ljicher opened this issue Aug 15, 2023 · 6 comments
Open

推理速度很慢 #4

ljicher opened this issue Aug 15, 2023 · 6 comments

Comments

@ljicher
Copy link

ljicher commented Aug 15, 2023

代码是cpu下的吗,比python版本还更耗时

@AIDajiangtang
Copy link
Owner

代码是cpu下的吗,比python版本还更耗时

推理引擎用的是onnxruntime CPU版本,如果电脑有GPU,可以尝试GPU版本
https://github.com/microsoft/onnxruntime/releases/download/v1.15.1/onnxruntime-win-x64-gpu-1.15.1.zip

@zhongyisang
Copy link

想问一下有成功改造到gpu上么,我这边遇见了一些问题

@AIDajiangtang
Copy link
Owner

AIDajiangtang commented Aug 24, 2023 via email

@newforrestgump001
Copy link

gpu 挺快的,有问题可以一起讨论。

@zzulidamao
Copy link

@newforrestgump001 在gpu上大概多久?我测试在gpu上需要9秒左右,light-glue推理需要4秒多?请问你是自己改动代码到gpu上吗?

@zouwen198317
Copy link

我在GPU上测试,也很慢,

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

6 participants