Skip to content

v1.6.0

Latest
Compare
Choose a tag to compare
@dianjixz dianjixz released this 03 Apr 07:10
· 74 commits to main since this release
  • Modify llm-yolo to support asynchronous inference
  • Add yolo.boxV2 return structure to llm-yolo
  • Modify llm-llm to support asynchronous inference
  • Optimize inference speed for llm-llm
  • Optimize image data output for llm-camera
  • Add openai-api module to provide OpenAI API services
  • Add qwen2.5-1.5B-Int4-ax630c Int4 quantized model
  • Add qwen2.5-0.5B-Int4-ax630c Int4 quantized model