[Bug]: shardDelegator leak

[zhengbuqian]

Is there an existing issue for this?

• I have searched the existing issues

Environment

- Milvus version:
- Deployment mode(standalone or cluster):
- MQ type(rocksmq, pulsar or kafka):    
- SDK version(e.g. pymilvus v2.0.0rc2):
- OS(Ubuntu or CentOS): 
- CPU/Memory: 
- GPU: 
- Others:

Current Behavior

after a collection is released, the shardDelegator object will continue to live and cannot be GC-ed

Expected Behavior

No response

Steps To Reproduce

Milvus Log

No response

Anything else?

No response