🚀 Feature

• Enable yolov5 deployment to torchserve on docker (GPU compatible).
• Use a fixed batch_size (fill with 0 for fast inference if the batch is not full)

Motivation

I wanted to use YOLOv5 for my personal projects, using a GPU with fixed batch inference (multiple videos in concurrences),
and TorchServe seemed to be the best option. For this reason, I wanted to share this with the community, as I had some issues in settings things up (especially the handler file).

Pitch

Just sharing things :)

You can check this feature on this github repository:
https://github.com/louisoutin/yolov5_torchserve

Any feedbacks are welcome, thanks!