How to detect video or webcam?

[Mr-LiuDC]

Hi, Thanks for your example code, it works fine.

I'm new in JavaScript, How to use webcam for live detection?

[Hyuto]

Hello, well it's definitely possible to stream video through webcam, firstly using opencvjs to take every frame from webcam and then do inference just like in the code for every frame.

Although it's possible but the performance is awful, because browser engine isn't suitable for large model like YOLOv7. I suggest to deploy it on the server side (directly on computer machine) to increase performance just like my other repo yolov7-node. On that example yolov7 model is served on server side (node), it transfer image array thought web socket, doing inference on node, and transfer detection result to frontend. The performance is somewhat good.

[Mr-LiuDC]

Thanks. That sounds like a good idea thought web socket and detect on server side. I will hava a try.

[slyang2021]

Hello, well it's definitely possible to stream video through webcam, firstly using opencvjs to take every frame from webcam and then do inference just like in the code for every frame.

Although it's possible but the performance is awful, because browser engine isn't suitable for large model like YOLOv7. I suggest to deploy it on the server side (directly on computer machine) to increase performance just like my other repo yolov7-node. On that example yolov7 model is served on server side (node), it transfer image array thought web socket, doing inference on node, and transfer detection result to frontend. The performance is somewhat good.

I want to implement real-time detection with a webcam now, but I'm not sure how to do it because I'm a JavaScript beginner. Can you explain how to use OpenCV.js specifically? Thanks