Hey friends, I've set up Scrypted and have been running it for awhile now. I have it running on Intel hardware with 8 dedicated cores, and an NVIDIA 5080 GPU.
I'm running the nvidia docker image, and have installed the nvidia drivers and nvidia container toolkit. In the ONNX Object Detection plugin in Scrypted I can select Device ID "0" for the card, it shows "CUDAExecutionProvider" under Execution Device, and in the settings per camera for "Object Detection" I set Decoder to "cuda" and Post Processing to "Hardware".
Running the Diagnostics plugin on System yields:
GPU Decode
Running OK
I monitor the host by ssh to prompt and watching htop output. CPU usage across all cores is super low. Lots of "prebuffer-mixin" processes running (which is weird because I don't have prebuffering turned on, but that's for another time). Everything seems okay.
BUT every once in awhile I notice it lagging a bunch, I'll log in and check and it's like scrypted lost awareness of the GPU. Looking at htop then, all CPU cores are pegged, and there are a bunch of onnx processes suddenly listed as running. To me this indicates the cpu is processing object detection and not the gpu. I go to the gear icon in Scrypted management UI, do a Restart under "Server Management", and it's all good again. Everything shows up.
Any thoughts on this, or things to watch for? Any type of watchdog I can run?
Many thanks!