Hi, On Wed, Jan 29, Guillaume Gardet wrote:
-----Original Message----- From: Thorsten Kukuk
Sent: 29 January 2020 17:16 To: opensuse-kubic@opensuse.org Subject: [opensuse-kubic] Elastic Inference Demo available
Our containers are much smaller, are much more robust ;) and the demo runs even on a Raspberry Pi4 running openSUSE Kubic! Ok, the frame rate on a Raspberry Pi4 is really, really bad :(, but we are working on this ;) Intel released last night the Device Plugin for Kubernetes for the Myriad Cards, so the next step will be to get this working with the Intel Neural Compute Stick2 on Raspberry Pi4. Currently, the Raspberry Pi4 manages 0.08 fps, with the stick it's 267 fps ;)
Any idea what is the bottleneck on RPi4?
My guess is the CPU. To get better compareable Numbers, I used the benchmark app with the same image, the choosen model precision was FP16. Raspberry Pi4 (CPU): ~8 FPS ThinkPad X1 (CPU): ~112 FPS Intel NCS2: ~267 FPS (independent of if used on the Raspberry Pi4 or X1). Thorsten -- Thorsten Kukuk, Distinguished Engineer, Senior Architect SLES & MicroOS SUSE Software Solutions Germany GmbH, Maxfeldstr. 5, 90409 Nuernberg, Germany Managing Director: Felix Imendoerffer (HRB 36809, AG Nürnberg) -- To unsubscribe, e-mail: opensuse-kubic+unsubscribe@opensuse.org To contact the owner, e-mail: opensuse-kubic+owner@opensuse.org