[opensuse-kubic] Elastic Inference Demo available
Hi, I'm pretty sure some of you know the Elastic Infernece Demo from Intel for Clear Linux. Since Intel released the source code end of last year, I ported, build and packaged it for and run it on openSUSE Kubic. The goal is to use it as demo for SUSECon 2020: https://en.opensuse.org/Kubic:Elastic_Inference_Demo Maybe it's from interest for others, too, who need an eye catching demo. Our containers are much smaller, are much more robust ;) and the demo runs even on a Raspberry Pi4 running openSUSE Kubic! Ok, the frame rate on a Raspberry Pi4 is really, really bad :(, but we are working on this ;) Intel released last night the Device Plugin for Kubernetes for the Myriad Cards, so the next step will be to get this working with the Intel Neural Compute Stick2 on Raspberry Pi4. Currently, the Raspberry Pi4 manages 0.08 fps, with the stick it's 267 fps ;) And we think about to create an inference model for our gecko! Help is always welcome. Thorsten -- Thorsten Kukuk, Distinguished Engineer, Senior Architect SLES & MicroOS SUSE Software Solutions Germany GmbH, Maxfeldstr. 5, 90409 Nuernberg, Germany Managing Director: Felix Imendoerffer (HRB 36809, AG Nürnberg) -- To unsubscribe, e-mail: opensuse-kubic+unsubscribe@opensuse.org To contact the owner, e-mail: opensuse-kubic+owner@opensuse.org
Hi,
-----Original Message----- From: Thorsten Kukuk <kukuk@suse.de> Sent: 29 January 2020 17:16 To: opensuse-kubic@opensuse.org Subject: [opensuse-kubic] Elastic Inference Demo available
Hi,
I'm pretty sure some of you know the Elastic Infernece Demo from Intel for Clear Linux. Since Intel released the source code end of last year, I ported, build and packaged it for and run it on openSUSE Kubic. The goal is to use it as demo for SUSECon 2020:
It looks good!
Maybe it's from interest for others, too, who need an eye catching demo.
Our containers are much smaller, are much more robust ;) and the demo runs even on a Raspberry Pi4 running openSUSE Kubic! Ok, the frame rate on a Raspberry Pi4 is really, really bad :(, but we are working on this ;) Intel released last night the Device Plugin for Kubernetes for the Myriad Cards, so the next step will be to get this working with the Intel Neural Compute Stick2 on Raspberry Pi4. Currently, the Raspberry Pi4 manages 0.08 fps, with the stick it's 267 fps ;)
Any idea what is the bottleneck on RPi4? Cheers, Guillaume
And we think about to create an inference model for our gecko!
Help is always welcome.
Thorsten
-- Thorsten Kukuk, Distinguished Engineer, Senior Architect SLES & MicroOS SUSE Software Solutions Germany GmbH, Maxfeldstr. 5, 90409 Nuernberg, Germany Managing Director: Felix Imendoerffer (HRB 36809, AG Nürnberg) -- To unsubscribe, e-mail: opensuse-kubic+unsubscribe@opensuse.org To contact the owner, e-mail: opensuse-kubic+owner@opensuse.org
IMPORTANT NOTICE: The contents of this email and any attachments are confidential and may also be privileged. If you are not the intended recipient, please notify the sender immediately and do not disclose the contents to any other person, use it for any purpose, or store or copy the information in any medium. Thank you. -- To unsubscribe, e-mail: opensuse-kubic+unsubscribe@opensuse.org To contact the owner, e-mail: opensuse-kubic+owner@opensuse.org
Hi, On Wed, Jan 29, Guillaume Gardet wrote:
-----Original Message----- From: Thorsten Kukuk <kukuk@suse.de> Sent: 29 January 2020 17:16 To: opensuse-kubic@opensuse.org Subject: [opensuse-kubic] Elastic Inference Demo available
Our containers are much smaller, are much more robust ;) and the demo runs even on a Raspberry Pi4 running openSUSE Kubic! Ok, the frame rate on a Raspberry Pi4 is really, really bad :(, but we are working on this ;) Intel released last night the Device Plugin for Kubernetes for the Myriad Cards, so the next step will be to get this working with the Intel Neural Compute Stick2 on Raspberry Pi4. Currently, the Raspberry Pi4 manages 0.08 fps, with the stick it's 267 fps ;)
Any idea what is the bottleneck on RPi4?
My guess is the CPU. To get better compareable Numbers, I used the benchmark app with the same image, the choosen model precision was FP16. Raspberry Pi4 (CPU): ~8 FPS ThinkPad X1 (CPU): ~112 FPS Intel NCS2: ~267 FPS (independent of if used on the Raspberry Pi4 or X1). Thorsten -- Thorsten Kukuk, Distinguished Engineer, Senior Architect SLES & MicroOS SUSE Software Solutions Germany GmbH, Maxfeldstr. 5, 90409 Nuernberg, Germany Managing Director: Felix Imendoerffer (HRB 36809, AG Nürnberg) -- To unsubscribe, e-mail: opensuse-kubic+unsubscribe@opensuse.org To contact the owner, e-mail: opensuse-kubic+owner@opensuse.org
participants (2)
-
Guillaume Gardet -
Thorsten Kukuk