October 2018 - openSUSE Kubic - openSUSE Mailing Lists

[opensuse-kubic] cloud-init broken?
by Panagiotis Georgiadis 29 Oct '18

29 Oct '18

Hi folks, I am trying using the latest snapshot for Kubic, that is 'openSUSE-Tumbleweed-Kubic-DVD-x86_64-Snapshot20181026-Media.iso' and I've noticed that 'kubeadm init' fails [1] because cloud-init couldn't setup the network during boot time. > ImportError: libffi.so.7: cannot open shared object file: No such file > or directory See [2] Can you confirm this? Is this known? [1] http://alfano.arch.suse.de/tests/107#step/kubeadm_init/10 [2] http://alfano.arch.suse.de/tests/107#step/first_boot/2 PS: This was found while testing https://trello.com/c/SQERZKi0/39-openqa-testing-for-kubeadm -- Panagiotis Georgiadis Software Engineer - Containers & Kubernetes HA/Perf/Scale SUSE -- To unsubscribe, e-mail: opensuse-kubic+unsubscribe(a)opensuse.org To contact the owner, e-mail: opensuse-kubic+owner(a)opensuse.org

2 1

[opensuse-kubic] Training Manifests in OpenSUSE Github
by J. S. Evans 22 Oct '18

22 Oct '18

Hi all, I meant to post this last week but spent most of the time in bed sick. I would like to add the K8ts manifests and Helm charts that we use for the official CaaSP training courses in the OpenSUSE Github. They would be open-sourced and available for users to test and use on Kubic primarily and open for pushes from the OpenSUSE community. I would only be uploading Kubernetes manifests, Helm charts, and brief descriptions. We will not be uploading actual SUSE course material such as PDF's etc. As we spoke in the Kubic meeting last week, one thing that I would like to come out of these manifests, etc. is a Kubic-centric alternative to Redhat's http://kubernetesbyexample.com/ on the OpenSUSE wiki. What I am asking is to be added to the OpenSUSE org in Github and a new public repository and admin rights for only that repository so that I can approve pull requests (if that is possible). Here are some examples of the exercises for the CaaSP 3 training course that I can share now. There will be more and different exercises in the future. Deploy a Simple Pod Delete and then Redeploy a Deployment Expose a Service Running in a Pod Update a Pod Update a Pod Via Rolling Updates Scale a Deployment Use Environment Variables in a Pod Deploy a Stateful App with Volume Storage Configure NFS Persistent Storage Configure Persistent Storage with a NFS StorageClass Define and Access a Secret in Kubic Define Limits for Containers and Pods CaaS Platform Network and Logs Create a Helm Repository Deploy an Application with Helm -- Jason Evans Training Engineer SUSE Inc. jevans(a)suse.com https://training.suse.com Mobile: +420 799 797 827 -- To unsubscribe, e-mail: opensuse-kubic+unsubscribe(a)opensuse.org To contact the owner, e-mail: opensuse-kubic+owner(a)opensuse.org

1 0

[opensuse-kubic] Weekly Kubic Project sync meeting minutes 2018-10-16
by Rafael Fernández López 16 Oct '18

16 Oct '18

Hello, Another week, another minutes. ``` Meeting: Weekly Kubic Project sync meeting Date: 2018-10-16 15:00:00 UTC Location: IRC (chat.freenode.net, #kubic channel) Attendees (alphabetically sorted): * ereslibre * sysrich * tgeek * vrothberg Only attendees that interacted are recorded. This is an open meeting, so the list of attendees could potentially be bigger. Minutes: * cri-o, multi machine openQA testing (sysrich) 2018-10-16 17:00:49 sysrich o/ no news from me really this week - cri-o 1.12 is still WIP and monitoring upstream suggests they're knocking out the last awkward fixes. multi-machine openQA testing is progressing slowly, but I REALLY want to have something working by the end of this week. Because I won't be around for the next 3 weeks due to conference travel and vacation. * kubeadm upstream work (ereslibre) 2018-10-16 17:01:11 ereslibre I'll start: I've been working on a couple of issues upstream on kubeadm; nothing really important to share, just upstream work * podman container runlabel (vrothberg) 2018-10-16 17:01:53 vrothberg o/ the latest version of podman supports runlabels via `podman container runlabel $LABEL $IMAGE` 2018-10-16 17:02:22 vrothberg This allows to execute commands on the host specified by the image in the $LABEL. 2018-10-16 17:02:40 vrothberg I see some usecases for the work on the Kubic init-container * new kubic images location (tgeek) 2018-10-16 17:04:38 tgeek I notced that there have been no new Kubic image since August. With there be any more in the future? 2018-10-16 17:05:10 tgeek specifically the ones here: https://download.opensuse.org/repositories/devel:/CaaSP:/images/images/ 2018-10-16 17:05:41 ereslibre tgeek: the ones with the new kubic (experimental) are here: https://download.opensuse.org/repositories/devel:/kubic:/images:/experiment… 2018-10-16 17:05:54 tgeek thank you ``` Cheers, Rafa.

1 0

[opensuse-kubic] Weekly Kubic Project sync meeting minutes 2018-10-09
by Rafael Fernández López 09 Oct '18

09 Oct '18

Hello, Another week, another minutes. This time a very active one! This time I did some manual work to order the conversations inside their main topics, please answer here if I managed to do something wrong! ``` Meeting: Weekly Kubic Project sync meeting Date: 2018-10-09 15:00:00 UTC Location: IRC (chat.freenode.net, #kubic channel) Attendees (alphabetically sorted): * ereslibre * marekcounts * sysrich Only attendees that interacted are recorded. This is an open meeting, so the list of attendees could potentially be bigger. Minutes: * kubeadm upstream work (marekcounts) 2018-10-09 17:01:13 marekcounts For the last few days i've been helping upstream kubeadm with the isolation of the self hosting feature. 2018-10-09 17:01:47 marekcounts looking on completing that in the next few weeks. 2018-10-09 17:01:50 ereslibre marekcounts: just to clarify: this is kept but it won't be supported for upgrades right? As far as I understood we need to work on a KEP for this, right? 2018-10-09 17:02:01 marekcounts correct. 2018-10-09 17:02:20 marekcounts We are keeping the feture. making it it's own thing and removing it from normal kubeadm upgrades * 1.12 cri-o and kubernetes releases (sysrich) 2018-10-09 17:03:24 sysrich from my side, it's mostly been small tweaks and tunings this week. We're still waiting for upstream to release cri-o 1.12 so all the kubernetes 1.12 submissions are baking in devel:kubic. That's it from me * kubeadm upstream work (ereslibre) 2018-10-09 17:04:12 ereslibre from my side not much: I've contributed a little PR to kubeadm upstream and working in kubic-init ``` Cheers, Rafa.

1 0

[opensuse-kubic] *.yaml files for pods
by Thorsten Kukuk 04 Oct '18

04 Oct '18

Hi, if we ship pods like kured (kubernetes reboot daemon) or anything else like a monitoring or logging solution, how should we provide the required *.yaml files to start the pods on the cluster? E.g. for the kured container we need to apply: - kured-rbac.yaml to allow kured to drain the node - kured-ds.yaml to start the daemonset If we make kured a required default, it's easy. But what if this should be optional? What would be the best/official solution to provide users with this files, so that they can download the image from our registry and run it on the kubic cluster? Thanks, Thorsten -- Thorsten Kukuk, Distinguished Engineer, Senior Architect SLES & CaaSP SUSE LINUX GmbH, Maxfeldstr. 5, 90409 Nuernberg, Germany GF: Felix Imendoerffer, Jane Smithard, Graham Norton, HRB 21284 (AG Nuernberg) -- To unsubscribe, e-mail: opensuse-kubic+unsubscribe(a)opensuse.org To contact the owner, e-mail: opensuse-kubic+owner(a)opensuse.org

2 1

[opensuse-kubic] daemonsets on kubernetes master
by Thorsten Kukuk 04 Oct '18

04 Oct '18

Hi, Currently we don't schedule daemonsets on the kubernetes master with kubeadm. But there are quite some usefull daemonsets for rebooting the cluster (kured), logging and monitoring (fluentd, prometheus, ...), which all make only sense if they would run on the kubernetes master, too. On CaaSP we allowed daemonsets on the kubernetes master for that reason. What is our plan with Kubic? How should this work there? Thorsten -- Thorsten Kukuk, Distinguished Engineer, Senior Architect SLES & CaaSP SUSE LINUX GmbH, Maxfeldstr. 5, 90409 Nuernberg, Germany GF: Felix Imendoerffer, Jane Smithard, Graham Norton, HRB 21284 (AG Nuernberg) -- To unsubscribe, e-mail: opensuse-kubic+unsubscribe(a)opensuse.org To contact the owner, e-mail: opensuse-kubic+owner(a)opensuse.org

2 1

[opensuse-kubic] Weekly Kubic Project sync meeting minutes 2018-10-02
by Rafael Fernández López 02 Oct '18

02 Oct '18

Hello, Another week, another minutes. This time a very active one! This time I did some manual work to order the conversations inside their main topics, please answer here if I managed to do something wrong! ``` Meeting: Weekly Kubic Project sync meeting Date: 2018-10-02 15:00:00 UTC Location: IRC (chat.freenode.net, #kubic channel) Attendees (alphabetically sorted): * drpaneas * ereslibre * fvogt * marekcounts * mmeister * Pharaoh_Atem * sysrich * vrothberg Only attendees that interacted are recorded. This is an open meeting, so the list of attendees could potentially be bigger. Minutes: * openqa for kubeadm testing (sysrich) 2018-10-02 17:00:22 sysrich I have 2 things on the go at the moment. 2018-10-02 17:00:27 sysrich First - Getting openqa.opensuse.org ready for proper cluster testing is progressing well. This is involving reinstalling all of the openqa.opensuse.org hardware and reconfiguring it to use Leap 15 transactional servers. I'm about halfway there and I hope to have this finished by the end of the week. then I will start setting things up for cluster testing. 2018-10-02 17:00:42 sysrich I don't have the time to look at the tests themselves in parralel, so we could do with help getting the openQA tests ready for kubeadm cluster and upgrade testing. I think it might make sense to sync with panos who (if he has any spare time) might already be looking at getting the tests ready for when I have the infra ready. @drpaneas what do you think? 2018-10-02 17:04:48 sysrich drpaneas, we have a rough plan in the trello card - https://trello.com/c/SQERZKi0/39-openqa-testing-for-kubeadm 2018-10-02 17:06:44 marekcounts Ty Daines is interested in getting into helping with upstream testing work. she might be interested in helping make a kubeadm test, you could ask her. 2018-10-02 17:06:58 marekcounts if you all could use the help* 2018-10-02 17:08:52 sysrich marekcounts, yeah, how can we get in touch with Ty? 2018-10-02 17:08:55 marekcounts this meeting? sure. i'll let her know about it. I think it would be 8am for her. so she will not be happy about it for sure! 2018-10-02 17:09:07 Pharaoh_Atem give her an hour and it should be fine ;) 2018-10-02 17:09:22 Pharaoh_Atem 9am is usually much more reasonable 2018-10-02 17:10:16 mmeister Pharaoh_Atem: that's getting a bit late for me :P but we'll figure it out 2018-10-02 17:10:25 marekcounts @sysrich you can hit her up in e-mail for sure. and i'll try to get her to join this meeting next week. * etcd-operator and v1alpha3 kubeadm api (ereslibre) 2018-10-02 17:02:29 ereslibre in the meanwhile, from my side: I've been working with etcd-operator, but had many issues with our current kubernetes desired version (1.11.2). I've switched to start checking the v1alpha3 api of kubeadm that allows us to set multi-master clusters, and I'm currently working on this and in an upstream issue on kubeadm 2018-10-02 17:03:01 sysrich ereslibre, ooh, interesting - did you know you can use 1.12 from devel:kubic? 2018-10-02 17:04:45 ereslibre sysrich: that's nice :), I tried to use kubeadm 1.12, but controller-manager is not yet up-to-date to support it, and it still depends on 1.11 (https://github.com/kubernetes-sigs/controller-runtime) 2018-10-02 17:05:19 sysrich ereslibre, awesome, thats something to add to the list of 'things we need before we can upgrade 1.12 in factory' I guess then? 2018-10-02 17:06:17 ereslibre sysrich: yes, I'd first need to understand how the timing of these "external" projects work wrt the kubernetes main version, I don't know if we should block the 1.12 because of that 2018-10-02 17:06:34 Pharaoh_Atem aren't they all version syncd? 2018-10-02 17:07:08 ereslibre Pharaoh_Atem: https://github.com/kubernetes-sigs/controller-runtime has nothing 1.12-related yet, as far as I can tell 2018-10-02 17:07:29 Pharaoh_Atem hmm, I guess so 2018-10-02 17:07:33 sysrich ereslibre, might it be 1.12 compatible out of the box? 2018-10-02 17:08:24 ereslibre sysrich: it might be, certainly not at godep level... we have conflicting requirements and I get into a dependency hell :( 2018-10-02 17:08:33 sysrich ereslibre, :-/ * Kubernetes 1.12 (sysrich) 2018-10-02 17:02:46 sysrich ok I guess @drpaneas is busy..so moving on - Second - Kubernetes 1.12 is out, I already packaged it in devel:kubic and basic manual "kubeadm init" and even "kubeadm upgrade" tests suggests things are looking good. I know vrothberg is already contributing cri-o and cri-tools 1.12. Does anyone know if there is anything else needed before we can submit them to Factory? 2018-10-02 17:02:49 drpaneas sysrich, I didn't find any time to check this :/ Thigh might delay since I am quite occupied with the on-boarding of the new team. 2018-10-02 17:03:29 sysrich drpaneas, thanks :) I guessed as much, hence asking for help, we really could do with someone looking at those tests while I'm fighting the hardware 2018-10-02 17:04:08 drpaneas sysrich, if someone is interested to develop a test for kubeadm, should we collect a test-plan and then convert this into openQA code? 2018-10-02 17:08:16 sysrich I've made a trello card so we can track everything we need before we submit k8s 1.12 to Factory - https://trello.com/c/ok1ITWAx/41-submit-k8s-112-to-factory 2018-10-02 17:07:54 marekcounts also. I have been working on creating instructions for backing up and restoring our clusters. hopfully will have that done in the next week or two. 2018-10-02 17:08:06 mmeister marekcounts: sounds good, is it possible for Ty to join the meetings? not sure if that works timezone wise * mmeister 2018-10-02 17:09:42 mmeister from my side, i have some more time now as well to work again on kubic, i'll catch up with the trello board and obviously if you need me somewhere feel free to ping me directly * Testing kubic (drpaneas) 2018-10-02 17:11:21 drpaneas 1. I would like to be able to use caasp-devenv for testing kubic purposes. Like quickly setup a cluster in 0-time and start playing with it. Does one knows if this is possible already? or should I look into it? 2018-10-02 17:12:00 ereslibre drpaneas: I suggest you to try https://github.com/kubic-project/kubic-init out; this is a place where we are starting to put effort into 2018-10-02 17:12:26 mmeister drpaneas: caaspdevenv is outdated regarding kubic, as we dropped velum and so on 2018-10-02 17:13:03 drpaneas mmeister, that's my point. I would like to have a devenv that works for kubeadm. What do the other think? 2018-10-02 17:14:01 sysrich drpaneas, I think ereslibre's suggestion is probably better - the goal of kubic-init is meant to be setting up clusters in 0-time and start playing with it (or using in production one day) 2018-10-02 17:14:23 sysrich drpaneas, working on a seperate tool to do an overlapping job with the new tool which is meant to be a key part of the future Kubic & SUSE CaaSP story seems like more work than we need 2018-10-02 17:14:24 Pharaoh_Atem sysrich: perhaps I'm missing something, but do we have disk images for kubic to use as VMs yet? 2018-10-02 17:14:41 Pharaoh_Atem or should I be using the ISO and going through an install process? 2018-10-02 17:14:56 sysrich Pharaoh_Atem, unofficial images: https://download.opensuse.org/repositories/devel:/kubic:/images:/experiment… 2018-10-02 17:15:02 Pharaoh_Atem cool 2018-10-02 17:15:07 Pharaoh_Atem that should help with my OKD stuff 2018-10-02 17:16:00 drpaneas sysrich, alright I will look into kubic-init then. Also, do have any plan to have official KVM images at some point int time? 2018-10-02 17:16:47 sysrich drpaneas, one day, sure - there needs to be a release process in Tumbleweed for VM images first..and I won't be looking at that any time soon * Raspberry images (drpaneas) 2018-10-02 17:17:33 drpaneas 2. My second question is about RasPi images. Are there any plans for those yet or the only avail. ones are the sysrich personal OBS project? 2018-10-02 17:18:09 sysrich drpaneas, I'll be deleting the ones in my personal OBS project right now ;) 2018-10-02 17:18:17 sysrich drpaneas, but, there are equally unofficial ones in https://download.opensuse.org/repositories/devel:/kubic:/images:/experiment… 2018-10-02 17:18:37 sysrich the kubeadm ones will likely never work - RPi3 is too low resourced - but the Pine64 ones have some home 2018-10-02 17:18:38 sysrich hope* 2018-10-02 17:18:57 drpaneas ok, thanks for your answer, I am covered with mine topics. :) * Vagrant kernel firmware in kubic images (fvogt) 2018-10-02 17:19:16 fvogt sysrich: I just noticed that vagrant has "kernel-firmware" in kubic-images, is that intentional? 2018-10-02 17:20:26 sysrich fvogt, good question, best to ask jan.farjerski at SUSE, he was the one who did the vagrant flavour 2018-10-02 17:20:36 sysrich fvogt, they want to use it as part of whatever they're doing with Ceph I guess 2018-10-02 17:20:58 fvogt I'll do a sr and add him as reviewer 2018-10-02 17:21:18 sysrich danke * Origin rebase from 3.9 to 3.10, Origin building in OBS, CRI-O by default in Origin and Buildah adoption in OpenShift (Pharaoh_Atem) 2018-10-02 17:23:33 Pharaoh_Atem 1. I'm starting the work on rebasing my origin package from 3.9 to 3.10 now, and this probably means some adjustments to the kubernetes package might be needed to set up alternatives for a couple of the binaries 2018-10-02 17:23:52 Pharaoh_Atem off the top of my head, kubectl and hyperkube are provided by origin too 2018-10-02 17:24:37 Pharaoh_Atem 2. I've been having problems actually building origin in OBS, as the environment seems to get exhausted easily 2018-10-02 17:24:51 Pharaoh_Atem is there something I can do to make it so that it selects environments where it's buildable? 2018-10-02 17:24:58 sysrich Q to 1.kubectl and hyperkube - they couldn't be fulfilled by pulling from the kubernetes package? 2018-10-02 17:25:27 Pharaoh_Atem sysrich: I am not sure, it's something worth investigating, but they might be extended to support OpenShift's additional functionality 2018-10-02 17:25:34 sysrich Pharaoh_Atem, https://openbuildservice.org/help/manuals/obs-reference-guide/cha.obs.build… 2018-10-02 17:26:28 Pharaoh_Atem also, I'm considering just making OpenShift on Kubic default to CRI-O 2018-10-02 17:26:32 Pharaoh_Atem just as kubernetes does 2018-10-02 17:26:43 Pharaoh_Atem no reason not to, as OpenShift supports it as well as k8s does 2018-10-02 17:26:47 sysrich awesome! 2018-10-02 17:27:23 Pharaoh_Atem and a bit of a heads-up, OpenShift is going to change to use buildah for building containers in the near future by default 2018-10-02 17:27:41 Pharaoh_Atem I think vrothberg has packaged this already? Would this be available in the kubic distribution too? 2018-10-02 17:28:26 sysrich buildah's already in kubic/TW, yes 2018-10-02 17:28:46 Pharaoh_Atem cool 2018-10-02 17:28:49 vrothberg Yep, it's there :) 2018-10-02 17:28:53 Pharaoh_Atem excellent ``` Cheers, Rafa.

1 0