[heroes] infra/salt pillar improvement
Hello to all, First of all let me introduce myself, my name is Niels Abspoel. I have been asked to join the infra team by Theo. I have worked on the openSUSE salt package before the systemsmanagement team took over. In the meantime I have kept myself busy with the salt-formulas on github. I work for a company named Webscale B.V. as a systems engineer and configuration management expert. Now that is out of the way, Why am I mailing: I think the infra/salt pillar setup on gitlab.opensuse.org can benefit from pillar stack configuration: https://docs.saltstack.com/en/latest/ref/pillar/all/salt.pillar.stack.html For more information on a real world example: https://www.youtube.com/watch?v=F3K706JJ2EI -- To unsubscribe, e-mail: heroes+unsubscribe@opensuse.org To contact the owner, e-mail: heroes+owner@opensuse.org
On Tue, Jan 31, 2017 at 09:00:37PM +0100, Niels Abspoel wrote:
I think the infra/salt pillar setup on gitlab.opensuse.org can benefit from pillar stack configuration: https://docs.saltstack.com/en/latest/ref/pillar/all/salt.pillar.stack.html
For more information on a real world example: https://www.youtube.com/watch?v=F3K706JJ2EI
Any chance you can send me an example? Or even better an MR? I will set up tomorrow a couple of testing VMs for such experiments -- Theo Chatzimichos <tampakrap@opensuse.org> <tchatzimichos@suse.com> System Administrator SUSE Operations and Services Team
Theo, I think I can create a MR, but on the basis of the git repo I have some difficulty in creating a working version, I have the following information: /srv/salt /srv/pillar I miss the following information: formulas ( are they based on saltstack-formulas?) salt version ( 2016.11 or older) 2017-01-31 22:11 GMT+01:00 Theo Chatzimichos <tampakrap@opensuse.org>:
On Tue, Jan 31, 2017 at 09:00:37PM +0100, Niels Abspoel wrote:
I think the infra/salt pillar setup on gitlab.opensuse.org can benefit from pillar stack configuration: https://docs.saltstack.com/en/latest/ref/pillar/all/salt.pillar.stack.html
For more information on a real world example: https://www.youtube.com/watch?v=F3K706JJ2EI
Any chance you can send me an example? Or even better an MR? I will set up tomorrow a couple of testing VMs for such experiments -- Theo Chatzimichos <tampakrap@opensuse.org> <tchatzimichos@suse.com> System Administrator SUSE Operations and Services Team -- To unsubscribe, e-mail: heroes+unsubscribe@opensuse.org To contact the owner, e-mail: heroes+owner@opensuse.org
On Tue, Jan 31, 2017 at 10:25:06PM +0100, Niels Abspoel wrote:
Theo,
I think I can create a MR, but on the basis of the git repo I have some difficulty in creating a working version, I have the following information: /srv/salt /srv/pillar
I miss the following information: formulas ( are they based on saltstack-formulas?) salt version ( 2016.11 or older)
formulas are indeed based on the saltstack-formulas github organization, but in the same gitlab instance are copies of them so that we lock their revision. I update them manually every one or two weeks after also checking at their diffs. You should have access to them but let me know if you don't please [1]. Also the saltmaster configuration is in salt as well. salt version is 2016.3.4, the one included in 42.2. The update in 2016.11.x is wip because it fails some tests. The testsuite is [2] written by the SUSE Manager guys. It is running in a SUSE internal CI at the moment, but there is also a wip to move it to ci.o.o Hope that helps, let me know if you need more info. [1] https://gitlab.opensuse.org/saltstack-formulas/timezone-formula [2] https://github.com/openSUSE/salt-toaster
Thanks will take a look, most of the formulas, are known. so that won't be a problem I have a opensuse 42.2 virtual machine already running to test some stuff. 2017-01-31 22:53 GMT+01:00 Theo Chatzimichos <tampakrap@opensuse.org>:
On Tue, Jan 31, 2017 at 10:25:06PM +0100, Niels Abspoel wrote:
Theo,
I think I can create a MR, but on the basis of the git repo I have some difficulty in creating a working version, I have the following information: /srv/salt /srv/pillar
I miss the following information: formulas ( are they based on saltstack-formulas?) salt version ( 2016.11 or older)
formulas are indeed based on the saltstack-formulas github organization, but in the same gitlab instance are copies of them so that we lock their revision. I update them manually every one or two weeks after also checking at their diffs. You should have access to them but let me know if you don't please [1]. Also the saltmaster configuration is in salt as well.
salt version is 2016.3.4, the one included in 42.2. The update in 2016.11.x is wip because it fails some tests. The testsuite is [2] written by the SUSE Manager guys. It is running in a SUSE internal CI at the moment, but there is also a wip to move it to ci.o.o
Hope that helps, let me know if you need more info.
[1] https://gitlab.opensuse.org/saltstack-formulas/timezone-formula [2] https://github.com/openSUSE/salt-toaster -- To unsubscribe, e-mail: heroes+unsubscribe@opensuse.org To contact the owner, e-mail: heroes+owner@opensuse.org
Hi all, I have started testing to implement a ext_pillar: stack configuration. But I hit a snag, the stack ext_pillar requires a hard coded path, (something like /srv/stack/stack.cfg) So getting everything from gitfs and git_pillar won't work with stack. I have create an issue: https://github.com/bbinet/pillarstack/issues/24 To ask the author if it's possible to make it work. I think it's best for now to leave the current setup as it is. Are there currently issues with some formula's that need be addressed? - missing formula's for configuration? - improving openSUSE support for some existing salt-formulas? 2017-01-31 23:21 GMT+01:00 Niels Abspoel <aboe76@gmail.com>:
Thanks will take a look, most of the formulas, are known. so that won't be a problem I have a opensuse 42.2 virtual machine already running to test some stuff.
2017-01-31 22:53 GMT+01:00 Theo Chatzimichos <tampakrap@opensuse.org>:
On Tue, Jan 31, 2017 at 10:25:06PM +0100, Niels Abspoel wrote:
Theo,
I think I can create a MR, but on the basis of the git repo I have some difficulty in creating a working version, I have the following information: /srv/salt /srv/pillar
I miss the following information: formulas ( are they based on saltstack-formulas?) salt version ( 2016.11 or older)
formulas are indeed based on the saltstack-formulas github organization, but in the same gitlab instance are copies of them so that we lock their revision. I update them manually every one or two weeks after also checking at their diffs. You should have access to them but let me know if you don't please [1]. Also the saltmaster configuration is in salt as well.
salt version is 2016.3.4, the one included in 42.2. The update in 2016.11.x is wip because it fails some tests. The testsuite is [2] written by the SUSE Manager guys. It is running in a SUSE internal CI at the moment, but there is also a wip to move it to ci.o.o
Hope that helps, let me know if you need more info.
[1] https://gitlab.opensuse.org/saltstack-formulas/timezone-formula [2] https://github.com/openSUSE/salt-toaster -- To unsubscribe, e-mail: heroes+unsubscribe@opensuse.org To contact the owner, e-mail: heroes+owner@opensuse.org
On Thu, Feb 02, 2017 at 11:53:22PM +0100, Niels Abspoel wrote:
Hi all,
I have started testing to implement a ext_pillar: stack configuration. But I hit a snag, the stack ext_pillar requires a hard coded path, (something like /srv/stack/stack.cfg)
So getting everything from gitfs and git_pillar won't work with stack.
I have create an issue: https://github.com/bbinet/pillarstack/issues/24 To ask the author if it's possible to make it work.
I think it's best for now to leave the current setup as it is.
I would still like to see it in action. Mind setting it up on a new branch so I can test it somewhere (without gitfs)?
Are there currently issues with some formula's that need be addressed? - missing formula's for configuration? - improving openSUSE support for some existing salt-formulas?
Services that I plan to use in production soon and haven't checked at all if they have formula, or if their formula is good enough and with suse support: rsyslog, bind, mysql, postgresql, nginx, haproxy PS: please don't top-post Theo
Hello, thanks for helping with Salt! Am Donnerstag, 2. Februar 2017, 23:53:22 CET schrieb Niels Abspoel:
Are there currently issues with some formula's that need be addressed? - missing formula's for configuration? - improving openSUSE support for some existing salt-formulas?
I hit two problems with mysql-formula: - https://github.com/saltstack-formulas/mysql-formula/issues/156 - https://github.com/saltstack-formulas/mysql-formula/issues/157 Regards, Christian Boltz -- So does that mean you're volunteering, Pascal? No, wait - I can see the headline now: "Guru Site Down Due to Maintainer Working 24/7 on Newsletter - Millions in Agony!" [Kai Ponte in opensuse-project] -- To unsubscribe, e-mail: heroes+unsubscribe@opensuse.org To contact the owner, e-mail: heroes+owner@opensuse.org
2017-02-04 23:45 GMT+01:00 Christian Boltz <opensuse@cboltz.de>:
Hello,
thanks for helping with Salt!
Am Donnerstag, 2. Februar 2017, 23:53:22 CET schrieb Niels Abspoel:
Are there currently issues with some formula's that need be addressed? - missing formula's for configuration? - improving openSUSE support for some existing salt-formulas?
I hit two problems with mysql-formula: - https://github.com/saltstack-formulas/mysql-formula/issues/156 - https://github.com/saltstack-formulas/mysql-formula/issues/157
I have taken some action regarding these issues, first one is just a pr to fix it. - https://github.com/saltstack-formulas/mysql-formula/issues/156 The other one I have tried the mysql-formula on leap and tumble after applying my fix they work, so could you test with my small fix?
Regards,
Christian Boltz -- So does that mean you're volunteering, Pascal? No, wait - I can see the headline now: "Guru Site Down Due to Maintainer Working 24/7 on Newsletter - Millions in Agony!" [Kai Ponte in opensuse-project]
-- To unsubscribe, e-mail: heroes+unsubscribe@opensuse.org To contact the owner, e-mail: heroes+owner@opensuse.org
-- To unsubscribe, e-mail: heroes+unsubscribe@opensuse.org To contact the owner, e-mail: heroes+owner@opensuse.org
Hello, sorry for the delay ;-) Am Dienstag, 7. Februar 2017, 23:22:54 CET schrieb Niels Abspoel:
2017-02-04 23:45 GMT+01:00 Christian Boltz <opensuse@cboltz.de>:
I hit two problems with mysql-formula: - https://github.com/saltstack-formulas/mysql-formula/issues/156 - https://github.com/saltstack-formulas/mysql-formula/issues/157
I have taken some action regarding these issues, first one is just a pr to fix it. - https://github.com/saltstack-formulas/mysql-formula/issues/156
Yeah, this works now :-) I just closed ticket 156.
The other one I have tried the mysql-formula on leap and tumble after applying my fix they work, so could you test with my small fix?
I tested with the updated mysql-formula, and the problem in ticket 157 still exists. You'll probably need to define a separate salt user to hit the problem - when using "root" it works without problems. I'm testing with empty /var/lib/mysql/ (this also means to stop mysql and clean up that directory after each test) and this pillar: mysql: server: root_password: 'secret1' mysqld: max_allowed_packet: 64M salt_user: salt_user_name: 'salt' salt_user_password: 'secret2' grants: - 'all privileges' database: - enwiki user: enwiki: password: 'secret3' host: localhost databases: - database: enwiki grants: ['all privileges'] salt/profile/mysql/server.sls simply has include: - mysql - mysql.remove_test_database Applying my patch from https://github.com/saltstack-formulas/mysql-formula/issues/157 still fixes the problem. Regards, Christian Boltz -- Every addition of patches and {extra files not maintained by upstream} to a SRPM I hate to do and maintain, and hate it by line count. [Jan Engelhardt in opensuse-factory] -- To unsubscribe, e-mail: heroes+unsubscribe@opensuse.org To contact the owner, e-mail: heroes+owner@opensuse.org
2017-01-31 22:11 GMT+01:00 Theo Chatzimichos <tampakrap@opensuse.org>:
On Tue, Jan 31, 2017 at 09:00:37PM +0100, Niels Abspoel wrote:
I think the infra/salt pillar setup on gitlab.opensuse.org can benefit from pillar stack configuration: https://docs.saltstack.com/en/latest/ref/pillar/all/salt.pillar.stack.html
For more information on a real world example: https://www.youtube.com/watch?v=F3K706JJ2EI
Any chance you can send me an example? Or even better an MR? I will set up tomorrow a couple of testing VMs for such experiments
Theo, I have created a branch with the preliminary stack configuration, without modifying too much. It's still rough, because I couldn't test some logic, because I use a different principle no grains, no roles, just states. But I think it could work: this is the location. https://gitlab.opensuse.org/infra/salt/tree/aboe76/stack
-- Theo Chatzimichos <tampakrap@opensuse.org> <tchatzimichos@suse.com> System Administrator SUSE Operations and Services Team -- To unsubscribe, e-mail: heroes+unsubscribe@opensuse.org To contact the owner, e-mail: heroes+owner@opensuse.org
participants (3)
-
Christian Boltz -
Niels Abspoel -
Theo Chatzimichos