On lunes, 28 de febrero de 2022 18:26:23 (CET) Julio Gonzalez wrote:

We are happy to announce the immediate availability of Uyuni 2021.02

Needless to say, this is a typo. We released 2022.02, as the rest of the email says, including the subject :-)

Hello List

After upgrade to 2022.02 - the Grafana page "Uyuni Client Systems" is empty. There are some "Apply highstate" errors on all servers:

[...]

----------           ID: mgrchannels_install_products     Function: product.installed         Name: mgrchannels_install_products       Result: false      Comment: An error was encountered while installing package(s): Zypper command failure: Running scope as unit: run-r400d7802d80044878ce143992d6b40f6.scope      Started: 18:37:00.777587     Duration: 13778.085          SLS: channels      Changed: {}

[...]

----------           ID: mgr_install_products     Function: product.installed         Name: mgr_install_products       Result: false      Comment: An error was encountered while installing package(s): Zypper command failure: Running scope as unit: run-r6380388771464ae4b4b5c8755888c2da.scope      Started: 18:37:14.753645     Duration: 23162.495          SLS: packages      Changed: {}

[...]

There is no other issue on uyuni or any other client systems. I see the uyuni server on Grafana and any other data page but not the uyuni client systems anymore. The prometheus-node_exporter.service works on all client systems. On uyuni Admin - all monitoring tasks are green:

ok    System ok    PostgreSQL Datenbank ok    Server self monitoring ok    Taskomatic (Java JMX) ok    Tomcat (Java JMX)

Some ideas?

Best regards

Martin

Am 28.02.22 um 18:26 schrieb Julio Gonzalez:

We are happy to announce the immediate availability of Uyuni 2021.02

At https://www.uyuni-project.org/pages/stable-version.html you will find all the resources you need to start working with Uyuni 2022.02, including the release notes, documentation, requirements and setup instructions.

VERY IMPORTANT: Read the release notes! If you are updating from an Uyuni version older than 2021.06, a major upgrade procedure is required.

This is the list of highlights for this release:

• Reporting Database
• Ubuntu errata installation
• Monitoring: Prometheus 2.32.1
• Monitoring: Postgres exporter updated to version 0.10.0 for SUSE Linux Enterprise and openSUSE
• SLES PAYG client support on cloud
• openscap for Debian 11 (Tech Preview)

Please check the release notes for full details, and in particular review the section about the Postgres exporter update and the Prometheus update, as it could require manual if you are using monitoring.

Remember that Uyuni will follow a rolling release planning, so the next version will contain bugfixes for this one and any new features. There will be no maintenance of 2022.02

As always, we hope you will enjoy Uyuni 2022.02 and we invite everyone of you to send us your feedback [1] and of course your patches, if you can contribute.

Happy hacking!

[1] https://www.uyuni-project.org/pages/contact.html

Hi Martin,

the Prometheus configuration looks good. Could you look up Tomcat logs on Uyuni server for further hints?

Witek

On 3/12/22 10:13, muy.2020--- via Uyuni Users wrote:

Hello list

Still no luck to get mgr-clients running since Uyuni 2022.02. The mgr-clients don't show up on prometheus page, but the configuration is in prometheus.yml. There is an error in log:

2022-03-12T10:05:15.971633+01:00 monisrv prometheus[3208]: ts=2022-03-12T09:05:15.971Z caller=refresh.go:79 level=error component="discovery manager scrape" discovery=uyuni msg="Unable to refresh target groups" err="unable to get endpoints information: Fault(-1): redstone.xmlrpc.XmlRpcFault: unhandled internal exception: null"

The configuration is:

# --------------------   # Auto discover clients of uyuni.mydomain   # --------------------   - job_name: 'mgr-clients'     uyuni_sd_configs:       - server: https://uyuni.mydomain         username: <hidden>         password: <hidden>

relabel_configs:       - source_labels: [__meta_uyuni_exporter]         target_label: exporter       - source_labels: [__address__]         replacement: "No group"         target_label: groups       - source_labels: [__meta_uyuni_groups]         regex: (.+)         target_label: groups       - source_labels: [__meta_uyuni_minion_hostname]         target_label: hostname       - source_labels: [__meta_uyuni_primary_fqdn]         regex: (.+)         target_label: hostname       - source_labels: [hostname, __address__]         regex: (.*);.*:(.*)         replacement: ${1}:${2}         target_label: __address__       - source_labels: [__meta_uyuni_metrics_path]         regex: (.+)         target_label: __metrics_path__       - source_labels: [__meta_uyuni_proxy_module]         target_label: __param_module

Am 09.03.22 um 18:57 schrieb Martin via Uyuni Users:

...

Hello List

After upgrade to 2022.02 - the Grafana page "Uyuni Client Systems" is empty. There are some "Apply highstate" errors on all servers:

[...]

---

ID: mgrchannels_install_products     Function: product.installed         Name: mgrchannels_install_products       Result: false      Comment: An error was encountered while installing package(s): Zypper command failure: Running scope as unit: run-r400d7802d80044878ce143992d6b40f6.scope      Started: 18:37:00.777587     Duration: 13778.085          SLS: channels      Changed: {}

[...]

---

ID: mgr_install_products     Function: product.installed         Name: mgr_install_products       Result: false      Comment: An error was encountered while installing package(s): Zypper command failure: Running scope as unit: run-r6380388771464ae4b4b5c8755888c2da.scope      Started: 18:37:14.753645     Duration: 23162.495          SLS: packages      Changed: {}

[...]

There is no other issue on uyuni or any other client systems. I see the uyuni server on Grafana and any other data page but not the uyuni client systems anymore. The prometheus-node_exporter.service works on all client systems. On uyuni Admin - all monitoring tasks are green:

ok    System ok    PostgreSQL Datenbank ok    Server self monitoring ok    Taskomatic (Java JMX) ok    Tomcat (Java JMX)

Some ideas?

Best regards

Martin

Am 28.02.22 um 18:26 schrieb Julio Gonzalez:

...

We are happy to announce the immediate availability of Uyuni 2021.02

At https://www.uyuni-project.org/pages/stable-version.html you will find all the resources you need to start working with Uyuni 2022.02, including the release notes, documentation, requirements and setup instructions.

VERY IMPORTANT: Read the release notes! If you are updating from an Uyuni version older than 2021.06, a major upgrade procedure is required.

This is the list of highlights for this release:

• Reporting Database
• Ubuntu errata installation
• Monitoring: Prometheus 2.32.1
• Monitoring: Postgres exporter updated to version 0.10.0 for SUSE Linux

Enterprise and openSUSE

• SLES PAYG client support on cloud
• openscap for Debian 11 (Tech Preview)

Please check the release notes for full details, and in particular review the section about the Postgres exporter update and the Prometheus update, as it could require manual if you are using monitoring.

Remember that Uyuni will follow a rolling release planning, so the next version will contain bugfixes for this one and any new features. There will be no maintenance of 2022.02

As always, we hope you will enjoy Uyuni 2022.02 and we invite everyone of you to send us your feedback [1] and of course your patches, if you can contribute.

Happy hacking!

[1] https://www.uyuni-project.org/pages/contact.html

Indeed. I could reproduce it in my environment.

I've provided a bugfix which should solve these problems: https://github.com/uyuni-project/uyuni/pull/5024

Thanks for reporting Witek

!!! We stand with Ukraine !!!

On 3/15/22 16:57, Martin via Uyuni Users wrote:

Hello Witek

There is no useful message in the Tomcat logs - only this message repeats every minute what results in a big log:

15-Mar-2022 16:39:21.951 WARNUNG [ajp-nio-127.0.0.1-8009-exec-10] redstone.xmlrpc.XmlRpcDispatcher.writeError redstone.xmlrpc.XmlRpcFault: unhandled internal exception: null 15-Mar-2022 16:40:21.941 WARNUNG [ajp-nio-127.0.0.1-8009-exec-9] redstone.xmlrpc.XmlRpcDispatcher.writeError redstone.xmlrpc.XmlRpcFault: unhandled internal exception: null 15-Mar-2022 16:41:21.960 WARNUNG [ajp-nio-127.0.0.1-8009-exec-1] redstone.xmlrpc.XmlRpcDispatcher.writeError redstone.xmlrpc.XmlRpcFault: unhandled internal exception: null 15-Mar-2022 16:42:22.012 WARNUNG [ajp-nio-127.0.0.1-8009-exec-8] redstone.xmlrpc.XmlRpcDispatcher.writeError redstone.xmlrpc.XmlRpcFault: unhandled internal exception: null 15-Mar-2022 16:43:31.958 WARNUNG [ajp-nio-127.0.0.1-8009-exec-5] redstone.xmlrpc.XmlRpcDispatcher.writeError redstone.xmlrpc.XmlRpcFault: unhandled internal exception: null 15-Mar-2022 16:44:27.009 WARNUNG [ajp-nio-127.0.0.1-8009-exec-10] redstone.xmlrpc.XmlRpcDispatcher.writeError redstone.xmlrpc.XmlRpcFault: unhandled internal exception: null 15-Mar-2022 16:45:22.429 WARNUNG [ajp-nio-127.0.0.1-8009-exec-5] redstone.xmlrpc.XmlRpcDispatcher.writeError redstone.xmlrpc.XmlRpcFault: unhandled internal exception: null 15-Mar-2022 16:46:22.018 WARNUNG [ajp-nio-127.0.0.1-8009-exec-10] redstone.xmlrpc.XmlRpcDispatcher.writeError redstone.xmlrpc.XmlRpcFault: unhandled internal exception: null 15-Mar-2022 16:47:21.946 WARNUNG [ajp-nio-127.0.0.1-8009-exec-4] redstone.xmlrpc.XmlRpcDispatcher.writeError redstone.xmlrpc.XmlRpcFault: unhandled internal exception: null 15-Mar-2022 16:48:26.953 WARNUNG [ajp-nio-127.0.0.1-8009-exec-9] redstone.xmlrpc.XmlRpcDispatcher.writeError redstone.xmlrpc.XmlRpcFault: unhandled internal exception: null 15-Mar-2022 16:49:21.948 WARNUNG [ajp-nio-127.0.0.1-8009-exec-3] redstone.xmlrpc.XmlRpcDispatcher.writeError redstone.xmlrpc.XmlRpcFault: unhandled internal exception: null 15-Mar-2022 16:50:21.946 WARNUNG [ajp-nio-127.0.0.1-8009-exec-7] redstone.xmlrpc.XmlRpcDispatcher.writeError redstone.xmlrpc.XmlRpcFault: unhandled internal exception: null 15-Mar-2022 16:51:21.961 WARNUNG [ajp-nio-127.0.0.1-8009-exec-1] redstone.xmlrpc.XmlRpcDispatcher.writeError redstone.xmlrpc.XmlRpcFault: unhandled internal exception: null 15-Mar-2022 16:52:22.040 WARNUNG [ajp-nio-127.0.0.1-8009-exec-1] redstone.xmlrpc.XmlRpcDispatcher.writeError redstone.xmlrpc.XmlRpcFault: unhandled internal exception: null

Martin

Am 14.03.22 um 15:56 schrieb Witek Bedyk via Uyuni Users:

...

Hi Martin,

the Prometheus configuration looks good. Could you look up Tomcat logs on Uyuni server for further hints?

Witek

On 3/12/22 10:13, muy.2020--- via Uyuni Users wrote:

...

Hello list

Still no luck to get mgr-clients running since Uyuni 2022.02. The mgr-clients don't show up on prometheus page, but the configuration is in prometheus.yml. There is an error in log:

2022-03-12T10:05:15.971633+01:00 monisrv prometheus[3208]: ts=2022-03-12T09:05:15.971Z caller=refresh.go:79 level=error component="discovery manager scrape" discovery=uyuni msg="Unable to refresh target groups" err="unable to get endpoints information: Fault(-1): redstone.xmlrpc.XmlRpcFault: unhandled internal exception: null"

The configuration is:

# --------------------    # Auto discover clients of uyuni.mydomain    # --------------------    - job_name: 'mgr-clients'      uyuni_sd_configs:        - server: https://uyuni.mydomain          username: <hidden>          password: <hidden>

relabel_configs:        - source_labels: [__meta_uyuni_exporter]          target_label: exporter        - source_labels: [__address__]          replacement: "No group"          target_label: groups        - source_labels: [__meta_uyuni_groups]          regex: (.+)          target_label: groups        - source_labels: [__meta_uyuni_minion_hostname]          target_label: hostname        - source_labels: [__meta_uyuni_primary_fqdn]          regex: (.+)          target_label: hostname        - source_labels: [hostname, __address__]          regex: (.*);.*:(.*)          replacement: ${1}:${2}          target_label: __address__        - source_labels: [__meta_uyuni_metrics_path]          regex: (.+)          target_label: __metrics_path__        - source_labels: [__meta_uyuni_proxy_module]          target_label: __param_module

Am 09.03.22 um 18:57 schrieb Martin via Uyuni Users:

...

Hello List

After upgrade to 2022.02 - the Grafana page "Uyuni Client Systems" is empty. There are some "Apply highstate" errors on all servers:

[...]

---

ID: mgrchannels_install_products     Function: product.installed         Name: mgrchannels_install_products       Result: false      Comment: An error was encountered while installing package(s): Zypper command failure: Running scope as unit: run-r400d7802d80044878ce143992d6b40f6.scope      Started: 18:37:00.777587     Duration: 13778.085          SLS: channels      Changed: {}

[...]

---

ID: mgr_install_products     Function: product.installed         Name: mgr_install_products       Result: false      Comment: An error was encountered while installing package(s): Zypper command failure: Running scope as unit: run-r6380388771464ae4b4b5c8755888c2da.scope      Started: 18:37:14.753645     Duration: 23162.495          SLS: packages      Changed: {}

[...]

There is no other issue on uyuni or any other client systems. I see the uyuni server on Grafana and any other data page but not the uyuni client systems anymore. The prometheus-node_exporter.service works on all client systems. On uyuni Admin - all monitoring tasks are green:

ok    System ok    PostgreSQL Datenbank ok    Server self monitoring ok    Taskomatic (Java JMX) ok    Tomcat (Java JMX)

Some ideas?

Best regards

Martin

Am 28.02.22 um 18:26 schrieb Julio Gonzalez:

...

We are happy to announce the immediate availability of Uyuni 2021.02

At https://www.uyuni-project.org/pages/stable-version.html you will find all the resources you need to start working with Uyuni 2022.02, including the release notes, documentation, requirements and setup instructions.

VERY IMPORTANT: Read the release notes! If you are updating from an Uyuni version older than 2021.06, a major upgrade procedure is required.

This is the list of highlights for this release:

• Reporting Database
• Ubuntu errata installation
• Monitoring: Prometheus 2.32.1
• Monitoring: Postgres exporter updated to version 0.10.0 for SUSE

Linux    Enterprise and openSUSE

• SLES PAYG client support on cloud
• openscap for Debian 11 (Tech Preview)

Please check the release notes for full details, and in particular review the section about the Postgres exporter update and the Prometheus update, as it could require manual if you are using monitoring.

Remember that Uyuni will follow a rolling release planning, so the next version will contain bugfixes for this one and any new features. There will be no maintenance of 2022.02

As always, we hope you will enjoy Uyuni 2022.02 and we invite everyone of you to send us your feedback [1] and of course your patches, if you can contribute.

Happy hacking!

[1] https://www.uyuni-project.org/pages/contact.html