Hi, I've installed Uyuni on a fresh openSUSE 15.3 install. it's a VM with 4 CPUs, 8GB RAM plus the required storage. The VM is dedicated to Uyuni as a test environment. I've gone through the setup wizard via YAST, but there seems to be an issue with Tomcat starting. I have no clue about where to begin as to debugging the issue with Tomcat. Any help would be much appreciated. I have copied the output from the log files below. Many thanks, Neil Output from log files below: t-uyuni:/var/log # cat /var/log/susemanager_setup.log Asserting correct java version... /var/spacewalk already exists. Leaving it untouched. Filesystem type for /var/cache is ext4 - ok. Open needed firewall ports... running success success Performing forced re-installation! Shutting down spacewalk services... Done. Delete existing database... Delete existing salt minion keys CREATE ROLE * Loading answer file: /root/spacewalk-answers. ** Database: Setting up database connection for PostgreSQL backend. ** Database: Populating database. ** Database: --clear-db option used. Clearing database. ** Database: Shutting down spacewalk services that may be using DB. ** Database: Services stopped. Clearing DB. *** Progress: # * Configuring tomcat. * Setting up users and groups. ** GPG: Initializing GPG and importing key. * Performing initial configuration. * Configuring apache SSL virtual host. * Configuring jabberd. * Creating SSL certificates. ** SSL: Generating CA certificate. ** SSL: Deploying CA certificate. ** SSL: Generating server certificate. ** SSL: Storing SSL certificates. * Deploying configuration files. * Update configuration in database. * Setting up Cobbler.. * Restarting services. Tomcat failed to start properly or the installer ran out of tries. Please check /var/log/tomcat/catalina.out or /var/log/tomcat/catalina.$(date +%Y-%m-%d).log for errors t-uyuni:/var/log # cat /var/log/tomcat/catalina.out: tomcat-9.0.36 RPM installed t-uyuni:/var/log # cat /var/log/tomcat/catalina.2021-10-15.log 15-Oct-2021 00:23:43.424 SEVERE [main] org.apache.catalina.startup.Catalina.initDirs Cannot find specified temporary folder at [/var/cache/tomcat/temp] 15-Oct-2021 00:23:43.893 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Server version name: Apache Tomcat/9.0.36 15-Oct-2021 00:23:43.893 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Server built: Mar 17 2021 12:00:00 UTC 15-Oct-2021 00:23:43.893 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Server version number: 9.0.36.0 15-Oct-2021 00:23:43.894 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log OS Name: Linux 15-Oct-2021 00:23:43.894 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log OS Version: 5.3.18-59.27-default 15-Oct-2021 00:23:43.894 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Architecture: amd64 15-Oct-2021 00:23:43.894 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Java Home: /usr/lib64/jvm/java-11-openjdk-11 15-Oct-2021 00:23:43.894 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log JVM Version: 11.0.12+7-suse-3.62.1-x8664 15-Oct-2021 00:23:43.894 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log JVM Vendor: Oracle Corporation 15-Oct-2021 00:23:43.894 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log CATALINA_BASE: /usr/share/tomcat 15-Oct-2021 00:23:43.894 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log CATALINA_HOME: /usr/share/tomcat 15-Oct-2021 00:23:43.895 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -ea 15-Oct-2021 00:23:43.896 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Xms256m 15-Oct-2021 00:23:43.896 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Xmx1G 15-Oct-2021 00:23:43.896 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djava.awt.headless=true 15-Oct-2021 00:23:43.896 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dorg.xml.sax.driver=com.redhat.rhn.frontend.xmlrpc.util.RhnSAXParser 15-Oct-2021 00:23:43.896 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dorg.apache.tomcat.util.http.Parameters.MAX_COUNT=1024 15-Oct-2021 00:23:43.896 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -XX:MaxNewSize=256 15-Oct-2021 00:23:43.896 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -XX:-UseConcMarkSweepGC 15-Oct-2021 00:23:43.897 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dnet.sf.ehcache.skipUpdateCheck=true 15-Oct-2021 00:23:43.897 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: --add-exports=java.annotation/javax.annotation.security=ALL-UNNAMED 15-Oct-2021 00:23:43.897 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: --add-opens=java.annotation/javax.annotation.security=ALL-UNNAMED 15-Oct-2021 00:23:43.897 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: --add-modules=java.annotation,com.sun.xml.bind 15-Oct-2021 00:23:43.897 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dcatalina.base=/usr/share/tomcat 15-Oct-2021 00:23:43.897 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dcatalina.home=/usr/share/tomcat 15-Oct-2021 00:23:43.897 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djava.endorsed.dirs= 15-Oct-2021 00:23:43.897 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djava.io.tmpdir=/var/cache/tomcat/temp 15-Oct-2021 00:23:43.897 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djava.util.logging.config.file=/usr/share/tomcat/conf/logging.properties 15-Oct-2021 00:23:43.898 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager 15-Oct-2021 00:23:43.898 INFO [main] org.apache.catalina.core.AprLifecycleListener.lifecycleEvent Loaded Apache Tomcat Native library [1.2.23] using APR version [1.6.3]. 15-Oct-2021 00:23:43.898 INFO [main] org.apache.catalina.core.AprLifecycleListener.lifecycleEvent APR capabilities: IPv6 [true], sendfile [true], accept filters [false], random [true]. 15-Oct-2021 00:23:43.898 INFO [main] org.apache.catalina.core.AprLifecycleListener.lifecycleEvent APR/OpenSSL configuration: useAprConnector [false], useOpenSSL [true] 15-Oct-2021 00:23:43.901 INFO [main] org.apache.catalina.core.AprLifecycleListener.initializeSSL OpenSSL successfully initialized [OpenSSL 1.1.1d 10 Sep 2019] 15-Oct-2021 00:23:44.443 INFO [main] org.apache.coyote.AbstractProtocol.init Initializing ProtocolHandler ["ajp-nio-127.0.0.1-8009"] 15-Oct-2021 00:23:44.494 INFO [main] org.apache.coyote.AbstractProtocol.init Initializing ProtocolHandler ["ajp-nio-0:0:0:0:0:0:0:1-8009"] 15-Oct-2021 00:23:44.496 INFO [main] org.apache.coyote.AbstractProtocol.init Initializing ProtocolHandler ["http-nio-127.0.0.1-8080"] 15-Oct-2021 00:23:44.500 INFO [main] org.apache.catalina.startup.Catalina.load Server initialization in [1,076] milliseconds 15-Oct-2021 00:23:44.580 INFO [main] org.apache.catalina.core.StandardService.startInternal Starting service [Catalina] 15-Oct-2021 00:23:44.580 INFO [main] org.apache.catalina.core.StandardEngine.startInternal Starting Servlet engine: [Apache Tomcat/9.0.36] 15-Oct-2021 00:23:44.584 SEVERE [main] org.apache.catalina.startup.HostConfig.beforeStart Unable to create directory for deployment: [/etc/tomcat/Catalina/localhost] 15-Oct-2021 00:23:44.590 INFO [main] org.apache.catalina.startup.HostConfig.deployDirectory Deploying web application directory [/srv/tomcat/webapps/rhn] 15-Oct-2021 00:23:44.645 WARNING [main] org.apache.catalina.core.StandardContext.postWorkDirectory Failed to create work directory [/usr/share/tomcat/work/Catalina/localhost/rhn] for context [/rhn] 15-Oct-2021 00:23:56.306 INFO [main] org.apache.jasper.servlet.TldScanner.scanJars At least one JAR was scanned for TLDs yet contained no TLDs. Enable debug logging for this logger for a complete list of JARs that were scanned but no TLDs were found in them. Skipping unneeded JARs during scanning can improve startup time and JSP compilation time. 15-Oct-2021 00:23:59.601 INFO [MLog-Init-Reporter] com.mchange.v2.log.MLog$1.run MLog clients using java 1.4+ standard logging. 15-Oct-2021 00:23:59.725 INFO [main] com.mchange.v2.c3p0.C3P0Registry.banner Initializing c3p0-0.9.5.2 [built 28-November-2020 12:00:00 +0000; debug? false; trace: 5] 15-Oct-2021 00:23:59.854 INFO [main] com.mchange.v2.c3p0.impl.AbstractPoolBackedDataSource.getPoolManager Initializing c3p0 pool... com.mchange.v2.c3p0.PoolBackedDataSource@1f90fe4 [ connectionPoolDataSource -> com.mchange.v2.c3p0.WrapperConnectionPoolDataSource@7ec3c36 [ acquireIncrement -> 3, acquireRetryAttempts -> 30, acquireRetryDelay -> 1000, autoCommitOnClose -> false, automaticTestTable -> null, breakAfterAcquireFailure -> false, checkoutTimeout -> 0, connectionCustomizerClassName -> null, connectionTesterClassName -> com.mchange.v2.c3p0.impl.DefaultConnectionTester, contextClassLoaderSource -> caller, debugUnreturnedConnectionStackTraces -> false, factoryClassLocation -> null, forceIgnoreUnresolvedTransactions -> false, forceSynchronousCheckins -> false, identityToken -> 1hge1vpakztqmgw1fjdewj|3ca7f198, idleConnectionTestPeriod -> 300, initialPoolSize -> 5, maxAdministrativeTaskTime -> 0, maxConnectionAge -> 0, maxIdleTime -> 300, maxIdleTimeExcessConnections -> 0, maxPoolSize -> 20, maxStatements -> 0, maxStatementsPerConnection -> 0, minPoolSize -> 5, nestedDataSource -> com.mchange.v2.c3p0.DriverManagerDataSource@3224f2b7 [ description -> null, driverClass -> null, factoryClassLocation -> null, forceUseNamedDriverClass -> false, identityToken -> 1hge1vpakztqmgw1fjdewj|674f5034, jdbcUrl -> jdbc:postgresql://localhost:5432/uyuni, properties -> {driver_proto=jdbc:postgresql, password=******, user=******} ], preferredTestQuery -> select 'c3p0 ping' from dual, privilegeSpawnedThreads -> false, propertyCycle -> 0, statementCacheNumDeferredCloseThreads -> 0, testConnectionOnCheckin -> false, testConnectionOnCheckout -> true, unreturnedConnectionTimeout -> 0, usesTraditionalReflectiveProxies -> false; userOverrides: {} ], dataSourceName -> null, extensions -> {}, factoryClassLocation -> null, identityToken -> 1hge1vpakztqmgw1fjdewj|5db16956, numHelperThreads -> 3 ] 15-Oct-2021 00:24:02.696 INFO [RHN Message Dispatcher] com.mchange.v2.c3p0.impl.AbstractPoolBackedDataSource.getPoolManager Initializing c3p0 pool... com.mchange.v2.c3p0.PoolBackedDataSource@1b002e00 [ connectionPoolDataSource -> com.mchange.v2.c3p0.WrapperConnectionPoolDataSource@815d6c47 [ acquireIncrement -> 3, acquireRetryAttempts -> 30, acquireRetryDelay -> 1000, autoCommitOnClose -> false, automaticTestTable -> null, breakAfterAcquireFailure -> false, checkoutTimeout -> 0, connectionCustomizerClassName -> null, connectionTesterClassName -> com.mchange.v2.c3p0.impl.DefaultConnectionTester, contextClassLoaderSource -> caller, debugUnreturnedConnectionStackTraces -> false, factoryClassLocation -> null, forceIgnoreUnresolvedTransactions -> false, forceSynchronousCheckins -> false, identityToken -> 1hge1vpakztqmgw1fjdewj|56c640d3, idleConnectionTestPeriod -> 300, initialPoolSize -> 5, maxAdministrativeTaskTime -> 0, maxConnectionAge -> 0, maxIdleTime -> 300, maxIdleTimeExcessConnections -> 0, maxPoolSize -> 20, maxStatements -> 0, maxStatementsPerConnection -> 0, minPoolSize -> 5, nestedDataSource -> com.mchange.v2.c3p0.DriverManagerDataSource@898f6136 [ description -> null, driverClass -> null, factoryClassLocation -> null, forceUseNamedDriverClass -> false, identityToken -> 1hge1vpakztqmgw1fjdewj|3b48d01b, jdbcUrl -> jdbc:postgresql://localhost:5432/uyuni, properties -> {driver_proto=jdbc:postgresql, password=******, user=******} ], preferredTestQuery -> select 'c3p0 ping' from dual, privilegeSpawnedThreads -> false, propertyCycle -> 0, statementCacheNumDeferredCloseThreads -> 0, testConnectionOnCheckin -> false, testConnectionOnCheckout -> true, unreturnedConnectionTimeout -> 0, usesTraditionalReflectiveProxies -> false; userOverrides: {} ], dataSourceName -> null, extensions -> {}, factoryClassLocation -> null, identityToken -> 1hge1vpakztqmgw1fjdewj|45e17594, numHelperThreads -> 3 ] 15-Oct-2021 00:24:03.712 INFO [salt-event-connection-watchdog] com.mchange.v2.c3p0.impl.AbstractPoolBackedDataSource.getPoolManager Initializing c3p0 pool... com.mchange.v2.c3p0.PoolBackedDataSource@cd96a19c [ connectionPoolDataSource -> com.mchange.v2.c3p0.WrapperConnectionPoolDataSource@33ce53fc [ acquireIncrement -> 3, acquireRetryAttempts -> 30, acquireRetryDelay -> 1000, autoCommitOnClose -> false, automaticTestTable -> null, breakAfterAcquireFailure -> false, checkoutTimeout -> 0, connectionCustomizerClassName -> null, connectionTesterClassName -> com.mchange.v2.c3p0.impl.DefaultConnectionTester, contextClassLoaderSource -> caller, debugUnreturnedConnectionStackTraces -> false, factoryClassLocation -> null, forceIgnoreUnresolvedTransactions -> false, forceSynchronousCheckins -> false, identityToken -> 1hge1vpakztqmgw1fjdewj|4eae19e2, idleConnectionTestPeriod -> 300, initialPoolSize -> 5, maxAdministrativeTaskTime -> 0, maxConnectionAge -> 0, maxIdleTime -> 300, maxIdleTimeExcessConnections -> 0, maxPoolSize -> 20, maxStatements -> 0, maxStatementsPerConnection -> 0, minPoolSize -> 5, nestedDataSource -> com.mchange.v2.c3p0.DriverManagerDataSource@e2719916 [ description -> null, driverClass -> null, factoryClassLocation -> null, forceUseNamedDriverClass -> false, identityToken -> 1hge1vpakztqmgw1fjdewj|454e4cc, jdbcUrl -> jdbc:postgresql://localhost:5432/uyuni, properties -> {driver_proto=jdbc:postgresql, password=******, user=******} ], preferredTestQuery -> select 'c3p0 ping' from dual, privilegeSpawnedThreads -> false, propertyCycle -> 0, statementCacheNumDeferredCloseThreads -> 0, testConnectionOnCheckin -> false, testConnectionOnCheckout -> true, unreturnedConnectionTimeout -> 0, usesTraditionalReflectiveProxies -> false; userOverrides: {} ], dataSourceName -> null, extensions -> {}, factoryClassLocation -> null, identityToken -> 1hge1vpakztqmgw1fjdewj|2fc9b33b, numHelperThreads -> 3 ] 15-Oct-2021 00:24:04.501 INFO [main] com.mchange.v2.c3p0.impl.AbstractPoolBackedDataSource.getPoolManager Initializing c3p0 pool... com.mchange.v2.c3p0.PoolBackedDataSource@5a587ba1 [ connectionPoolDataSource -> com.mchange.v2.c3p0.WrapperConnectionPoolDataSource@abc5536c [ acquireIncrement -> 3, acquireRetryAttempts -> 30, acquireRetryDelay -> 1000, autoCommitOnClose -> false, automaticTestTable -> null, breakAfterAcquireFailure -> false, checkoutTimeout -> 0, connectionCustomizerClassName -> null, connectionTesterClassName -> com.mchange.v2.c3p0.impl.DefaultConnectionTester, contextClassLoaderSource -> caller, debugUnreturnedConnectionStackTraces -> false, factoryClassLocation -> null, forceIgnoreUnresolvedTransactions -> false, forceSynchronousCheckins -> false, identityToken -> 1hge1vpakztqmgw1fjdewj|76eb41bc, idleConnectionTestPeriod -> 300, initialPoolSize -> 5, maxAdministrativeTaskTime -> 0, maxConnectionAge -> 0, maxIdleTime -> 300, maxIdleTimeExcessConnections -> 0, maxPoolSize -> 20, maxStatements -> 0, maxStatementsPerConnection -> 0, minPoolSize -> 5, nestedDataSource -> com.mchange.v2.c3p0.DriverManagerDataSource@d0214c51 [ description -> null, driverClass -> null, factoryClassLocation -> null, forceUseNamedDriverClass -> false, identityToken -> 1hge1vpakztqmgw1fjdewj|275c02dd, jdbcUrl -> jdbc:postgresql://localhost:5432/uyuni, properties -> {driver_proto=jdbc:postgresql, password=******, user=******} ], preferredTestQuery -> select 'c3p0 ping' from dual, privilegeSpawnedThreads -> false, propertyCycle -> 0, statementCacheNumDeferredCloseThreads -> 0, testConnectionOnCheckin -> false, testConnectionOnCheckout -> true, unreturnedConnectionTimeout -> 0, usesTraditionalReflectiveProxies -> false; userOverrides: {} ], dataSourceName -> null, extensions -> {}, factoryClassLocation -> null, identityToken -> 1hge1vpakztqmgw1fjdewj|4a238791, numHelperThreads -> 3 ] 15-Oct-2021 00:24:04.844 SEVERE [main] org.apache.catalina.core.StandardContext.startInternal One or more listeners failed to start. Full details will be found in the appropriate container log file 15-Oct-2021 00:24:04.852 SEVERE [main] org.apache.catalina.core.StandardContext.startInternal Context [/rhn] startup failed due to previous errors 15-Oct-2021 00:24:04.890 WARNING [main] org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesJdbc The web application [rhn] registered the JDBC driver [org.postgresql.Driver] but failed to unregister it when the web application was stopped. To prevent a memory leak, the JDBC Driver has been forcibly unregistered. 15-Oct-2021 00:24:04.891 WARNING [main] org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesJdbc The web application [rhn] registered the JDBC driver [com.impossibl.postgres.jdbc.PGDriver] but failed to unregister it when the web application was stopped. To prevent a memory leak, the JDBC Driver has been forcibly unregistered. 15-Oct-2021 00:24:04.891 WARNING [main] org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesThreads The web application [rhn] appears to have started a thread named [pool-1-thread-1] but has failed to stop it. This is very likely to create a memory leak. Stack trace of thread: java.base@11.0.12/sun.nio.ch.EPoll.wait(Native Method) java.base@11.0.12/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120) java.base@11.0.12/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124) java.base@11.0.12/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136) org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor.execute(AbstractMultiworkerIOReactor.java:340) org.apache.http.impl.nio.conn.PoolingNHttpClientConnectionManager.execute(PoolingNHttpClientConnectionManager.java:221) org.apache.http.impl.nio.client.CloseableHttpAsyncClientBase$1.run(CloseableHttpAsyncClientBase.java:64) java.base@11.0.12/java.lang.Thread.run(Thread.java:829) 15-Oct-2021 00:24:04.897 WARNING [main] org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesThreads The web application [rhn] appears to have started a thread named [I/O dispatcher 1] but has failed to stop it. This is very likely to create a memory leak. Stack trace of thread: java.base@11.0.12/sun.nio.ch.EPoll.wait(Native Method) java.base@11.0.12/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120) java.base@11.0.12/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124) java.base@11.0.12/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136) org.apache.http.impl.nio.reactor.AbstractIOReactor.execute(AbstractIOReactor.java:255) org.apache.http.impl.nio.reactor.BaseIOReactor.execute(BaseIOReactor.java:104) org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(AbstractMultiworkerIOReactor.java:588) java.base@11.0.12/java.lang.Thread.run(Thread.java:829) 15-Oct-2021 00:24:04.898 WARNING [main] org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesThreads The web application [rhn] appears to have started a thread named [I/O dispatcher 2] but has failed to stop it. This is very likely to create a memory leak. Stack trace of thread: java.base@11.0.12/sun.nio.ch.EPoll.wait(Native Method) java.base@11.0.12/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120) java.base@11.0.12/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124) java.base@11.0.12/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136) org.apache.http.impl.nio.reactor.AbstractIOReactor.execute(AbstractIOReactor.java:255) org.apache.http.impl.nio.reactor.BaseIOReactor.execute(BaseIOReactor.java:104) org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(AbstractMultiworkerIOReactor.java:588) java.base@11.0.12/java.lang.Thread.run(Thread.java:829) 15-Oct-2021 00:24:04.899 WARNING [main] org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesThreads The web application [rhn] appears to have started a thread named [I/O dispatcher 3] but has failed to stop it. This is very likely to create a memory leak. Stack trace of thread: java.base@11.0.12/sun.nio.ch.EPoll.wait(Native Method) java.base@11.0.12/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120) java.base@11.0.12/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124) java.base@11.0.12/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136) org.apache.http.impl.nio.reactor.AbstractIOReactor.execute(AbstractIOReactor.java:255) org.apache.http.impl.nio.reactor.BaseIOReactor.execute(BaseIOReactor.java:104) org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(AbstractMultiworkerIOReactor.java:588) java.base@11.0.12/java.lang.Thread.run(Thread.java:829) 15-Oct-2021 00:24:04.900 WARNING [main] org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesThreads The web application [rhn] appears to have started a thread named [I/O dispatcher 4] but has failed to stop it. This is very likely to create a memory leak. Stack trace of thread: java.base@11.0.12/sun.nio.ch.EPoll.wait(Native Method) java.base@11.0.12/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120) java.base@11.0.12/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124) java.base@11.0.12/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136) org.apache.http.impl.nio.reactor.AbstractIOReactor.execute(AbstractIOReactor.java:255) org.apache.http.impl.nio.reactor.BaseIOReactor.execute(BaseIOReactor.java:104) org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(AbstractMultiworkerIOReactor.java:588) java.base@11.0.12/java.lang.Thread.run(Thread.java:829) 15-Oct-2021 00:24:04.902 WARNING [main] org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesThreads The web application [rhn] appears to have started a thread named [RHN Message Dispatcher] but has failed to stop it. This is very likely to create a memory leak. Stack trace of thread: java.base@11.0.12/java.lang.Object.wait(Native Method) EDU.oswego.cs.dl.util.concurrent.LinkedQueue.poll(LinkedQueue.java:170) com.redhat.rhn.common.messaging.MessageQueue.popEventMessage(MessageQueue.java:144) com.redhat.rhn.common.messaging.MessageDispatcher.run(MessageDispatcher.java:80) java.base@11.0.12/java.lang.Thread.run(Thread.java:829) 15-Oct-2021 00:24:04.902 WARNING [main] org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesThreads The web application [rhn] appears to have started a thread named [C3P0PooledConnectionPoolManager[identityToken->1hge1vpakztqmgw1fjdewj|5db16956]-AdminTaskTimer] but has failed to stop it. This is very likely to create a memory leak. Stack trace of thread: java.base@11.0.12/java.lang.Object.wait(Native Method) java.base@11.0.12/java.util.TimerThread.mainLoop(Timer.java:553) java.base@11.0.12/java.util.TimerThread.run(Timer.java:506) 15-Oct-2021 00:24:04.903 WARNING [main] org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesThreads The web application [rhn] appears to have started a thread named [C3P0PooledConnectionPoolManager[identityToken->1hge1vpakztqmgw1fjdewj|5db16956]-HelperThread-#0] but has failed to stop it. This is very likely to create a memory leak. Stack trace of thread: java.base@11.0.12/java.lang.Object.wait(Native Method) com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:683) 15-Oct-2021 00:24:04.904 WARNING [main] org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesThreads The web application [rhn] appears to have started a thread named [C3P0PooledConnectionPoolManager[identityToken->1hge1vpakztqmgw1fjdewj|5db16956]-HelperThread-#1] but has failed to stop it. This is very likely to create a memory leak. Stack trace of thread: java.base@11.0.12/java.lang.Object.wait(Native Method) com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:683) 15-Oct-2021 00:24:04.905 WARNING [main] org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesThreads The web application [rhn] appears to have started a thread named [C3P0PooledConnectionPoolManager[identityToken->1hge1vpakztqmgw1fjdewj|5db16956]-HelperThread-#2] but has failed to stop it. This is very likely to create a memory leak. Stack trace of thread: java.base@11.0.12/java.lang.Object.wait(Native Method) com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:683) 15-Oct-2021 00:24:04.906 WARNING [main] org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesThreads The web application [rhn] appears to have started a thread named [__DEFAULT__] but has failed to stop it. This is very likely to create a memory leak. Stack trace of thread: java.base@11.0.12/java.lang.Object.wait(Native Method) java.base@11.0.12/java.lang.Object.wait(Object.java:328) java.base@11.0.12/java.util.TimerThread.mainLoop(Timer.java:527) java.base@11.0.12/java.util.TimerThread.run(Timer.java:506) 15-Oct-2021 00:24:04.907 WARNING [main] org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesThreads The web application [rhn] appears to have started a thread named [PG-JDBC Housekeeper] but has failed to stop it. This is very likely to create a memory leak. Stack trace of thread: java.base@11.0.12/java.lang.Object.wait(Native Method) java.base@11.0.12/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:155) java.base@11.0.12/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:176) com.impossibl.postgres.jdbc.ThreadedHousekeeper$1.run(ThreadedHousekeeper.java:187) 15-Oct-2021 00:24:04.908 WARNING [main] org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesThreads The web application [rhn] appears to have started a thread named [PG-JDBC I/O (1)] but has failed to stop it. This is very likely to create a memory leak. Stack trace of thread: java.base@11.0.12/sun.nio.ch.EPoll.wait(Native Method) java.base@11.0.12/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120) java.base@11.0.12/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124) java.base@11.0.12/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141) io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:803) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:457) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) java.base@11.0.12/java.lang.Thread.run(Thread.java:829) 15-Oct-2021 00:24:04.909 WARNING [main] org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesThreads The web application [rhn] appears to have started a thread named [C3P0PooledConnectionPoolManager[identityToken->1hge1vpakztqmgw1fjdewj|45e17594]-AdminTaskTimer] but has failed to stop it. This is very likely to create a memory leak. Stack trace of thread: java.base@11.0.12/java.lang.Object.wait(Native Method) java.base@11.0.12/java.util.TimerThread.mainLoop(Timer.java:553) java.base@11.0.12/java.util.TimerThread.run(Timer.java:506) 15-Oct-2021 00:24:04.910 WARNING [main] org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesThreads The web application [rhn] appears to have started a thread named [C3P0PooledConnectionPoolManager[identityToken->1hge1vpakztqmgw1fjdewj|45e17594]-HelperThread-#0] but has failed to stop it. This is very likely to create a memory leak. Stack trace of thread: java.base@11.0.12/java.lang.Object.wait(Native Method) com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:683) 15-Oct-2021 00:24:04.911 WARNING [main] org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesThreads The web application [rhn] appears to have started a thread named [C3P0PooledConnectionPoolManager[identityToken->1hge1vpakztqmgw1fjdewj|45e17594]-HelperThread-#1] but has failed to stop it. This is very likely to create a memory leak. Stack trace of thread: java.base@11.0.12/java.lang.Object.wait(Native Method) com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:683) 15-Oct-2021 00:24:04.912 WARNING [main] org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesThreads The web application [rhn] appears to have started a thread named [C3P0PooledConnectionPoolManager[identityToken->1hge1vpakztqmgw1fjdewj|45e17594]-HelperThread-#2] but has failed to stop it. This is very likely to create a memory leak. Stack trace of thread: java.base@11.0.12/java.lang.Object.wait(Native Method) com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:683) 15-Oct-2021 00:24:04.912 WARNING [main] org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesThreads The web application [rhn] appears to have started a thread named [C3P0PooledConnectionPoolManager[identityToken->1hge1vpakztqmgw1fjdewj|2fc9b33b]-AdminTaskTimer] but has failed to stop it. This is very likely to create a memory leak. Stack trace of thread: java.base@11.0.12/java.lang.Object.wait(Native Method) java.base@11.0.12/java.util.TimerThread.mainLoop(Timer.java:553) java.base@11.0.12/java.util.TimerThread.run(Timer.java:506) 15-Oct-2021 00:24:04.913 WARNING [main] org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesThreads The web application [rhn] appears to have started a thread named [C3P0PooledConnectionPoolManager[identityToken->1hge1vpakztqmgw1fjdewj|2fc9b33b]-HelperThread-#0] but has failed to stop it. This is very likely to create a memory leak. Stack trace of thread: java.base@11.0.12/java.lang.Object.wait(Native Method) com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:683) 15-Oct-2021 00:24:04.913 WARNING [main] org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesThreads The web application [rhn] appears to have started a thread named [C3P0PooledConnectionPoolManager[identityToken->1hge1vpakztqmgw1fjdewj|2fc9b33b]-HelperThread-#1] but has failed to stop it. This is very likely to create a memory leak. Stack trace of thread: java.base@11.0.12/java.lang.Object.wait(Native Method) com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:683) 15-Oct-2021 00:24:04.914 WARNING [main] org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesThreads The web application [rhn] appears to have started a thread named [C3P0PooledConnectionPoolManager[identityToken->1hge1vpakztqmgw1fjdewj|2fc9b33b]-HelperThread-#2] but has failed to stop it. This is very likely to create a memory leak. Stack trace of thread: java.base@11.0.12/java.lang.Object.wait(Native Method) com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:683) 15-Oct-2021 00:24:04.915 WARNING [main] org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesThreads The web application [rhn] appears to have started a thread named [C3P0PooledConnectionPoolManager[identityToken->1hge1vpakztqmgw1fjdewj|4a238791]-AdminTaskTimer] but has failed to stop it. This is very likely to create a memory leak. Stack trace of thread: java.base@11.0.12/java.lang.Object.wait(Native Method) java.base@11.0.12/java.util.TimerThread.mainLoop(Timer.java:553) java.base@11.0.12/java.util.TimerThread.run(Timer.java:506) 15-Oct-2021 00:24:04.916 WARNING [main] org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesThreads The web application [rhn] appears to have started a thread named [C3P0PooledConnectionPoolManager[identityToken->1hge1vpakztqmgw1fjdewj|4a238791]-HelperThread-#0] but has failed to stop it. This is very likely to create a memory leak. Stack trace of thread: java.base@11.0.12/java.lang.Object.wait(Native Method) com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:683) 15-Oct-2021 00:24:04.917 WARNING [main] org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesThreads The web application [rhn] appears to have started a thread named [C3P0PooledConnectionPoolManager[identityToken->1hge1vpakztqmgw1fjdewj|4a238791]-HelperThread-#1] but has failed to stop it. This is very likely to create a memory leak. Stack trace of thread: java.base@11.0.12/java.lang.Object.wait(Native Method) com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:683) 15-Oct-2021 00:24:04.917 WARNING [main] org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesThreads The web application [rhn] appears to have started a thread named [C3P0PooledConnectionPoolManager[identityToken->1hge1vpakztqmgw1fjdewj|4a238791]-HelperThread-#2] but has failed to stop it. This is very likely to create a memory leak. Stack trace of thread: java.base@11.0.12/java.lang.Object.wait(Native Method) com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:683) 15-Oct-2021 00:24:04.919 SEVERE [main] org.apache.catalina.loader.WebappClassLoaderBase.checkThreadLocalMapForLeaks The web application [rhn] created a ThreadLocal with key of type [java.lang.ThreadLocal] (value [java.lang.ThreadLocal@41999e96]) and a value of type [io.netty.util.internal.InternalThreadLocalMap] (value [io.netty.util.internal.InternalThreadLocalMap@63ca45e0]) but failed to remove it when the web application was stopped. Threads are going to be renewed over time to try and avoid a probable memory leak. 15-Oct-2021 00:24:04.920 SEVERE [main] org.apache.catalina.loader.WebappClassLoaderBase.checkThreadLocalMapForLeaks The web application [rhn] created a ThreadLocal with key of type [java.lang.ThreadLocal] (value [java.lang.ThreadLocal@41999e96]) and a value of type [io.netty.util.internal.InternalThreadLocalMap] (value [io.netty.util.internal.InternalThreadLocalMap@50d4c4dc]) but failed to remove it when the web application was stopped. Threads are going to be renewed over time to try and avoid a probable memory leak. 15-Oct-2021 00:24:04.928 INFO [main] org.apache.catalina.startup.HostConfig.deployDirectory Deployment of web application directory [/srv/tomcat/webapps/rhn] has finished in [20,338] ms 15-Oct-2021 00:24:04.932 INFO [main] org.apache.coyote.AbstractProtocol.start Starting ProtocolHandler ["ajp-nio-127.0.0.1-8009"] 15-Oct-2021 00:24:04.950 INFO [main] org.apache.coyote.AbstractProtocol.start Starting ProtocolHandler ["ajp-nio-0:0:0:0:0:0:0:1-8009"] 15-Oct-2021 00:24:04.956 INFO [main] org.apache.coyote.AbstractProtocol.start Starting ProtocolHandler ["http-nio-127.0.0.1-8080"] 15-Oct-2021 00:24:04.959 INFO [main] org.apache.catalina.startup.Catalina.start Server startup in [20,458] milliseconds 15-Oct-2021 00:28:59.875 INFO [C3P0PooledConnectionPoolManager[identityToken->1hge1vpakztqmgw1fjdewj|5db16956]-AdminTaskTimer] org.apache.catalina.loader.WebappClassLoaderBase.checkStateForResourceLoading Illegal access: this web application instance has been stopped already. Could not load [com.mchange.v2.resourcepool.BasicResourcePool$AsyncTestIdleResourceTask]. The following stack trace is thrown for debugging purposes as well as to attempt to terminate the thread which caused the illegal access. java.lang.IllegalStateException: Illegal access: this web application instance has been stopped already. Could not load [com.mchange.v2.resourcepool.BasicResourcePool$AsyncTestIdleResourceTask]. The following stack trace is thrown for debugging purposes as well as to attempt to terminate the thread which caused the illegal access. at org.apache.catalina.loader.WebappClassLoaderBase.checkStateForResourceLoading(WebappClassLoaderBase.java:1385) at org.apache.catalina.loader.WebappClassLoaderBase.checkStateForClassLoading(WebappClassLoaderBase.java:1373) at org.apache.catalina.loader.WebappClassLoaderBase.loadClass(WebappClassLoaderBase.java:1226) at org.apache.catalina.loader.WebappClassLoaderBase.loadClass(WebappClassLoaderBase.java:1188) at com.mchange.v2.resourcepool.BasicResourcePool.checkIdleResources(BasicResourcePool.java:1635) at com.mchange.v2.resourcepool.BasicResourcePool.access$2000(BasicResourcePool.java:44) at com.mchange.v2.resourcepool.BasicResourcePool$CheckIdleResourcesTask.run(BasicResourcePool.java:2176) at java.base/java.util.TimerThread.mainLoop(Timer.java:556) at java.base/java.util.TimerThread.run(Timer.java:506) 15-Oct-2021 00:29:58.883 INFO [main] org.apache.catalina.core.StandardServer.await A valid shutdown command was received via the shutdown port. Stopping the Server instance. 15-Oct-2021 00:29:58.884 INFO [main] org.apache.coyote.AbstractProtocol.pause Pausing ProtocolHandler ["ajp-nio-127.0.0.1-8009"] 15-Oct-2021 00:29:58.890 INFO [main] org.apache.coyote.AbstractProtocol.pause Pausing ProtocolHandler ["ajp-nio-0:0:0:0:0:0:0:1-8009"] 15-Oct-2021 00:29:58.896 INFO [main] org.apache.coyote.AbstractProtocol.pause Pausing ProtocolHandler ["http-nio-127.0.0.1-8080"] 15-Oct-2021 00:29:58.902 INFO [main] org.apache.catalina.core.StandardService.stopInternal Stopping service [Catalina] 15-Oct-2021 00:29:58.904 INFO [main] org.apache.coyote.AbstractProtocol.stop Stopping ProtocolHandler ["ajp-nio-127.0.0.1-8009"] 15-Oct-2021 00:29:58.908 INFO [main] org.apache.coyote.AbstractProtocol.stop Stopping ProtocolHandler ["ajp-nio-0:0:0:0:0:0:0:1-8009"] 15-Oct-2021 00:29:58.911 INFO [main] org.apache.coyote.AbstractProtocol.stop Stopping ProtocolHandler ["http-nio-127.0.0.1-8080"] 15-Oct-2021 00:29:58.915 INFO [main] org.apache.coyote.AbstractProtocol.destroy Destroying ProtocolHandler ["ajp-nio-127.0.0.1-8009"] 15-Oct-2021 00:30:20.700 SEVERE [main] org.apache.catalina.startup.Catalina.initDirs Cannot find specified temporary folder at [/var/cache/tomcat/temp] 15-Oct-2021 00:30:21.136 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Server version name: Apache Tomcat/9.0.36 15-Oct-2021 00:30:21.137 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Server built: Mar 17 2021 12:00:00 UTC 15-Oct-2021 00:30:21.137 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Server version number: 9.0.36.0 15-Oct-2021 00:30:21.137 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log OS Name: Linux 15-Oct-2021 00:30:21.137 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log OS Version: 5.3.18-59.27-default 15-Oct-2021 00:30:21.137 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Architecture: amd64 15-Oct-2021 00:30:21.137 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Java Home: /usr/lib64/jvm/java-11-openjdk-11 15-Oct-2021 00:30:21.138 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log JVM Version: 11.0.12+7-suse-3.62.1-x8664 15-Oct-2021 00:30:21.138 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log JVM Vendor: Oracle Corporation 15-Oct-2021 00:30:21.138 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log CATALINA_BASE: /usr/share/tomcat 15-Oct-2021 00:30:21.138 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log CATALINA_HOME: /usr/share/tomcat 15-Oct-2021 00:30:21.145 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -ea 15-Oct-2021 00:30:21.145 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Xms256m 15-Oct-2021 00:30:21.145 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Xmx1G 15-Oct-2021 00:30:21.145 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djava.awt.headless=true 15-Oct-2021 00:30:21.145 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dorg.xml.sax.driver=com.redhat.rhn.frontend.xmlrpc.util.RhnSAXParser 15-Oct-2021 00:30:21.145 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dorg.apache.tomcat.util.http.Parameters.MAX_COUNT=1024 15-Oct-2021 00:30:21.145 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -XX:MaxNewSize=256 15-Oct-2021 00:30:21.146 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -XX:-UseConcMarkSweepGC 15-Oct-2021 00:30:21.146 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dnet.sf.ehcache.skipUpdateCheck=true 15-Oct-2021 00:30:21.146 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: --add-exports=java.annotation/javax.annotation.security=ALL-UNNAMED 15-Oct-2021 00:30:21.146 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: --add-opens=java.annotation/javax.annotation.security=ALL-UNNAMED 15-Oct-2021 00:30:21.146 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: --add-modules=java.annotation,com.sun.xml.bind 15-Oct-2021 00:30:21.146 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dcatalina.base=/usr/share/tomcat 15-Oct-2021 00:30:21.146 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dcatalina.home=/usr/share/tomcat 15-Oct-2021 00:30:21.146 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djava.endorsed.dirs= 15-Oct-2021 00:30:21.147 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djava.io.tmpdir=/var/cache/tomcat/temp 15-Oct-2021 00:30:21.147 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djava.util.logging.config.file=/usr/share/tomcat/conf/logging.properties 15-Oct-2021 00:30:21.147 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager 15-Oct-2021 00:30:21.147 INFO [main] org.apache.catalina.core.AprLifecycleListener.lifecycleEvent Loaded Apache Tomcat Native library [1.2.23] using APR version [1.6.3]. 15-Oct-2021 00:30:21.147 INFO [main] org.apache.catalina.core.AprLifecycleListener.lifecycleEvent APR capabilities: IPv6 [true], sendfile [true], accept filters [false], random [true]. 15-Oct-2021 00:30:21.147 INFO [main] org.apache.catalina.core.AprLifecycleListener.lifecycleEvent APR/OpenSSL configuration: useAprConnector [false], useOpenSSL [true] 15-Oct-2021 00:30:21.150 INFO [main] org.apache.catalina.core.AprLifecycleListener.initializeSSL OpenSSL successfully initialized [OpenSSL 1.1.1d 10 Sep 2019] 15-Oct-2021 00:30:22.602 INFO [main] org.apache.coyote.AbstractProtocol.init Initializing ProtocolHandler ["ajp-nio-127.0.0.1-8009"] 15-Oct-2021 00:30:22.727 INFO [main] org.apache.coyote.AbstractProtocol.init Initializing ProtocolHandler ["ajp-nio-0:0:0:0:0:0:0:1-8009"] 15-Oct-2021 00:30:22.740 INFO [main] org.apache.coyote.AbstractProtocol.init Initializing ProtocolHandler ["http-nio-127.0.0.1-8080"] 15-Oct-2021 00:30:22.748 INFO [main] org.apache.catalina.startup.Catalina.load Server initialization in [2,048] milliseconds 15-Oct-2021 00:30:23.023 INFO [main] org.apache.catalina.core.StandardService.startInternal Starting service [Catalina] 15-Oct-2021 00:30:23.023 INFO [main] org.apache.catalina.core.StandardEngine.startInternal Starting Servlet engine: [Apache Tomcat/9.0.36] 15-Oct-2021 00:30:23.027 SEVERE [main] org.apache.catalina.startup.HostConfig.beforeStart Unable to create directory for deployment: [/etc/tomcat/Catalina/localhost] 15-Oct-2021 00:30:23.066 INFO [main] org.apache.catalina.startup.HostConfig.deployDirectory Deploying web application directory [/srv/tomcat/webapps/rhn] 15-Oct-2021 00:30:23.168 WARNING [main] org.apache.catalina.core.StandardContext.postWorkDirectory Failed to create work directory [/usr/share/tomcat/work/Catalina/localhost/rhn] for context [/rhn] 15-Oct-2021 00:30:33.404 INFO [main] org.apache.jasper.servlet.TldScanner.scanJars At least one JAR was scanned for TLDs yet contained no TLDs. Enable debug logging for this logger for a complete list of JARs that were scanned but no TLDs were found in them. Skipping unneeded JARs during scanning can improve startup time and JSP compilation time. 15-Oct-2021 00:30:36.592 INFO [MLog-Init-Reporter] com.mchange.v2.log.MLog$1.run MLog clients using java 1.4+ standard logging. 15-Oct-2021 00:30:36.724 INFO [main] com.mchange.v2.c3p0.C3P0Registry.banner Initializing c3p0-0.9.5.2 [built 28-November-2020 12:00:00 +0000; debug? false; trace: 5] 15-Oct-2021 00:30:36.898 INFO [main] com.mchange.v2.c3p0.impl.AbstractPoolBackedDataSource.getPoolManager Initializing c3p0 pool... com.mchange.v2.c3p0.PoolBackedDataSource@a1bbdb61 [ connectionPoolDataSource -> com.mchange.v2.c3p0.WrapperConnectionPoolDataSource@1a8d630f [ acquireIncrement -> 3, acquireRetryAttempts -> 30, acquireRetryDelay -> 1000, autoCommitOnClose -> false, automaticTestTable -> null, breakAfterAcquireFailure -> false, checkoutTimeout -> 0, connectionCustomizerClassName -> null, connectionTesterClassName -> com.mchange.v2.c3p0.impl.DefaultConnectionTester, contextClassLoaderSource -> caller, debugUnreturnedConnectionStackTraces -> false, factoryClassLocation -> null, forceIgnoreUnresolvedTransactions -> false, forceSynchronousCheckins -> false, identityToken -> 1hge1vpakztz4s2162y2vk|21358f6c, idleConnectionTestPeriod -> 300, initialPoolSize -> 5, maxAdministrativeTaskTime -> 0, maxConnectionAge -> 0, maxIdleTime -> 300, maxIdleTimeExcessConnections -> 0, maxPoolSize -> 20, maxStatements -> 0, maxStatementsPerConnection -> 0, minPoolSize -> 5, nestedDataSource -> com.mchange.v2.c3p0.DriverManagerDataSource@5859dcb1 [ description -> null, driverClass -> null, factoryClassLocation -> null, forceUseNamedDriverClass -> false, identityToken -> 1hge1vpakztz4s2162y2vk|3c68a85f, jdbcUrl -> jdbc:postgresql://localhost:5432/uyuni, properties -> {driver_proto=jdbc:postgresql, password=******, user=******} ], preferredTestQuery -> select 'c3p0 ping' from dual, privilegeSpawnedThreads -> false, propertyCycle -> 0, statementCacheNumDeferredCloseThreads -> 0, testConnectionOnCheckin -> false, testConnectionOnCheckout -> true, unreturnedConnectionTimeout -> 0, usesTraditionalReflectiveProxies -> false; userOverrides: {} ], dataSourceName -> null, extensions -> {}, factoryClassLocation -> null, identityToken -> 1hge1vpakztz4s2162y2vk|1df0f641, numHelperThreads -> 3 ] 15-Oct-2021 00:30:39.793 INFO [RHN Message Dispatcher] com.mchange.v2.c3p0.impl.AbstractPoolBackedDataSource.getPoolManager Initializing c3p0 pool... com.mchange.v2.c3p0.PoolBackedDataSource@78d300e0 [ connectionPoolDataSource -> com.mchange.v2.c3p0.WrapperConnectionPoolDataSource@d768dc5a [ acquireIncrement -> 3, acquireRetryAttempts -> 30, acquireRetryDelay -> 1000, autoCommitOnClose -> false, automaticTestTable -> null, breakAfterAcquireFailure -> false, checkoutTimeout -> 0, connectionCustomizerClassName -> null, connectionTesterClassName -> com.mchange.v2.c3p0.impl.DefaultConnectionTester, contextClassLoaderSource -> caller, debugUnreturnedConnectionStackTraces -> false, factoryClassLocation -> null, forceIgnoreUnresolvedTransactions -> false, forceSynchronousCheckins -> false, identityToken -> 1hge1vpakztz4s2162y2vk|6ca86bab, idleConnectionTestPeriod -> 300, initialPoolSize -> 5, maxAdministrativeTaskTime -> 0, maxConnectionAge -> 0, maxIdleTime -> 300, maxIdleTimeExcessConnections -> 0, maxPoolSize -> 20, maxStatements -> 0, maxStatementsPerConnection -> 0, minPoolSize -> 5, nestedDataSource -> com.mchange.v2.c3p0.DriverManagerDataSource@f0807a9c [ description -> null, driverClass -> null, factoryClassLocation -> null, forceUseNamedDriverClass -> false, identityToken -> 1hge1vpakztz4s2162y2vk|66bfec9, jdbcUrl -> jdbc:postgresql://localhost:5432/uyuni, properties -> {driver_proto=jdbc:postgresql, password=******, user=******} ], preferredTestQuery -> select 'c3p0 ping' from dual, privilegeSpawnedThreads -> false, propertyCycle -> 0, statementCacheNumDeferredCloseThreads -> 0, testConnectionOnCheckin -> false, testConnectionOnCheckout -> true, unreturnedConnectionTimeout -> 0, usesTraditionalReflectiveProxies -> false; userOverrides: {} ], dataSourceName -> null, extensions -> {}, factoryClassLocation -> null, identityToken -> 1hge1vpakztz4s2162y2vk|40761d63, numHelperThreads -> 3 ] 15-Oct-2021 00:30:40.674 INFO [salt-event-connection-watchdog] com.mchange.v2.c3p0.impl.AbstractPoolBackedDataSource.getPoolManager Initializing c3p0 pool... com.mchange.v2.c3p0.PoolBackedDataSource@3fc43092 [ connectionPoolDataSource -> com.mchange.v2.c3p0.WrapperConnectionPoolDataSource@40130bf7 [ acquireIncrement -> 3, acquireRetryAttempts -> 30, acquireRetryDelay -> 1000, autoCommitOnClose -> false, automaticTestTable -> null, breakAfterAcquireFailure -> false, checkoutTimeout -> 0, connectionCustomizerClassName -> null, connectionTesterClassName -> com.mchange.v2.c3p0.impl.DefaultConnectionTester, contextClassLoaderSource -> caller, debugUnreturnedConnectionStackTraces -> false, factoryClassLocation -> null, forceIgnoreUnresolvedTransactions -> false, forceSynchronousCheckins -> false, identityToken -> 1hge1vpakztz4s2162y2vk|25768b08, idleConnectionTestPeriod -> 300, initialPoolSize -> 5, maxAdministrativeTaskTime -> 0, maxConnectionAge -> 0, maxIdleTime -> 300, maxIdleTimeExcessConnections -> 0, maxPoolSize -> 20, maxStatements -> 0, maxStatementsPerConnection -> 0, minPoolSize -> 5, nestedDataSource -> com.mchange.v2.c3p0.DriverManagerDataSource@dec86c09 [ description -> null, driverClass -> null, factoryClassLocation -> null, forceUseNamedDriverClass -> false, identityToken -> 1hge1vpakztz4s2162y2vk|22762e4d, jdbcUrl -> jdbc:postgresql://localhost:5432/uyuni, properties -> {driver_proto=jdbc:postgresql, password=******, user=******} ], preferredTestQuery -> select 'c3p0 ping' from dual, privilegeSpawnedThreads -> false, propertyCycle -> 0, statementCacheNumDeferredCloseThreads -> 0, testConnectionOnCheckin -> false, testConnectionOnCheckout -> true, unreturnedConnectionTimeout -> 0, usesTraditionalReflectiveProxies -> false; userOverrides: {} ], dataSourceName -> null, extensions -> {}, factoryClassLocation -> null, identityToken -> 1hge1vpakztz4s2162y2vk|418aab0b, numHelperThreads -> 3 ] 15-Oct-2021 00:30:41.460 INFO [main] com.mchange.v2.c3p0.impl.AbstractPoolBackedDataSource.getPoolManager Initializing c3p0 pool... com.mchange.v2.c3p0.PoolBackedDataSource@77186e2f [ connectionPoolDataSource -> com.mchange.v2.c3p0.WrapperConnectionPoolDataSource@4e92c539 [ acquireIncrement -> 3, acquireRetryAttempts -> 30, acquireRetryDelay -> 1000, autoCommitOnClose -> false, automaticTestTable -> null, breakAfterAcquireFailure -> false, checkoutTimeout -> 0, connectionCustomizerClassName -> null, connectionTesterClassName -> com.mchange.v2.c3p0.impl.DefaultConnectionTester, contextClassLoaderSource -> caller, debugUnreturnedConnectionStackTraces -> false, factoryClassLocation -> null, forceIgnoreUnresolvedTransactions -> false, forceSynchronousCheckins -> false, identityToken -> 1hge1vpakztz4s2162y2vk|5d98a66e, idleConnectionTestPeriod -> 300, initialPoolSize -> 5, maxAdministrativeTaskTime -> 0, maxConnectionAge -> 0, maxIdleTime -> 300, maxIdleTimeExcessConnections -> 0, maxPoolSize -> 20, maxStatements -> 0, maxStatementsPerConnection -> 0, minPoolSize -> 5, nestedDataSource -> com.mchange.v2.c3p0.DriverManagerDataSource@25af1126 [ description -> null, driverClass -> null, factoryClassLocation -> null, forceUseNamedDriverClass -> false, identityToken -> 1hge1vpakztz4s2162y2vk|dae3613, jdbcUrl -> jdbc:postgresql://localhost:5432/uyuni, properties -> {driver_proto=jdbc:postgresql, password=******, user=******} ], preferredTestQuery -> select 'c3p0 ping' from dual, privilegeSpawnedThreads -> false, propertyCycle -> 0, statementCacheNumDeferredCloseThreads -> 0, testConnectionOnCheckin -> false, testConnectionOnCheckout -> true, unreturnedConnectionTimeout -> 0, usesTraditionalReflectiveProxies -> false; userOverrides: {} ], dataSourceName -> null, extensions -> {}, factoryClassLocation -> null, identityToken -> 1hge1vpakztz4s2162y2vk|d304447, numHelperThreads -> 3 ] 15-Oct-2021 00:30:41.763 SEVERE [main] org.apache.catalina.core.StandardContext.startInternal One or more listeners failed to start. Full details will be found in the appropriate container log file 15-Oct-2021 00:30:41.767 SEVERE [main] org.apache.catalina.core.StandardContext.startInternal Context [/rhn] startup failed due to previous errors 15-Oct-2021 00:30:41.810 WARNING [main] org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesJdbc The web application [rhn] registered the JDBC driver [org.postgresql.Driver] but failed to unregister it when the web application was stopped. To prevent a memory leak, the JDBC Driver has been forcibly unregistered. 15-Oct-2021 00:30:41.810 WARNING [main] org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesJdbc The web application [rhn] registered the JDBC driver [com.impossibl.postgres.jdbc.PGDriver] but failed to unregister it when the web application was stopped. To prevent a memory leak, the JDBC Driver has been forcibly unregistered. 15-Oct-2021 00:30:41.812 WARNING [main] org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesThreads The web application [rhn] appears to have started a thread named [pool-1-thread-1] but has failed to stop it. This is very likely to create a memory leak. Stack trace of thread: java.base@11.0.12/sun.nio.ch.EPoll.wait(Native Method) java.base@11.0.12/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120) java.base@11.0.12/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124) java.base@11.0.12/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136) org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor.execute(AbstractMultiworkerIOReactor.java:340) org.apache.http.impl.nio.conn.PoolingNHttpClientConnectionManager.execute(PoolingNHttpClientConnectionManager.java:221) org.apache.http.impl.nio.client.CloseableHttpAsyncClientBase$1.run(CloseableHttpAsyncClientBase.java:64) java.base@11.0.12/java.lang.Thread.run(Thread.java:829) 15-Oct-2021 00:30:41.813 WARNING [main] org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesThreads The web application [rhn] appears to have started a thread named [I/O dispatcher 1] but has failed to stop it. This is very likely to create a memory leak. Stack trace of thread: java.base@11.0.12/sun.nio.ch.EPoll.wait(Native Method) java.base@11.0.12/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120) java.base@11.0.12/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124) java.base@11.0.12/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136) org.apache.http.impl.nio.reactor.AbstractIOReactor.execute(AbstractIOReactor.java:255) org.apache.http.impl.nio.reactor.BaseIOReactor.execute(BaseIOReactor.java:104) org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(AbstractMultiworkerIOReactor.java:588) java.base@11.0.12/java.lang.Thread.run(Thread.java:829) 15-Oct-2021 00:30:41.814 WARNING [main] org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesThreads The web application [rhn] appears to have started a thread named [I/O dispatcher 2] but has failed to stop it. This is very likely to create a memory leak. Stack trace of thread: java.base@11.0.12/sun.nio.ch.EPoll.wait(Native Method) java.base@11.0.12/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120) java.base@11.0.12/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124) java.base@11.0.12/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136) org.apache.http.impl.nio.reactor.AbstractIOReactor.execute(AbstractIOReactor.java:255) org.apache.http.impl.nio.reactor.BaseIOReactor.execute(BaseIOReactor.java:104) org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(AbstractMultiworkerIOReactor.java:588) java.base@11.0.12/java.lang.Thread.run(Thread.java:829) 15-Oct-2021 00:30:41.815 WARNING [main] org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesThreads The web application [rhn] appears to have started a thread named [I/O dispatcher 3] but has failed to stop it. This is very likely to create a memory leak. Stack trace of thread: java.base@11.0.12/sun.nio.ch.EPoll.wait(Native Method) java.base@11.0.12/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120) java.base@11.0.12/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124) java.base@11.0.12/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136) org.apache.http.impl.nio.reactor.AbstractIOReactor.execute(AbstractIOReactor.java:255) org.apache.http.impl.nio.reactor.BaseIOReactor.execute(BaseIOReactor.java:104) org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(AbstractMultiworkerIOReactor.java:588) java.base@11.0.12/java.lang.Thread.run(Thread.java:829) 15-Oct-2021 00:30:41.816 WARNING [main] org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesThreads The web application [rhn] appears to have started a thread named [I/O dispatcher 4] but has failed to stop it. This is very likely to create a memory leak. Stack trace of thread: java.base@11.0.12/sun.nio.ch.EPoll.wait(Native Method) java.base@11.0.12/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120) java.base@11.0.12/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124) java.base@11.0.12/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136) org.apache.http.impl.nio.reactor.AbstractIOReactor.execute(AbstractIOReactor.java:255) org.apache.http.impl.nio.reactor.BaseIOReactor.execute(BaseIOReactor.java:104) org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(AbstractMultiworkerIOReactor.java:588) java.base@11.0.12/java.lang.Thread.run(Thread.java:829) 15-Oct-2021 00:30:41.818 WARNING [main] org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesThreads The web application [rhn] appears to have started a thread named [RHN Message Dispatcher] but has failed to stop it. This is very likely to create a memory leak. Stack trace of thread: java.base@11.0.12/java.lang.Object.wait(Native Method) EDU.oswego.cs.dl.util.concurrent.LinkedQueue.poll(LinkedQueue.java:170) com.redhat.rhn.common.messaging.MessageQueue.popEventMessage(MessageQueue.java:144) com.redhat.rhn.common.messaging.MessageDispatcher.run(MessageDispatcher.java:80) java.base@11.0.12/java.lang.Thread.run(Thread.java:829) 15-Oct-2021 00:30:41.819 WARNING [main] org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesThreads The web application [rhn] appears to have started a thread named [C3P0PooledConnectionPoolManager[identityToken->1hge1vpakztz4s2162y2vk|1df0f641]-AdminTaskTimer] but has failed to stop it. This is very likely to create a memory leak. Stack trace of thread: java.base@11.0.12/java.lang.Object.wait(Native Method) java.base@11.0.12/java.util.TimerThread.mainLoop(Timer.java:553) java.base@11.0.12/java.util.TimerThread.run(Timer.java:506) 15-Oct-2021 00:30:41.819 WARNING [main] org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesThreads The web application [rhn] appears to have started a thread named [C3P0PooledConnectionPoolManager[identityToken->1hge1vpakztz4s2162y2vk|1df0f641]-HelperThread-#0] but has failed to stop it. This is very likely to create a memory leak. Stack trace of thread: java.base@11.0.12/java.lang.Object.wait(Native Method) com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:683) 15-Oct-2021 00:30:41.820 WARNING [main] org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesThreads The web application [rhn] appears to have started a thread named [C3P0PooledConnectionPoolManager[identityToken->1hge1vpakztz4s2162y2vk|1df0f641]-HelperThread-#1] but has failed to stop it. This is very likely to create a memory leak. Stack trace of thread: java.base@11.0.12/java.lang.Object.wait(Native Method) com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:683) 15-Oct-2021 00:30:41.821 WARNING [main] org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesThreads The web application [rhn] appears to have started a thread named [C3P0PooledConnectionPoolManager[identityToken->1hge1vpakztz4s2162y2vk|1df0f641]-HelperThread-#2] but has failed to stop it. This is very likely to create a memory leak. Stack trace of thread: java.base@11.0.12/java.lang.Object.wait(Native Method) com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:683) 15-Oct-2021 00:30:41.822 WARNING [main] org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesThreads The web application [rhn] appears to have started a thread named [__DEFAULT__] but has failed to stop it. This is very likely to create a memory leak. Stack trace of thread: java.base@11.0.12/java.lang.Object.wait(Native Method) java.base@11.0.12/java.lang.Object.wait(Object.java:328) java.base@11.0.12/java.util.TimerThread.mainLoop(Timer.java:527) java.base@11.0.12/java.util.TimerThread.run(Timer.java:506) 15-Oct-2021 00:30:41.822 WARNING [main] org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesThreads The web application [rhn] appears to have started a thread named [PG-JDBC Housekeeper] but has failed to stop it. This is very likely to create a memory leak. Stack trace of thread: java.base@11.0.12/java.lang.Object.wait(Native Method) java.base@11.0.12/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:155) java.base@11.0.12/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:176) com.impossibl.postgres.jdbc.ThreadedHousekeeper$1.run(ThreadedHousekeeper.java:187) 15-Oct-2021 00:30:41.823 WARNING [main] org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesThreads The web application [rhn] appears to have started a thread named [PG-JDBC I/O (1)] but has failed to stop it. This is very likely to create a memory leak. Stack trace of thread: java.base@11.0.12/sun.nio.ch.EPoll.wait(Native Method) java.base@11.0.12/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120) java.base@11.0.12/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124) java.base@11.0.12/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141) io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:803) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:457) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) java.base@11.0.12/java.lang.Thread.run(Thread.java:829) 15-Oct-2021 00:30:41.825 WARNING [main] org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesThreads The web application [rhn] appears to have started a thread named [C3P0PooledConnectionPoolManager[identityToken->1hge1vpakztz4s2162y2vk|40761d63]-AdminTaskTimer] but has failed to stop it. This is very likely to create a memory leak. Stack trace of thread: java.base@11.0.12/java.lang.Object.wait(Native Method) java.base@11.0.12/java.util.TimerThread.mainLoop(Timer.java:553) java.base@11.0.12/java.util.TimerThread.run(Timer.java:506) 15-Oct-2021 00:30:41.825 WARNING [main] org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesThreads The web application [rhn] appears to have started a thread named [C3P0PooledConnectionPoolManager[identityToken->1hge1vpakztz4s2162y2vk|40761d63]-HelperThread-#0] but has failed to stop it. This is very likely to create a memory leak. Stack trace of thread: java.base@11.0.12/java.lang.Object.wait(Native Method) com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:683) 15-Oct-2021 00:30:41.826 WARNING [main] org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesThreads The web application [rhn] appears to have started a thread named [C3P0PooledConnectionPoolManager[identityToken->1hge1vpakztz4s2162y2vk|40761d63]-HelperThread-#1] but has failed to stop it. This is very likely to create a memory leak. Stack trace of thread: java.base@11.0.12/java.lang.Object.wait(Native Method) com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:683) 15-Oct-2021 00:30:41.827 WARNING [main] org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesThreads The web application [rhn] appears to have started a thread named [C3P0PooledConnectionPoolManager[identityToken->1hge1vpakztz4s2162y2vk|40761d63]-HelperThread-#2] but has failed to stop it. This is very likely to create a memory leak. Stack trace of thread: java.base@11.0.12/java.lang.Object.wait(Native Method) com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:683) 15-Oct-2021 00:30:41.828 WARNING [main] org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesThreads The web application [rhn] appears to have started a thread named [C3P0PooledConnectionPoolManager[identityToken->1hge1vpakztz4s2162y2vk|418aab0b]-AdminTaskTimer] but has failed to stop it. This is very likely to create a memory leak. Stack trace of thread: java.base@11.0.12/java.lang.Object.wait(Native Method) java.base@11.0.12/java.util.TimerThread.mainLoop(Timer.java:553) java.base@11.0.12/java.util.TimerThread.run(Timer.java:506) 15-Oct-2021 00:30:41.828 WARNING [main] org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesThreads The web application [rhn] appears to have started a thread named [C3P0PooledConnectionPoolManager[identityToken->1hge1vpakztz4s2162y2vk|418aab0b]-HelperThread-#0] but has failed to stop it. This is very likely to create a memory leak. Stack trace of thread: java.base@11.0.12/java.lang.Object.wait(Native Method) com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:683) 15-Oct-2021 00:30:41.829 WARNING [main] org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesThreads The web application [rhn] appears to have started a thread named [C3P0PooledConnectionPoolManager[identityToken->1hge1vpakztz4s2162y2vk|418aab0b]-HelperThread-#1] but has failed to stop it. This is very likely to create a memory leak. Stack trace of thread: java.base@11.0.12/java.lang.Object.wait(Native Method) com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:683) 15-Oct-2021 00:30:41.830 WARNING [main] org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesThreads The web application [rhn] appears to have started a thread named [C3P0PooledConnectionPoolManager[identityToken->1hge1vpakztz4s2162y2vk|418aab0b]-HelperThread-#2] but has failed to stop it. This is very likely to create a memory leak. Stack trace of thread: java.base@11.0.12/java.lang.Object.wait(Native Method) com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:683) 15-Oct-2021 00:30:41.830 WARNING [main] org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesThreads The web application [rhn] appears to have started a thread named [C3P0PooledConnectionPoolManager[identityToken->1hge1vpakztz4s2162y2vk|d304447]-AdminTaskTimer] but has failed to stop it. This is very likely to create a memory leak. Stack trace of thread: java.base@11.0.12/java.lang.Object.wait(Native Method) java.base@11.0.12/java.util.TimerThread.mainLoop(Timer.java:553) java.base@11.0.12/java.util.TimerThread.run(Timer.java:506) 15-Oct-2021 00:30:41.831 WARNING [main] org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesThreads The web application [rhn] appears to have started a thread named [C3P0PooledConnectionPoolManager[identityToken->1hge1vpakztz4s2162y2vk|d304447]-HelperThread-#0] but has failed to stop it. This is very likely to create a memory leak. Stack trace of thread: java.base@11.0.12/java.lang.Object.wait(Native Method) com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:683) 15-Oct-2021 00:30:41.832 WARNING [main] org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesThreads The web application [rhn] appears to have started a thread named [C3P0PooledConnectionPoolManager[identityToken->1hge1vpakztz4s2162y2vk|d304447]-HelperThread-#1] but has failed to stop it. This is very likely to create a memory leak. Stack trace of thread: java.base@11.0.12/java.lang.Object.wait(Native Method) com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:683) 15-Oct-2021 00:30:41.832 WARNING [main] org.apache.catalina.loader.WebappClassLoaderBase.clearReferencesThreads The web application [rhn] appears to have started a thread named [C3P0PooledConnectionPoolManager[identityToken->1hge1vpakztz4s2162y2vk|d304447]-HelperThread-#2] but has failed to stop it. This is very likely to create a memory leak. Stack trace of thread: java.base@11.0.12/java.lang.Object.wait(Native Method) com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:683) 15-Oct-2021 00:30:41.834 SEVERE [main] org.apache.catalina.loader.WebappClassLoaderBase.checkThreadLocalMapForLeaks The web application [rhn] created a ThreadLocal with key of type [java.lang.ThreadLocal] (value [java.lang.ThreadLocal@67f49986]) and a value of type [io.netty.util.internal.InternalThreadLocalMap] (value [io.netty.util.internal.InternalThreadLocalMap@5d349cc2]) but failed to remove it when the web application was stopped. Threads are going to be renewed over time to try and avoid a probable memory leak. 15-Oct-2021 00:30:41.835 SEVERE [main] org.apache.catalina.loader.WebappClassLoaderBase.checkThreadLocalMapForLeaks The web application [rhn] created a ThreadLocal with key of type [java.lang.ThreadLocal] (value [java.lang.ThreadLocal@67f49986]) and a value of type [io.netty.util.internal.InternalThreadLocalMap] (value [io.netty.util.internal.InternalThreadLocalMap@227be37c]) but failed to remove it when the web application was stopped. Threads are going to be renewed over time to try and avoid a probable memory leak. 15-Oct-2021 00:30:41.841 INFO [main] org.apache.catalina.startup.HostConfig.deployDirectory Deployment of web application directory [/srv/tomcat/webapps/rhn] has finished in [18,775] ms 15-Oct-2021 00:30:41.844 INFO [main] org.apache.coyote.AbstractProtocol.start Starting ProtocolHandler ["ajp-nio-127.0.0.1-8009"] 15-Oct-2021 00:30:41.866 INFO [main] org.apache.coyote.AbstractProtocol.start Starting ProtocolHandler ["ajp-nio-0:0:0:0:0:0:0:1-8009"] 15-Oct-2021 00:30:41.876 INFO [main] org.apache.coyote.AbstractProtocol.start Starting ProtocolHandler ["http-nio-127.0.0.1-8080"] 15-Oct-2021 00:30:41.885 INFO [main] org.apache.catalina.startup.Catalina.start Server startup in [19,137] milliseconds 15-Oct-2021 00:35:36.918 INFO [C3P0PooledConnectionPoolManager[identityToken->1hge1vpakztz4s2162y2vk|1df0f641]-AdminTaskTimer] org.apache.catalina.loader.WebappClassLoaderBase.checkStateForResourceLoading Illegal access: this web application instance has been stopped already. Could not load [com.mchange.v2.resourcepool.BasicResourcePool$AsyncTestIdleResourceTask]. The following stack trace is thrown for debugging purposes as well as to attempt to terminate the thread which caused the illegal access. java.lang.IllegalStateException: Illegal access: this web application instance has been stopped already. Could not load [com.mchange.v2.resourcepool.BasicResourcePool$AsyncTestIdleResourceTask]. The following stack trace is thrown for debugging purposes as well as to attempt to terminate the thread which caused the illegal access. at org.apache.catalina.loader.WebappClassLoaderBase.checkStateForResourceLoading(WebappClassLoaderBase.java:1385) at org.apache.catalina.loader.WebappClassLoaderBase.checkStateForClassLoading(WebappClassLoaderBase.java:1373) at org.apache.catalina.loader.WebappClassLoaderBase.loadClass(WebappClassLoaderBase.java:1226) at org.apache.catalina.loader.WebappClassLoaderBase.loadClass(WebappClassLoaderBase.java:1188) at com.mchange.v2.resourcepool.BasicResourcePool.checkIdleResources(BasicResourcePool.java:1635) at com.mchange.v2.resourcepool.BasicResourcePool.access$2000(BasicResourcePool.java:44) at com.mchange.v2.resourcepool.BasicResourcePool$CheckIdleResourcesTask.run(BasicResourcePool.java:2176) at java.base/java.util.TimerThread.mainLoop(Timer.java:556) at java.base/java.util.TimerThread.run(Timer.java:506)