Gentoo Forums
Gentoo Forums
Gentoo Forums
Quick Search: in
[Solved] Tomcat on Icedtea only answers during shutdown?!
View unanswered posts
View posts from last 24 hours

 
Reply to topic    Gentoo Forums Forum Index Networking & Security
View previous topic :: View next topic  
Author Message
Cygon
Tux's lil' helper
Tux's lil' helper


Joined: 05 Feb 2006
Posts: 81
Location: Germany

PostPosted: Sun Feb 28, 2016 10:55 am    Post subject: [Solved] Tomcat on Icedtea only answers during shutdown?! Reply with quote

I'm setting up a new Gentoo server on which I plan to run Jenkins (a Java webapp) through Tomcat.

At first, everything worked fine - I've set up the tomcat instance, the host manager showed, I installed Jenkins and it launched without a hitch. Then I restarted Jenkins and things went downhill from there:

- First, Jenkins (the deployed webapp) would not complete its restart
- Tomcat manager app showed 5 sessions and would time out when I hit 'Stop'
- After restarting tomcat itself, the Tomcat manager app still showed 5 Jenkins sessions
- After hitting 'Stop' a few times, the Tomcat manager app stopped responding
- Even after restarting tomcat, I get no HTTP response from Tomcat at all
- ...except: during shutdown. If I issue an HTTP request and then shut down Tomcat, it will be served.

I have erased every trace of Jenkins, I have removed and recreated my tomcat instance, I have restarted the server and nothing changed.

I've set all Tomcat logging options to 'FINE' (meaning debug/verbose). There is nothing useful at all in the logs. Normal startup without errors, tomcat process is running, HTTP requests time out & do *not* get logged. If I shut down Tomcat while a HTTP request is still waiting, then it does get logged.[/code]

Code:
8 core Opteron, AMD64, 32 GB RAM
Gentoo 4.1.15-r1
Tomcat 8.0.30
Tomcat-native 1.2.4
Icedtea-7.2.6.4-r1


Grateful for any idea or suggestion...


Last edited by Cygon on Tue Mar 01, 2016 6:01 pm; edited 1 time in total
Back to top
View user's profile Send private message
Cygon
Tux's lil' helper
Tux's lil' helper


Joined: 05 Feb 2006
Posts: 81
Location: Germany

PostPosted: Sun Feb 28, 2016 1:54 pm    Post subject: Reply with quote

Observations:

- it's running fine on another server, though that one is x86
- very sporadically it does begin to work. One running, it's fast and reliable.

- here's one instance of it suddenly starting to work after doing nothing for 8 minutes with 0% CPU usage.

Code:
28-Feb-2016 13:36:10.214 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Server version:        Apache Tomcat/8.0.30-gentoo
28-Feb-2016 13:36:10.216 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Server built:          Feb 28 2016 13:33:17 UTC
28-Feb-2016 13:36:10.217 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Server number:         8.0.30
28-Feb-2016 13:36:10.217 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log OS Name:               Linux
28-Feb-2016 13:36:10.217 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log OS Version:            4.1.15-gentoo-r1
28-Feb-2016 13:36:10.217 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Architecture:          amd64
28-Feb-2016 13:36:10.218 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Java Home:             /usr/lib64/icedtea7/jre
28-Feb-2016 13:36:10.218 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log JVM Version:           1.7.0_95-b00
28-Feb-2016 13:36:10.218 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log JVM Vendor:            Oracle Corporation
28-Feb-2016 13:36:10.218 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log CATALINA_BASE:         /var/lib/tomcat-8-jenkins
28-Feb-2016 13:36:10.219 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log CATALINA_HOME:         /usr/share/tomcat-8
28-Feb-2016 13:36:10.219 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager
28-Feb-2016 13:36:10.220 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djava.util.logging.config.file=/var/lib/tomcat-8-jenkins/conf/logging.properties
28-Feb-2016 13:36:10.220 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dcatalina.base=/var/lib/tomcat-8-jenkins
28-Feb-2016 13:36:10.220 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dcatalina.home=/usr/share/tomcat-8
28-Feb-2016 13:36:10.220 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Djava.io.tmpdir=/var/tmp/tomcat-8-jenkins
28-Feb-2016 13:36:10.220 INFO [main] org.apache.catalina.startup.VersionLoggerListener.log Command line argument: -Dgentoo.classpath=/usr/share/eclipse-ecj-4.4/lib/ecj.jar,/usr/share/oracle-javamail/lib/mail.jar,/usr/share/tomcat-servlet-api-3.1/lib/el-api.jar,/usr/share/tomcat-servlet-api-3.1/lib/jsp-api.jar,/usr/share/tomcat-servlet-api-3.1/lib/servlet-api.jar
28-Feb-2016 13:36:10.221 INFO [main] org.apache.catalina.core.AprLifecycleListener.lifecycleEvent Loaded APR based Apache Tomcat Native library 1.2.4 using APR version 1.5.2.
28-Feb-2016 13:36:10.221 INFO [main] org.apache.catalina.core.AprLifecycleListener.lifecycleEvent APR capabilities: IPv6 [true], sendfile [true], accept filters [false], random [true].
28-Feb-2016 13:36:10.226 INFO [main] org.apache.catalina.core.AprLifecycleListener.initializeSSL OpenSSL successfully initialized (OpenSSL 1.0.2f  28 Jan 2016)
28-Feb-2016 13:36:10.376 INFO [main] org.apache.coyote.AbstractProtocol.init Initializing ProtocolHandler ["http-apr-8080"]
28-Feb-2016 13:36:10.403 INFO [main] org.apache.coyote.AbstractProtocol.init Initializing ProtocolHandler ["ajp-apr-8009"]
28-Feb-2016 13:36:10.408 INFO [main] org.apache.catalina.startup.Catalina.load Initialization processed in 1263 ms
28-Feb-2016 13:36:10.465 INFO [main] org.apache.catalina.core.StandardService.startInternal Starting service Catalina
28-Feb-2016 13:36:10.465 INFO [main] org.apache.catalina.core.StandardEngine.startInternal Starting Servlet Engine: Apache Tomcat/8.0.30-gentoo
28-Feb-2016 13:36:10.482 INFO [localhost-startStop-1] org.apache.catalina.startup.HostConfig.deployDescriptor Deploying configuration descriptor /etc/tomcat-8-jenkins/Catalina/localhost/host-manager.xml
28-Feb-2016 13:36:11.670 INFO [localhost-startStop-1] org.apache.jasper.servlet.TldScanner.scanJars At least one JAR was scanned for TLDs yet contained no TLDs. Enable debug logging for this logger for a complete list of JARs that were scanned but no TLDs were found in them. Skipping unneeded JARs during scanning can improve startup time and JSP compilation time.
28-Feb-2016 13:44:50.732 INFO [localhost-startStop-1] org.apache.catalina.util.SessionIdGeneratorBase.createSecureRandom Creation of SecureRandom instance for session ID generation using [SHA1PRNG] took [519,017] milliseconds.
28-Feb-2016 13:44:50.772 INFO [localhost-startStop-1] org.apache.catalina.startup.HostConfig.deployDescriptor Deployment of configuration descriptor /etc/tomcat-8-jenkins/Catalina/localhost/host-manager.xml has finished in 520,290 ms
28-Feb-2016 13:44:50.773 INFO [localhost-startStop-1] org.apache.catalina.startup.HostConfig.deployDescriptor Deploying configuration descriptor /etc/tomcat-8-jenkins/Catalina/localhost/manager.xml
28-Feb-2016 13:44:51.204 INFO [localhost-startStop-1] org.apache.jasper.servlet.TldScanner.scanJars At least one JAR was scanned for TLDs yet contained no TLDs. Enable debug logging for this logger for a complete list of JARs that were scanned but no TLDs were found in them. Skipping unneeded JARs during scanning can improve startup time and JSP compilation time.
28-Feb-2016 13:44:51.211 INFO [localhost-startStop-1] org.apache.catalina.startup.HostConfig.deployDescriptor Deployment of configuration descriptor /etc/tomcat-8-jenkins/Catalina/localhost/manager.xml has finished in 438 ms
28-Feb-2016 13:44:51.213 INFO [localhost-startStop-1] org.apache.catalina.startup.HostConfig.deployDirectory Deploying web application directory /var/lib/tomcat-8-jenkins/webapps/ROOT
28-Feb-2016 13:44:51.605 INFO [localhost-startStop-1] org.apache.jasper.servlet.TldScanner.scanJars At least one JAR was scanned for TLDs yet contained no TLDs. Enable debug logging for this logger for a complete list of JARs that were scanned but no TLDs were found in them. Skipping unneeded JARs during scanning can improve startup time and JSP compilation time.
28-Feb-2016 13:44:51.612 INFO [localhost-startStop-1] org.apache.catalina.startup.HostConfig.deployDirectory Deployment of web application directory /var/lib/tomcat-8-jenkins/webapps/ROOT has finished in 399 ms
28-Feb-2016 13:44:51.617 INFO [main] org.apache.coyote.AbstractProtocol.start Starting ProtocolHandler ["http-apr-8080"]
28-Feb-2016 13:44:51.628 INFO [main] org.apache.coyote.AbstractProtocol.start Starting ProtocolHandler ["ajp-apr-8009"]
28-Feb-2016 13:44:51.629 INFO [main] org.apache.catalina.startup.Catalina.start Server startup in 521220 ms


Some googling revealed that tomcat may need some entropy for the RNG to start up. Since it's idling at 0% CPU and takes crazy long, that's my best bet.

I'll update this thread if that's the problem (in that case it would have been reeally nice of Tomcat could just write a single line into the log saying "waiting for entropy" or something :p)
Back to top
View user's profile Send private message
Cygon
Tux's lil' helper
Tux's lil' helper


Joined: 05 Feb 2006
Posts: 81
Location: Germany

PostPosted: Tue Mar 01, 2016 6:01 pm    Post subject: Reply with quote

Okay, it really was my system running out of entropy.

Code:
cat /proc/sys/kernel/random/entropy_avail


shows it going down to zero (or just a few bytes), causing some disk activity

Code:
du / -h


will fill the entropy pool and allow TomCat to launch.[/code]
Back to top
View user's profile Send private message
Display posts from previous:   
Reply to topic    Gentoo Forums Forum Index Networking & Security All times are GMT
Page 1 of 1

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum