Apache Mina threads deadlocked

[aakture]

Hi, we had an issue happen during testing, were all the AnonymouseIoService threads were waiting on a lock that was not held by any other thread. This seems to have caused the SFS instance to not be able to reply to any clients. SFS was still able to allow clients to connect, but not reply to them (I could telnet to the port fine). I found a post about this JVM bug: http://bugs.sun.com/bugdatabase/view_bu ... id=6822370

Has anyone else seen this, and is it an issue in 2X as well? Here's the thread dump obtained during the time we noticed the issue:

Code: Select all

INFO   | jvm 1    | 2012/11/01 23:50:54 | Full thread dump Java HotSpot(TM) 64-Bit Server VM (20.6-b01 mixed mode):
INFO   | jvm 1    | 2012/11/01 23:50:54 |
INFO   | jvm 1    | 2012/11/01 23:50:54 | "AWT-EventQueue-0" prio=10 tid=0x0000000040387800 nid=0x3000 in Object.wait() [0x00007f51fa0f9000]
INFO   | jvm 1    | 2012/11/01 23:50:54 |    java.lang.Thread.State: WAITING (on object monitor)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.lang.Object.wait(Native Method)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.lang.Object.wait(Object.java:485)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.awt.EventQueue.getNextEvent(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       - locked <0x000000058f8dbd60> (a java.awt.EventQueue)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.awt.EventDispatchThread.pumpOneEventForFilters(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.awt.EventDispatchThread.pumpEvents(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.awt.EventDispatchThread.pumpEvents(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.awt.EventDispatchThread.run(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |
INFO   | jvm 1    | 2012/11/01 23:50:54 | "AWT-Shutdown" prio=10 tid=0x00000000404f2000 nid=0x2fff in Object.wait() [0x00007f51f9ff8000]
INFO   | jvm 1    | 2012/11/01 23:50:54 |    java.lang.Thread.State: TIMED_WAITING (on object monitor)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.lang.Object.wait(Native Method)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at sun.awt.AWTAutoShutdown.run(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       - locked <0x000000058f8c3038> (a java.lang.Object)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.lang.Thread.run(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |
INFO   | jvm 1    | 2012/11/01 23:50:54 | "AnonymousIoService-16" daemon prio=10 tid=0x00007f51f5107800 nid=0x2ffe waiting on condition [0x00007f51f97f0000]
INFO   | jvm 1    | 2012/11/01 23:50:54 |    java.lang.Thread.State: WAITING (parking)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at sun.misc.Unsafe.park(Native Method)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       - parking to wait for  <0x000000058f4d4598> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.locks.LockSupport.park(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.LinkedBlockingQueue.take(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.ThreadPoolExecutor.getTask(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at org.apache.mina.util.NamePreservingRunnable.run(NamePreservingRunnable.java:51)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.lang.Thread.run(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |
INFO   | jvm 1    | 2012/11/01 23:50:54 | "AnonymousIoService-15" daemon prio=10 tid=0x00007f51f4101800 nid=0x2f88 waiting on condition [0x00007f51f98f1000]
INFO   | jvm 1    | 2012/11/01 23:50:54 |    java.lang.Thread.State: WAITING (parking)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at sun.misc.Unsafe.park(Native Method)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       - parking to wait for  <0x000000058f4d4598> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.locks.LockSupport.park(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.LinkedBlockingQueue.take(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.ThreadPoolExecutor.getTask(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at org.apache.mina.util.NamePreservingRunnable.run(NamePreservingRunnable.java:51)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.lang.Thread.run(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |
INFO   | jvm 1    | 2012/11/01 23:50:54 | "AnonymousIoService-14" daemon prio=10 tid=0x00007f51f4101000 nid=0x2f87 waiting on condition [0x00007f51f99f2000]
INFO   | jvm 1    | 2012/11/01 23:50:54 |    java.lang.Thread.State: WAITING (parking)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at sun.misc.Unsafe.park(Native Method)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       - parking to wait for  <0x000000058f4d4598> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.locks.LockSupport.park(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.LinkedBlockingQueue.take(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.ThreadPoolExecutor.getTask(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at org.apache.mina.util.NamePreservingRunnable.run(NamePreservingRunnable.java:51)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.lang.Thread.run(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |
INFO   | jvm 1    | 2012/11/01 23:50:54 | "AnonymousIoService-13" daemon prio=10 tid=0x00007f51f408e800 nid=0x2f05 waiting on condition [0x00007f51f9af3000]
INFO   | jvm 1    | 2012/11/01 23:50:54 |    java.lang.Thread.State: WAITING (parking)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at sun.misc.Unsafe.park(Native Method)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       - parking to wait for  <0x000000058f4d4598> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.locks.LockSupport.park(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.LinkedBlockingQueue.take(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.ThreadPoolExecutor.getTask(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at org.apache.mina.util.NamePreservingRunnable.run(NamePreservingRunnable.java:51)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.lang.Thread.run(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |
INFO   | jvm 1    | 2012/11/01 23:50:54 | "AnonymousIoService-12" daemon prio=10 tid=0x00007f51f408c800 nid=0x2f04 waiting on condition [0x00007f51f9bf4000]
INFO   | jvm 1    | 2012/11/01 23:50:54 |    java.lang.Thread.State: WAITING (parking)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at sun.misc.Unsafe.park(Native Method)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       - parking to wait for  <0x000000058f4d4598> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.locks.LockSupport.park(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.LinkedBlockingQueue.take(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.ThreadPoolExecutor.getTask(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at org.apache.mina.util.NamePreservingRunnable.run(NamePreservingRunnable.java:51)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.lang.Thread.run(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |
INFO   | jvm 1    | 2012/11/01 23:50:54 | "AnonymousIoService-11" daemon prio=10 tid=0x00007f51f408b800 nid=0x2ead waiting on condition [0x00007f51f9cf5000]
INFO   | jvm 1    | 2012/11/01 23:50:54 |    java.lang.Thread.State: WAITING (parking)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at sun.misc.Unsafe.park(Native Method)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       - parking to wait for  <0x000000058f4d4598> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.locks.LockSupport.park(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.LinkedBlockingQueue.take(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.ThreadPoolExecutor.getTask(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at org.apache.mina.util.NamePreservingRunnable.run(NamePreservingRunnable.java:51)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.lang.Thread.run(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |
INFO   | jvm 1    | 2012/11/01 23:50:54 | "AnonymousIoService-10" daemon prio=10 tid=0x00007f51f408a800 nid=0x2eac waiting on condition [0x00007f51f9df6000]
INFO   | jvm 1    | 2012/11/01 23:50:54 |    java.lang.Thread.State: WAITING (parking)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at sun.misc.Unsafe.park(Native Method)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       - parking to wait for  <0x000000058f4d4598> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.locks.LockSupport.park(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.LinkedBlockingQueue.take(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.ThreadPoolExecutor.getTask(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at org.apache.mina.util.NamePreservingRunnable.run(NamePreservingRunnable.java:51)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.lang.Thread.run(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |
INFO   | jvm 1    | 2012/11/01 23:50:54 | "AnonymousIoService-10" daemon prio=10 tid=0x00007f51f408a800 nid=0x2eac waiting on condition [0x00007f51f9df6000]
INFO   | jvm 1    | 2012/11/01 23:50:54 |    java.lang.Thread.State: WAITING (parking)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at sun.misc.Unsafe.park(Native Method)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       - parking to wait for  <0x000000058f4d4598> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.locks.LockSupport.park(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.LinkedBlockingQueue.take(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.ThreadPoolExecutor.getTask(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at org.apache.mina.util.NamePreservingRunnable.run(NamePreservingRunnable.java:51)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.lang.Thread.run(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |
INFO   | jvm 1    | 2012/11/01 23:50:54 | "AnonymousIoService-9" daemon prio=10 tid=0x00007f51f40dc000 nid=0x2e1a waiting on condition [0x00007f51f9ef7000]
INFO   | jvm 1    | 2012/11/01 23:50:54 |    java.lang.Thread.State: WAITING (parking)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at sun.misc.Unsafe.park(Native Method)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       - parking to wait for  <0x000000058f4d4598> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.locks.LockSupport.park(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.LinkedBlockingQueue.take(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.ThreadPoolExecutor.getTask(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at org.apache.mina.util.NamePreservingRunnable.run(NamePreservingRunnable.java:51)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.lang.Thread.run(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |
INFO   | jvm 1    | 2012/11/01 23:50:54 | "AnonymousIoService-8" daemon prio=10 tid=0x00007f51f40db000 nid=0x2e19 waiting on condition [0x00007f5200309000]
INFO   | jvm 1    | 2012/11/01 23:50:54 |    java.lang.Thread.State: WAITING (parking)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at sun.misc.Unsafe.park(Native Method)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       - parking to wait for  <0x000000058f4d4598> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.locks.LockSupport.park(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.LinkedBlockingQueue.take(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.ThreadPoolExecutor.getTask(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at org.apache.mina.util.NamePreservingRunnable.run(NamePreservingRunnable.java:51)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.lang.Thread.run(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |
INFO   | jvm 1    | 2012/11/01 23:50:54 | "pool-5-thread-1" prio=10 tid=0x00007f51f4292000 nid=0x2db4 waiting on condition [0x00007f51fa4cf000]
INFO   | jvm 1    | 2012/11/01 23:50:54 |    java.lang.Thread.State: TIMED_WAITING (sleeping)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.lang.Thread.sleep(Native Method)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at it.gotoandplay.smartfoxserver.util.scheduling.Scheduler.run(Scheduler.java:224)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.lang.Thread.run(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |
INFO   | jvm 1    | 2012/11/01 23:50:54 | "extensionReloader" prio=10 tid=0x00007f51f4233800 nid=0x2db3 waiting on condition [0x00007f51fa5d0000]
INFO   | jvm 1    | 2012/11/01 23:50:54 |    java.lang.Thread.State: TIMED_WAITING (sleeping)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.lang.Thread.sleep(Native Method)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at it.gotoandplay.smartfoxserver.lib.ExtensionAutoReloader.run(ExtensionAutoReloader.java:46)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.lang.Thread.run(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |
INFO   | jvm 1    | 2012/11/01 23:50:54 | "Timer-3" prio=10 tid=0x00007f51f423c800 nid=0x2db2 in Object.wait() [0x00007f51fa6d1000]
INFO   | jvm 1    | 2012/11/01 23:50:54 |    java.lang.Thread.State: TIMED_WAITING (on object monitor)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.lang.Object.wait(Native Method)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.TimerThread.mainLoop(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       - locked <0x000000058f8b4928> (a java.util.TaskQueue)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.TimerThread.run(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |
INFO   | jvm 1    | 2012/11/01 23:50:54 | "selector" prio=10 tid=0x00007f51f427d800 nid=0x2db1 waiting on condition [0x00007f51fa7d2000]
INFO   | jvm 1    | 2012/11/01 23:50:54 |    java.lang.Thread.State: TIMED_WAITING (sleeping)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.lang.Thread.sleep(Native Method)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at it.gotoandplay.smartfoxserver.EventReader.run(EventReader.java:37)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.lang.Thread.run(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |
INFO   | jvm 1    | 2012/11/01 23:50:54 | "TimerQueue" daemon prio=10 tid=0x0000000040cb6800 nid=0x2db0 in Object.wait() [0x00007f51fa8d3000]
INFO   | jvm 1    | 2012/11/01 23:50:54 |    java.lang.Thread.State: TIMED_WAITING (on object monitor)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.lang.Object.wait(Native Method)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at javax.swing.TimerQueue.run(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       - locked <0x000000058f8b19a0> (a javax.swing.TimerQueue)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.lang.Thread.run(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 | "AMQP Connection 208.95.105.197:5672" prio=10 tid=0x0000000040cb5800 nid=0x2daf runnable [0x00007f51fa9d4000]
INFO   | jvm 1    | 2012/11/01 23:50:54 |    java.lang.Thread.State: RUNNABLE
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.net.SocketInputStream.socketRead0(Native Method)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.net.SocketInputStream.read(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.io.BufferedInputStream.fill(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.io.BufferedInputStream.read(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       - locked <0x000000058f8b2b08> (a java.io.BufferedInputStream)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.io.DataInputStream.readUnsignedByte(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at com.rabbitmq.client.impl.Frame.readFrom(Frame.java:95)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at com.rabbitmq.client.impl.SocketFrameHandler.readFrame(SocketFrameHandler.java:131)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       - locked <0x000000058f8b2b30> (a java.io.DataInputStream)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at com.rabbitmq.client.impl.AMQConnection$MainLoop.run(AMQConnection.java:501)
INFO   | jvm 1    | 2012/11/01 23:50:54 |
INFO   | jvm 1    | 2012/11/01 23:50:54 | "AMQP Connection 208.95.105.197:5672" prio=10 tid=0x0000000040685000 nid=0x2dae runnable [0x00007f51faad5000]
INFO   | jvm 1    | 2012/11/01 23:50:54 |    java.lang.Thread.State: RUNNABLE
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.net.SocketInputStream.socketRead0(Native Method)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.net.SocketInputStream.read(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.io.BufferedInputStream.fill(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.io.BufferedInputStream.read(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       - locked <0x000000058f641020> (a java.io.BufferedInputStream)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.io.DataInputStream.readUnsignedByte(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at com.rabbitmq.client.impl.Frame.readFrom(Frame.java:95)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at com.rabbitmq.client.impl.SocketFrameHandler.readFrame(SocketFrameHandler.java:131)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       - locked <0x000000058f641000> (a java.io.DataInputStream)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at com.rabbitmq.client.impl.AMQConnection$MainLoop.run(AMQConnection.java:501)
INFO   | jvm 1    | 2012/11/01 23:50:54 |
INFO   | jvm 1    | 2012/11/01 23:50:54 | "com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#2" daemon prio=10 tid=0x0000000040c87000 nid=0x2dad in Object.wait() [0x00007f51fabd6000]
INFO   | jvm 1    | 2012/11/01 23:50:54 |    java.lang.Thread.State: TIMED_WAITING (on object monitor)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.lang.Object.wait(Native Method)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:534)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       - locked <0x000000058f5188a8> (a com.mchange.v2.async.ThreadPoolAsynchronousRunner)
INFO   | jvm 1    | 2012/11/01 23:50:54 |
INFO   | jvm 1    | 2012/11/01 23:50:54 | "com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#1" daemon prio=10 tid=0x0000000040c3d000 nid=0x2dac in Object.wait() [0x00007f51facd7000]
INFO   | jvm 1    | 2012/11/01 23:50:54 |    java.lang.Thread.State: TIMED_WAITING (on object monitor)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.lang.Object.wait(Native Method)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:534)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       - locked <0x000000058f5188a8> (a com.mchange.v2.async.ThreadPoolAsynchronousRunner)
INFO   | jvm 1    | 2012/11/01 23:50:54 |
INFO   | jvm 1    | 2012/11/01 23:50:54 | "com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#0" daemon prio=10 tid=0x0000000040872800 nid=0x2dab in Object.wait() [0x00007f51fadd8000]
INFO   | jvm 1    | 2012/11/01 23:50:54 |    java.lang.Thread.State: TIMED_WAITING (on object monitor)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.lang.Object.wait(Native Method)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread.run(ThreadPoolAsynchronousRunner.java:534)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       - locked <0x000000058f5188a8> (a com.mchange.v2.async.ThreadPoolAsynchronousRunner)
INFO   | jvm 1    | 2012/11/01 23:50:54 |
INFO   | jvm 1    | 2012/11/01 23:50:54 | "Timer-2" daemon prio=10 tid=0x0000000040d4f000 nid=0x2daa in Object.wait() [0x00007f51faed9000]
INFO   | jvm 1    | 2012/11/01 23:50:54 |    java.lang.Thread.State: TIMED_WAITING (on object monitor)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.lang.Object.wait(Native Method)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.TimerThread.mainLoop(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       - locked <0x000000058f519638> (a java.util.TaskQueue)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.TimerThread.run(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |
INFO   | jvm 1    | 2012/11/01 23:50:54 | "AnonymousIoService-7" daemon prio=10 tid=0x00007f51f427f800 nid=0x2da9 waiting on condition [0x00007f51fafda000]
INFO   | jvm 1    | 2012/11/01 23:50:54 |    java.lang.Thread.State: WAITING (parking)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at sun.misc.Unsafe.park(Native Method)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       - parking to wait for  <0x000000058f4d4598> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.locks.LockSupport.park(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.LinkedBlockingQueue.take(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.ThreadPoolExecutor.getTask(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at org.apache.mina.util.NamePreservingRunnable.run(NamePreservingRunnable.java:51)
INFO   | jvm 1    | 2012/11/01 23:50:54 |
INFO   | jvm 1    | 2012/11/01 23:50:54 | "AnonymousIoService-6" daemon prio=10 tid=0x00007f51f422b800 nid=0x2da8 waiting on condition [0x00007f51fb0db000]
INFO   | jvm 1    | 2012/11/01 23:50:54 |    java.lang.Thread.State: WAITING (parking)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at sun.misc.Unsafe.park(Native Method)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       - parking to wait for  <0x000000058f4d4598> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.locks.LockSupport.park(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.LinkedBlockingQueue.take(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.ThreadPoolExecutor.getTask(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at org.apache.mina.util.NamePreservingRunnable.run(NamePreservingRunnable.java:51)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.lang.Thread.run(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |
INFO   | jvm 1    | 2012/11/01 23:50:54 | "AnonymousIoService-5" daemon prio=10 tid=0x00007f51f4284800 nid=0x2da7 waiting on condition [0x00007f51fb1dc000]
INFO   | jvm 1    | 2012/11/01 23:50:54 |    java.lang.Thread.State: WAITING (parking)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at sun.misc.Unsafe.park(Native Method)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       - parking to wait for  <0x000000058f4d4598> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.locks.LockSupport.park(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.LinkedBlockingQueue.take(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.ThreadPoolExecutor.getTask(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at org.apache.mina.util.NamePreservingRunnable.run(NamePreservingRunnable.java:51)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.lang.Thread.run(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |
INFO   | jvm 1    | 2012/11/01 23:50:54 | "AnonymousIoService-4" daemon prio=10 tid=0x00007f51f419d800 nid=0x2da6 waiting on condition [0x00007f51fb2dd000]
INFO   | jvm 1    | 2012/11/01 23:50:54 |    java.lang.Thread.State: WAITING (parking)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at sun.misc.Unsafe.park(Native Method)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       - parking to wait for  <0x000000058f4d4598> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.locks.LockSupport.park(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.LinkedBlockingQueue.take(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.ThreadPoolExecutor.getTask(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at org.apache.mina.util.NamePreservingRunnable.run(NamePreservingRunnable.java:51)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.lang.Thread.run(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |
INFO   | jvm 1    | 2012/11/01 23:50:54 | "AnonymousIoService-3" daemon prio=10 tid=0x00007f51f41bb800 nid=0x2da5 waiting on condition [0x00007f51fb3de000]
INFO   | jvm 1    | 2012/11/01 23:50:54 |    java.lang.Thread.State: WAITING (parking)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at sun.misc.Unsafe.park(Native Method)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       - parking to wait for  <0x000000058f4d4598> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.locks.LockSupport.park(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.LinkedBlockingQueue.take(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.ThreadPoolExecutor.getTask(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at org.apache.mina.util.NamePreservingRunnable.run(NamePreservingRunnable.java:51)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.lang.Thread.run(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |
INFO   | jvm 1    | 2012/11/01 23:50:54 | "AnonymousIoService-2" daemon prio=10 tid=0x00007f51f41af800 nid=0x2da4 waiting on condition [0x00007f51fb4eb000]
INFO   | jvm 1    | 2012/11/01 23:50:54 |    java.lang.Thread.State: WAITING (parking)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at sun.misc.Unsafe.park(Native Method)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       - parking to wait for  <0x000000058f4d4598> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.locks.LockSupport.park(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.LinkedBlockingQueue.take(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.ThreadPoolExecutor.getTask(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at org.apache.mina.util.NamePreservingRunnable.run(NamePreservingRunnable.java:51)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.lang.Thread.run(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |
INFO   | jvm 1    | 2012/11/01 23:50:54 | "AnonymousIoService-1" daemon prio=10 tid=0x00007f51f41ae800 nid=0x2da3 waiting on condition [0x00007f51fb5ec000]
INFO   | jvm 1    | 2012/11/01 23:50:54 |    java.lang.Thread.State: WAITING (parking)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at sun.misc.Unsafe.park(Native Method)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       - parking to wait for  <0x000000058f4d4598> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.locks.LockSupport.park(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.LinkedBlockingQueue.take(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.ThreadPoolExecutor.getTask(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at org.apache.mina.util.NamePreservingRunnable.run(NamePreservingRunnable.java:51)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.lang.Thread.run(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |
INFO   | jvm 1    | 2012/11/01 23:50:54 | "SocketConnectorIoProcessor-0.0" prio=10 tid=0x000000004085f800 nid=0x2da2 runnable [0x00007f51fb6ed000]
INFO   | jvm 1    | 2012/11/01 23:50:54 |    java.lang.Thread.State: RUNNABLE
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at sun.nio.ch.EPollArrayWrapper.poll(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at sun.nio.ch.EPollSelectorImpl.doSelect(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at sun.nio.ch.SelectorImpl.lockAndDoSelect(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       - locked <0x000000058f4edec8> (a sun.nio.ch.Util$2)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       - locked <0x000000058f4edeb8> (a java.util.Collections$UnmodifiableSet)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       - locked <0x000000058f4ed9a8> (a sun.nio.ch.EPollSelectorImpl)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at sun.nio.ch.SelectorImpl.select(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at org.apache.mina.transport.socket.nio.SocketIoProcessor$Worker.run(SocketIoProcessor.java:480)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at org.apache.mina.util.NamePreservingRunnable.run(NamePreservingRunnable.java:51)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.lang.Thread.run(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |
INFO   | jvm 1    | 2012/11/01 23:50:54 | "Timer-1" daemon prio=10 tid=0x00007f51f41ad800 nid=0x2da0 in Object.wait() [0x00007f51fb7ee000]
INFO   | jvm 1    | 2012/11/01 23:50:54 |    java.lang.Thread.State: TIMED_WAITING (on object monitor)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.lang.Object.wait(Native Method)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.TimerThread.mainLoop(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       - locked <0x000000058f4d3b98> (a java.util.TaskQueue)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.TimerThread.run(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |
INFO   | jvm 1    | 2012/11/01 23:50:54 | "Timer-0" prio=10 tid=0x00007f51f4192800 nid=0x2d9f in Object.wait() [0x00007f51fb8ef000]
INFO   | jvm 1    | 2012/11/01 23:50:54 |    java.lang.Thread.State: TIMED_WAITING (on object monitor)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.lang.Object.wait(Native Method)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.TimerThread.mainLoop(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       - locked <0x000000058f2bad48> (a java.util.TaskQueue)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.util.TimerThread.run(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |
INFO   | jvm 1    | 2012/11/01 23:50:54 | "ExtensionHandler-4" daemon prio=10 tid=0x00007f51f400a800 nid=0x2d9e in Object.wait() [0x00007f51fb9f0000]
INFO   | jvm 1    | 2012/11/01 23:50:54 |    java.lang.Thread.State: WAITING (on object monitor)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.lang.Object.wait(Native Method)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.lang.Object.wait(Object.java:485)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at it.gotoandplay.smartfoxserver.lib.EventQueue.deQueue(EventQueue.java:64)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       - locked <0x000000058f2bb100> (a it.gotoandplay.smartfoxserver.lib.EventQueue)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at it.gotoandplay.smartfoxserver.controllers.ExtensionHandler.run(ExtensionHandler.java:342)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.lang.Thread.run(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |
INFO   | jvm 1    | 2012/11/01 23:50:54 | "ExtensionHandler-3" daemon prio=10 tid=0x00007f51f419c800 nid=0x2d9d in Object.wait() [0x00007f51fbaf1000]
INFO   | jvm 1    | 2012/11/01 23:50:54 |    java.lang.Thread.State: WAITING (on object monitor)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.lang.Object.wait(Native Method)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.lang.Object.wait(Object.java:485)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at it.gotoandplay.smartfoxserver.lib.EventQueue.deQueue(EventQueue.java:64)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       - locked <0x000000058f2bb100> (a it.gotoandplay.smartfoxserver.lib.EventQueue)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at it.gotoandplay.smartfoxserver.controllers.ExtensionHandler.run(ExtensionHandler.java:342)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.lang.Thread.run(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |
INFO   | jvm 1    | 2012/11/01 23:50:54 | "ExtensionHandler-2" daemon prio=10 tid=0x00007f51f419f800 nid=0x2d9c in Object.wait() [0x00007f51fbbf2000]
INFO   | jvm 1    | 2012/11/01 23:50:54 |    java.lang.Thread.State: WAITING (on object monitor)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.lang.Object.wait(Native Method)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.lang.Object.wait(Object.java:485)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at it.gotoandplay.smartfoxserver.lib.EventQueue.deQueue(EventQueue.java:64)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       - locked <0x000000058f2bb100> (a it.gotoandplay.smartfoxserver.lib.EventQueue)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at it.gotoandplay.smartfoxserver.controllers.ExtensionHandler.run(ExtensionHandler.java:342)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.lang.Thread.run(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |
INFO   | jvm 1    | 2012/11/01 23:50:54 | "ExtensionHandler-1" daemon prio=10 tid=0x00007f51f4191800 nid=0x2d9b in Object.wait() [0x00007f520040a000]
INFO   | jvm 1    | 2012/11/01 23:50:54 |    java.lang.Thread.State: WAITING (on object monitor)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.lang.Object.wait(Native Method)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.lang.Object.wait(Object.java:485)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at it.gotoandplay.smartfoxserver.lib.EventQueue.deQueue(EventQueue.java:64)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       - locked <0x000000058f2bb100> (a it.gotoandplay.smartfoxserver.lib.EventQueue)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at it.gotoandplay.smartfoxserver.controllers.ExtensionHandler.run(ExtensionHandler.java:342)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.lang.Thread.run(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |
INFO   | jvm 1    | 2012/11/01 23:50:54 | "BlueBoxHandler-1" daemon prio=10 tid=0x00007f51f419b800 nid=0x2d9a in Object.wait() [0x00007f51fbcf3000]
INFO   | jvm 1    | 2012/11/01 23:50:54 |    java.lang.Thread.State: WAITING (on object monitor)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.lang.Object.wait(Native Method)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       - waiting on <0x000000058f321ae8> (a it.gotoandplay.smartfoxserver.lib.EventQueue)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.lang.Object.wait(Object.java:485)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at it.gotoandplay.smartfoxserver.lib.EventQueue.deQueue(EventQueue.java:64)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       - locked <0x000000058f321ae8> (a it.gotoandplay.smartfoxserver.lib.EventQueue)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at it.gotoandplay.smartfoxserver.controllers.BlueBoxHandler.run(BlueBoxHandler.java:42)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.lang.Thread.run(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |
INFO   | jvm 1    | 2012/11/01 23:50:54 | "EventWriter-2" daemon prio=10 tid=0x00007f51f4190800 nid=0x2d98 in Object.wait() [0x00007f51fbef5000]
INFO   | jvm 1    | 2012/11/01 23:50:54 |    java.lang.Thread.State: WAITING (on object monitor)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.lang.Object.wait(Native Method)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.lang.Object.wait(Object.java:485)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at it.gotoandplay.smartfoxserver.lib.ChannelQueue.deQueue(ChannelQueue.java:51)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       - locked <0x000000058f2bb588> (a it.gotoandplay.smartfoxserver.lib.ChannelQueue)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at it.gotoandplay.smartfoxserver.EventWriter.run(EventWriter.java:73)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.lang.Thread.run(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |
INFO   | jvm 1    | 2012/11/01 23:50:54 | "EventWriter-1" daemon prio=10 tid=0x00007f51f4199000 nid=0x2d97 in Object.wait() [0x00007f51fbff6000]
INFO   | jvm 1    | 2012/11/01 23:50:54 |    java.lang.Thread.State: WAITING (on object monitor)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.lang.Object.wait(Native Method)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.lang.Object.wait(Object.java:485)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at it.gotoandplay.smartfoxserver.lib.ChannelQueue.deQueue(ChannelQueue.java:51)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       - locked <0x000000058f2bb588> (a it.gotoandplay.smartfoxserver.lib.ChannelQueue)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at it.gotoandplay.smartfoxserver.EventWriter.run(EventWriter.java:73)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.lang.Thread.run(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |
INFO   | jvm 1    | 2012/11/01 23:50:54 | "H2 TCP Server (tcp://localhost:9009)" prio=10 tid=0x00007f51f4186000 nid=0x2d95 runnable [0x00007f520050b000]
INFO   | jvm 1    | 2012/11/01 23:50:54 |    java.lang.Thread.State: RUNNABLE
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.net.PlainSocketImpl.socketAccept(Native Method)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.net.PlainSocketImpl.accept(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       - locked <0x000000058f29de60> (a java.net.SocksSocketImpl)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.net.ServerSocket.implAccept(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.net.ServerSocket.accept(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at org.h2.server.TcpServer.listen(TcpServer.java:135)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at org.h2.tools.Server.run(Server.java:443)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.lang.Thread.run(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |
INFO   | jvm 1    | 2012/11/01 23:50:54 | "Abandoned connection cleanup thread" daemon prio=10 tid=0x00007f51f4182800 nid=0x2d93 in Object.wait() [0x00007f520070d000]
INFO   | jvm 1    | 2012/11/01 23:50:54 |    java.lang.Thread.State: WAITING (on object monitor)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.lang.Object.wait(Native Method)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       - waiting on <0x000000058f2b1c18> (a java.lang.ref.ReferenceQueue$Lock)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.lang.ref.ReferenceQueue.remove(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       - locked <0x000000058f2b1c18> (a java.lang.ref.ReferenceQueue$Lock)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.lang.ref.ReferenceQueue.remove(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at com.mysql.jdbc.NonRegisteringDriver$1.run(NonRegisteringDriver.java:93)
INFO   | jvm 1    | 2012/11/01 23:50:54 |
INFO   | jvm 1    | 2012/11/01 23:50:54 | "SmartFoxServer" prio=10 tid=0x00007f51f4185000 nid=0x2d92 runnable [0x00007f5200208000]
INFO   | jvm 1    | 2012/11/01 23:50:54 |    java.lang.Thread.State: RUNNABLE
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at sun.nio.ch.EPollArrayWrapper.poll(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at sun.nio.ch.EPollSelectorImpl.doSelect(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at sun.nio.ch.SelectorImpl.lockAndDoSelect(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       - locked <0x000000058f8b6608> (a sun.nio.ch.Util$2)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       - locked <0x000000058f8b6618> (a java.util.Collections$UnmodifiableSet)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       - locked <0x000000058f8b65c0> (a sun.nio.ch.EPollSelectorImpl)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at sun.nio.ch.SelectorImpl.select(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at sun.nio.ch.SelectorImpl.select(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at it.gotoandplay.smartfoxserver.SmartFoxServer.acceptNewConnections(SmartFoxServer.java:702)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at it.gotoandplay.smartfoxserver.SmartFoxServer.run(SmartFoxServer.java:651)
INFO   | jvm 1    | 2012/11/01 23:50:54 |
INFO   | jvm 1    | 2012/11/01 23:50:54 | "DestroyJavaVM" prio=10 tid=0x00000000402af800 nid=0x2d7c waiting on condition [0x0000000000000000]
INFO   | jvm 1    | 2012/11/01 23:50:54 |    java.lang.Thread.State: RUNNABLE
INFO   | jvm 1    | 2012/11/01 23:50:54 |
INFO   | jvm 1    | 2012/11/01 23:50:54 | "Wrapper-Connection" daemon prio=10 tid=0x0000000040556000 nid=0x2d8e runnable [0x00007f520060c000]
INFO   | jvm 1    | 2012/11/01 23:50:54 |    java.lang.Thread.State: RUNNABLE
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.net.SocketInputStream.socketRead0(Native Method)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.net.SocketInputStream.read(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.net.SocketInputStream.read(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.io.DataInputStream.readByte(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at org.tanukisoftware.wrapper.WrapperManager.handleBackend(WrapperManager.java:5128)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at org.tanukisoftware.wrapper.WrapperManager.run(WrapperManager.java:5469)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.lang.Thread.run(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |
INFO   | jvm 1    | 2012/11/01 23:50:54 | "Wrapper-Control-Event-Monitor" daemon prio=10 tid=0x00000000403d1000 nid=0x2d8c waiting on condition [0x00007f520080e000]
INFO   | jvm 1    | 2012/11/01 23:50:54 |    java.lang.Thread.State: TIMED_WAITING (sleeping)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.lang.Thread.sleep(Native Method)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at org.tanukisoftware.wrapper.WrapperManager$3.run(WrapperManager.java:962)
INFO   | jvm 1    | 2012/11/01 23:50:54 |
INFO   | jvm 1    | 2012/11/01 23:50:54 | "RMI TCP Accept-0" daemon prio=10 tid=0x00007f51fc391800 nid=0x2d8a runnable [0x00007f5200d30000]
INFO   | jvm 1    | 2012/11/01 23:50:54 |    java.lang.Thread.State: RUNNABLE
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.net.PlainSocketImpl.socketAccept(Native Method)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.net.PlainSocketImpl.accept(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       - locked <0x000000058f1ca2e0> (a java.net.SocksSocketImpl)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.net.ServerSocket.implAccept(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.net.ServerSocket.accept(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at sun.management.jmxremote.LocalRMIServerSocketFactory$1.accept(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.lang.Thread.run(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |
INFO   | jvm 1    | 2012/11/01 23:50:54 | "RMI TCP Accept-9999" daemon prio=10 tid=0x00007f51fc38b800 nid=0x2d89 runnable [0x00007f5200e31000]
INFO   | jvm 1    | 2012/11/01 23:50:54 |    java.lang.Thread.State: RUNNABLE
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.net.PlainSocketImpl.socketAccept(Native Method)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.net.PlainSocketImpl.accept(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       - locked <0x000000058f1ca0e8> (a java.net.SocksSocketImpl)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.net.ServerSocket.implAccept(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.net.ServerSocket.accept(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.lang.Thread.run(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |
INFO   | jvm 1    | 2012/11/01 23:50:54 | "RMI TCP Accept-0" daemon prio=10 tid=0x00007f51fc37b000 nid=0x2d88 runnable [0x00007f5200f32000]
INFO   | jvm 1    | 2012/11/01 23:50:54 |    java.lang.Thread.State: RUNNABLE
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.net.PlainSocketImpl.socketAccept(Native Method)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.net.PlainSocketImpl.accept(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       - locked <0x000000058f1c9ed0> (a java.net.SocksSocketImpl)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.net.ServerSocket.implAccept(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.net.ServerSocket.accept(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.lang.Thread.run(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |
INFO   | jvm 1    | 2012/11/01 23:50:54 | "Low Memory Detector" daemon prio=10 tid=0x00007f51fc070800 nid=0x2d87 runnable [0x0000000000000000]
INFO   | jvm 1    | 2012/11/01 23:50:54 |    java.lang.Thread.State: RUNNABLE
INFO   | jvm 1    | 2012/11/01 23:50:54 |
INFO   | jvm 1    | 2012/11/01 23:50:54 | "C2 CompilerThread1" daemon prio=10 tid=0x00007f51fc06e000 nid=0x2d86 waiting on condition [0x0000000000000000]
INFO   | jvm 1    | 2012/11/01 23:50:54 |    java.lang.Thread.State: RUNNABLE
INFO   | jvm 1    | 2012/11/01 23:50:54 |
INFO   | jvm 1    | 2012/11/01 23:50:54 | "C2 CompilerThread0" daemon prio=10 tid=0x00007f51fc06b000 nid=0x2d85 waiting on condition [0x0000000000000000]
INFO   | jvm 1    | 2012/11/01 23:50:54 |    java.lang.Thread.State: RUNNABLE
INFO   | jvm 1    | 2012/11/01 23:50:54 |
INFO   | jvm 1    | 2012/11/01 23:50:54 | "Signal Dispatcher" daemon prio=10 tid=0x00007f51fc069000 nid=0x2d84 waiting on condition [0x0000000000000000]
INFO   | jvm 1    | 2012/11/01 23:50:54 |    java.lang.Thread.State: RUNNABLE
INFO   | jvm 1    | 2012/11/01 23:50:54 |
INFO   | jvm 1    | 2012/11/01 23:50:54 | "Finalizer" daemon prio=10 tid=0x00007f51fc04c800 nid=0x2d83 in Object.wait() [0x00007f52018c2000]
INFO   | jvm 1    | 2012/11/01 23:50:54 |    java.lang.Thread.State: WAITING (on object monitor)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.lang.Object.wait(Native Method)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.lang.ref.ReferenceQueue.remove(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       - locked <0x000000058f1c2658> (a java.lang.ref.ReferenceQueue$Lock)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.lang.ref.ReferenceQueue.remove(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.lang.ref.Finalizer$FinalizerThread.run(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |
INFO   | jvm 1    | 2012/11/01 23:50:54 | "Reference Handler" daemon prio=10 tid=0x00007f51fc04a800 nid=0x2d82 in Object.wait() [0x00007f52019c3000]
INFO   | jvm 1    | 2012/11/01 23:50:54 |    java.lang.Thread.State: WAITING (on object monitor)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.lang.Object.wait(Native Method)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.lang.Object.wait(Object.java:485)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       at java.lang.ref.Reference$ReferenceHandler.run(Unknown Source)
INFO   | jvm 1    | 2012/11/01 23:50:54 |       - locked <0x000000058f1c2618> (a java.lang.ref.Reference$Lock)
INFO   | jvm 1    | 2012/11/01 23:50:54 |
INFO   | jvm 1    | 2012/11/01 23:50:54 | "VM Thread" prio=10 tid=0x00007f51fc044000 nid=0x2d81 runnable
INFO   | jvm 1    | 2012/11/01 23:50:54 |
INFO   | jvm 1    | 2012/11/01 23:50:54 | "GC task thread#0 (ParallelGC)" prio=10 tid=0x00000000402c2800 nid=0x2d7d runnable
INFO   | jvm 1    | 2012/11/01 23:50:54 |
INFO   | jvm 1    | 2012/11/01 23:50:54 | "GC task thread#1 (ParallelGC)" prio=10 tid=0x00000000402c4800 nid=0x2d7e runnable
INFO   | jvm 1    | 2012/11/01 23:50:54 |
INFO   | jvm 1    | 2012/11/01 23:50:54 | "GC task thread#2 (ParallelGC)" prio=10 tid=0x00000000402c6800 nid=0x2d7f runnable
INFO   | jvm 1    | 2012/11/01 23:50:54 |
INFO   | jvm 1    | 2012/11/01 23:50:54 | "GC task thread#3 (ParallelGC)" prio=10 tid=0x00000000402c8000 nid=0x2d80 runnable
INFO   | jvm 1    | 2012/11/01 23:50:54 |
INFO   | jvm 1    | 2012/11/01 23:50:54 | "VM Periodic Task Thread" prio=10 tid=0x00007f51fc394000 nid=0x2d8b waiting on condition
INFO   | jvm 1    | 2012/11/01 23:50:54 |
INFO   | jvm 1    | 2012/11/01 23:50:54 | JNI global references: 1668
INFO   | jvm 1    | 2012/11/01 23:50:54 |
INFO   | jvm 1    | 2012/11/01 23:50:54 | Heap
INFO   | jvm 1    | 2012/11/01 23:50:54 |  PSYoungGen      total 20480K, used 5209K [0x000000072fab0000, 0x0000000731000000, 0x0000000800000000)
INFO   | jvm 1    | 2012/11/01 23:50:54 |   eden space 19136K, 23% used [0x000000072fab0000,0x000000072ff0e528,0x0000000730d60000)
INFO   | jvm 1    | 2012/11/01 23:50:54 |   from space 1344K, 54% used [0x0000000730eb0000,0x0000000730f68200,0x0000000731000000)
INFO   | jvm 1    | 2012/11/01 23:50:54 |   to   space 1344K, 0% used [0x0000000730d60000,0x0000000730d60000,0x0000000730eb0000)
INFO   | jvm 1    | 2012/11/01 23:50:54 |  PSOldGen        total 43712K, used 14578K [0x000000058f000000, 0x0000000591ab0000, 0x000000072fab0000)
INFO   | jvm 1    | 2012/11/01 23:50:54 |   object space 43712K, 33% used [0x000000058f000000,0x000000058fe3c960,0x0000000591ab0000)
INFO   | jvm 1    | 2012/11/01 23:50:54 |  PSPermGen       total 34432K, used 32555K [0x000000056f000000, 0x00000005711a0000, 0x000000058f000000)
INFO   | jvm 1    | 2012/11/01 23:50:54 |   object space 34432K, 94% used [0x000000056f000000,0x0000000570fcad70,0x00000005711a0000)
INFO   | jvm 1    | 2012/11/01 23:50:54 |

[Lapo]

Sorry I am not sure to understand what is going on here. In particular we don't use Apache MINA in SmartFoxServer.
Can you please provide more details as regards what you are doing? Did you integrate MINA on the server side to talk to other servers?

Thanks

[aakture]

Thanks for your reply. I don't think we have any MINA dependency added with our deployment, but I will continue to confirm. I did see when I grep for mina in the server directory, it appears in certain places related to red box:

Code: Select all

Alpers-MacBook-Pro:SmartFoxServer PRO 1.6.6 aakture$ grep -r -i "\.mina\." ./
Binary file ./Server/lib/cachedir/packages/lsc$1.pkc matches
Binary file ./Server/lib/cachedir/packages/lsc$2.pkc matches
Binary file ./Server/lib/cachedir/packages/lsc$3.pkc matches
Binary file ./Server/lib/cachedir/packages/lsc.pkc matches
Binary file ./Server/lib/pycore/lsc$py.class matches
./Server/RedBox/build.xml:					<available property="mina.installed" classpathref="project.classpath" classname="org.apache.mina.filter.codec.ProtocolEncoder"/>
./Server/RedBox/build.xml:					<available property="minajmx.installed" classpathref="project.classpath" classname="org.apache.mina.integration.jmx.IoServiceManager"/>
./Server/RedBox/build.xml:					<available property="mina.installed" classpathref="project.classpath" classname="org.apache.mina.filter.codec.ProtocolEncoder"/>
./Server/RedBox/build.xml:					<available property="minajmx.installed" classpathref="project.classpath" classname="org.apache.mina.integration.jmx.IoServiceManager"/>
./Server/RedBox/conf/jboss/red5-core.xml:						class="org.apache.mina.integration.spring.InetSocketAddressEditor" />
./Server/RedBox/conf/log4j.properties:log4j.logger.org.apache.mina.filter=WARN
./Server/RedBox/conf/log4j.properties:log4j.logger.org.apache.mina.filter.thread.ThreadPoolFilter=WARN
./Server/RedBox/conf/red5-core.xml:						class="org.apache.mina.integration.spring.InetSocketAddressEditor" />
./Server/RedBox/conf/war/log4j.properties:log4j.logger.org.apache.mina.filter.thread.ThreadPoolFilter=WARN
./Server/RedBox/conf/war/red5-core.xml:						class="org.apache.mina.integration.spring.InetSocketAddressEditor" />
Alpers-MacBook-Pro:SmartFoxServer PRO 1.6.6 aakture$ 

The problem I was experiencing, was that clients were timing out when trying to connect to the smartfox server. My test clients send a connection request and time out waiting for a response. So I did a thread dump on the smartfox server to see if I could determine the cause. This was when I discovered the MINA threads. I assumed (I guess incorrectly) they were started from the smartfox code.

[Lapo]

Hi,
there is no relation with clients not being able to connect and Apache MINA threads.
You should monitor the Server queues to see if maybe too many requests are piling up causing a slow down in the system. Do you use a server side login in your test?

Thanks
p.s. = the latest SFS PRO version is 1.6.9, I would suggest to get the latest update.

[aakture]

Ok, thanks, if it happens again, I'll check the queues. This is happening before I do a login. It happens during the connection, I call connect on the smartfox client, and await the SFSEvent.onConnection event, and it seems it didn't ever come. It's only happend one time that i know of during testing, which is when I took the tread dump. We are also using the 1.6.9 version currently.