[openjms-developer] OpenJMS crashing! Help!

Discussion:

Thomas, Ivy

2003-07-25 20:13:29 UTC

Hello
I am running the server in non persistent, tcp mode.

Here is what I see when I have around 50 publishers and subscribers to
same/multiple topics.
Can someone tell me if there is a configuration piece I missed and why this
is happenning? This is not like the server is running for days.. it
happenned in just an hour of all the publishers/subscribers coming in.

15:26:18.968 ERROR [Scheduler-Worker-2] - javax.jms.JMSException: Could not
get message for handle Handle : 4:1059159614031:3267
:ID:6202634392488269420
javax.jms.JMSException: Could not get message for handle Handle :
4:1059159614031:3267:ID:6202634392488269420
at org.exolab.jms.server.JmsServerSession.onMessage(Unknown Source)
at org.exolab.jms.messagemgr.TopicConsumerEndpoint.run(Unknown
Source)
at
org.exolab.core.threadPool.ThreadPoolWorker.runIt(ThreadPoolWorker.java:186)
at
org.exolab.core.threadPool.ThreadPoolWorker.runWork(ThreadPoolWorker.java:17
3)
at
org.exolab.core.threadPool.ThreadPoolWorker.access$000(ThreadPoolWorker.java
:67)
at
org.exolab.core.threadPool.ThreadPoolWorker$1.run(ThreadPoolWorker.java:117)
at java.lang.Thread.run(Thread.java:536)

after a period of time I start seeing this:

java.lang.OutOfMemoryError
java.lang.OutOfMemoryError
java.lang.OutOfMemoryError15:52:34.031 INFO [EventManager-Worker-3] -
Failed to verify that session 976118066399111786 is active.

Thanks
Ivy

Tim Anderson

2003-07-26 07:01:37 UTC

Permalink

You're running openjms 0.7.5?

NON_PERSISTENT messaging can cause the server to run out of memory
if:
. you are publishing a lot of messages in short period of time
. subscribers aren't consuming messages as fast as they are being
produced

To start with, you could try to increase the available memory
to the server:

E.g, to increase the memory on Windows, edit or create the
$OPENJMS_HOME/bin/setenv.bat
batch file and, and add:

rem Set the max memory to 256 MB
set JAVA_OPTS=-Xmx256M

Next, try playing round with the <MessageManagerConfiguration/> and
<GarbageCollectionConfiguration/> configuration elements.
See:
http://openjms.sourceforge.net/config/reference.html#MessageManagerConfigura
tion and
http://openjms.sourceforge.net/config/reference.html#GarbageCollectionConfig
uration

Regards,

Tim

-----Original Message-----
Thomas, Ivy
Sent: Saturday, 26 July 2003 6:13 AM
Subject: [openjms-developer] OpenJMS crashing! Help!
Hello
I am running the server in non persistent, tcp mode.
Here is what I see when I have around 50 publishers and subscribers to
same/multiple topics.
Can someone tell me if there is a configuration piece I missed
and why this
is happenning? This is not like the server is running for days.. it
happenned in just an hour of all the publishers/subscribers coming in.
Could not
get message for handle Handle : 4:1059159614031:3267
:ID:6202634392488269420
4:1059159614031:3267:ID:6202634392488269420
at
org.exolab.jms.server.JmsServerSession.onMessage(Unknown Source)
at org.exolab.jms.messagemgr.TopicConsumerEndpoint.run(Unknown
Source)
at
org.exolab.core.threadPool.ThreadPoolWorker.runIt(ThreadPoolWorker
.java:186)
at
org.exolab.core.threadPool.ThreadPoolWorker.runWork(ThreadPoolWork
er.java:17
3)
at
org.exolab.core.threadPool.ThreadPoolWorker.access$000(ThreadPoolW
orker.java
:67)
at
org.exolab.core.threadPool.ThreadPoolWorker$1.run(ThreadPoolWorker
.java:117)
at java.lang.Thread.run(Thread.java:536)
java.lang.OutOfMemoryError
java.lang.OutOfMemoryError
java.lang.OutOfMemoryError15:52:34.031 INFO [EventManager-Worker-3] -
Failed to verify that session 976118066399111786 is active.
Thanks
Ivy
-------------------------------------------------------
This SF.Net email sponsored by: Free pre-built ASP.NET sites including
Data Reports, E-commerce, Portals, and Forums are available now.
Download today and enter to win an XBOX or Visual Studio .NET.
http://aspnet.click-url.com/go/psa00100003ave/direct;at.aspnet_072
303_01/01
_______________________________________________
openjms-developer mailing list
https://lists.sourceforge.net/lists/listinfo/openjms-developer

Thomas, Ivy

2003-07-28 19:24:29 UTC

Permalink

I tried all kinds of combination: Here are the current configs that I am
working with. I have around 100 publishers publishing to the same topic at a
frequency of 8 secs. The subscribers may not be as many as publishers.

OPENJMS 0.7.5 - mode tcp - persistent

set JAVA_OPTS=-Xmx512M
destinationcachesize - 20000
maxthreads - 500
memorycheckinterval - 60
lowwaterthreshold - 35
garbagecollectionthreadpriority - 2
Still complains about the memory:(

Am running out of options to try and am considering changing the
destinationcachesize to 2000000.
Another note: Am creating the topic dynamically. Since I am having trouble
doing lookup on topic name, am assuming that on creating an existing topic,
it will return me a reference to the already created topic. Am I correct.

Appreciate your help!
Thanks
Ivy

-----Original Message-----
From: Thomas, Ivy [mailto:***@3eti.com]
Sent: Friday, July 25, 2003 4:13 PM
To: 'openjms-***@lists.sourceforge.net'
Subject: [openjms-developer] OpenJMS crashing! Help!

Hello
I am running the server in non persistent, tcp mode.

Here is what I see when I have around 50 publishers and subscribers to
same/multiple topics.
Can someone tell me if there is a configuration piece I missed and why this
is happenning? This is not like the server is running for days.. it
happenned in just an hour of all the publishers/subscribers coming in.

15:26:18.968 ERROR [Scheduler-Worker-2] - javax.jms.JMSException: Could not
get message for handle Handle : 4:1059159614031:3267
:ID:6202634392488269420
javax.jms.JMSException: Could not get message for handle Handle :
4:1059159614031:3267:ID:6202634392488269420
at org.exolab.jms.server.JmsServerSession.onMessage(Unknown Source)
at org.exolab.jms.messagemgr.TopicConsumerEndpoint.run(Unknown
Source)
at
org.exolab.core.threadPool.ThreadPoolWorker.runIt(ThreadPoolWorker.java:186)
at
org.exolab.core.threadPool.ThreadPoolWorker.runWork(ThreadPoolWorker.java:17
3)
at
org.exolab.core.threadPool.ThreadPoolWorker.access$000(ThreadPoolWorker.java
:67)
at
org.exolab.core.threadPool.ThreadPoolWorker$1.run(ThreadPoolWorker.java:117)
at java.lang.Thread.run(Thread.java:536)

after a period of time I start seeing this:

java.lang.OutOfMemoryError
java.lang.OutOfMemoryError
java.lang.OutOfMemoryError15:52:34.031 INFO [EventManager-Worker-3] -
Failed to verify that session 976118066399111786 is active.

Thanks
Ivy

-------------------------------------------------------
This SF.Net email sponsored by: Free pre-built ASP.NET sites including
Data Reports, E-commerce, Portals, and Forums are available now.
Download today and enter to win an XBOX or Visual Studio .NET.
http://aspnet.click-url.com/go/psa00100003ave/direct;at.aspnet_072303_01/01

Tim Anderson

2003-07-29 02:39:35 UTC

Permalink

Are you publishing to an administered destination
(one you look up from JNDI)?
In your initial post you mention you are using NON_PERSISTENT
delivery mode, but the latter one mentions 'persistent'. Which is it?

Looking at your parameters, try reducing the destination cache size,
maxthreads are memorycheckinterval.

-----Original Message-----
Thomas, Ivy
Sent: Tuesday, 29 July 2003 5:24 AM
Subject: RE: [openjms-developer] OpenJMS crashing! Help!
I tried all kinds of combination: Here are the current configs that I am
working with. I have around 100 publishers publishing to the same
topic at a
frequency of 8 secs. The subscribers may not be as many as publishers.
OPENJMS 0.7.5 - mode tcp - persistent
set JAVA_OPTS=-Xmx512M
destinationcachesize - 20000
maxthreads - 500
memorycheckinterval - 60
lowwaterthreshold - 35
garbagecollectionthreadpriority - 2
Still complains about the memory:(
Am running out of options to try and am considering changing the
destinationcachesize to 2000000.
Another note: Am creating the topic dynamically. Since I am having trouble
doing lookup on topic name, am assuming that on creating an
existing topic,
it will return me a reference to the already created topic. Am I correct.
Appreciate your help!
Thanks
Ivy
-----Original Message-----
Sent: Friday, July 25, 2003 4:13 PM
Subject: [openjms-developer] OpenJMS crashing! Help!
Hello
I am running the server in non persistent, tcp mode.
Here is what I see when I have around 50 publishers and subscribers to
same/multiple topics.
Can someone tell me if there is a configuration piece I missed
and why this
is happenning? This is not like the server is running for days.. it
happenned in just an hour of all the publishers/subscribers coming in.
Could not
get message for handle Handle : 4:1059159614031:3267
:ID:6202634392488269420
4:1059159614031:3267:ID:6202634392488269420
at
org.exolab.jms.server.JmsServerSession.onMessage(Unknown Source)
at org.exolab.jms.messagemgr.TopicConsumerEndpoint.run(Unknown
Source)
at
org.exolab.core.threadPool.ThreadPoolWorker.runIt(ThreadPoolWorker
.java:186)
at
org.exolab.core.threadPool.ThreadPoolWorker.runWork(ThreadPoolWork
er.java:17
3)
at
org.exolab.core.threadPool.ThreadPoolWorker.access$000(ThreadPoolW
orker.java
:67)
at
org.exolab.core.threadPool.ThreadPoolWorker$1.run(ThreadPoolWorker
.java:117)
at java.lang.Thread.run(Thread.java:536)
java.lang.OutOfMemoryError
java.lang.OutOfMemoryError
java.lang.OutOfMemoryError15:52:34.031 INFO [EventManager-Worker-3] -
Failed to verify that session 976118066399111786 is active.
Thanks
Ivy
-------------------------------------------------------
This SF.Net email sponsored by: Free pre-built ASP.NET sites including
Data Reports, E-commerce, Portals, and Forums are available now.
Download today and enter to win an XBOX or Visual Studio .NET.
http://aspnet.click-url.com/go/psa00100003ave/direct;at.aspnet_072
303_01/01
_______________________________________________
openjms-developer mailing list
https://lists.sourceforge.net/lists/listinfo/openjms-developer
-------------------------------------------------------
This SF.Net email sponsored by: Free pre-built ASP.NET sites including
Data Reports, E-commerce, Portals, and Forums are available now.
Download today and enter to win an XBOX or Visual Studio .NET.
http://aspnet.click-url.com/go/psa00100003ave/direct;at.aspnet_072
303_01/01
_______________________________________________
openjms-developer mailing list
https://lists.sourceforge.net/lists/listinfo/openjms-developer

Thomas, Ivy

2003-07-29 18:34:56 UTC

Permalink

I was initially using non persistent delivery mode and then I moved to
persistent. Now am back on non persistent delivery mode. Thanks for the
suggestions. I am not sure if the memory problem has gone away cause I am
having same old problems now .. And it lands up not delivering messages and
fills the log file with this error message.. .This is the same message I was
seeing initially.
14:22:56.281 ERROR [Scheduler-Worker-141] - javax.jms.JMSException: Could
not ge
t message for handle Handle : 4:1059498331515:16666:ID:2513998605325599726
javax.jms.JMSException: Could not get message for handle Handle :
4:105949833151
5:16666:ID:2513998605325599726
at org.exolab.jms.server.JmsServerSession.onMessage(Unknown Source)
at org.exolab.jms.messagemgr.TopicConsumerEndpoint.run(Unknown
Source)
at
org.exolab.core.threadPool.ThreadPoolWorker.runIt(ThreadPoolWorker.ja
va:186)
at
org.exolab.core.threadPool.ThreadPoolWorker.runWork(ThreadPoolWorker.
java:173)
at
org.exolab.core.threadPool.ThreadPoolWorker.access$000(ThreadPoolWork
er.java:67)
at
org.exolab.core.threadPool.ThreadPoolWorker$1.run(ThreadPoolWorker.ja
va:117)
at java.lang.Thread.run(Thread.java:536)

Here is my current configuration
set JAVA_OPTS=-Xmx512M
destinationcachesize - 15000
maxthreads - 1000
memorycheckinterval - 25
lowwaterthreshold - 20
garbagecollectionthreadpriority - 2
Please help. Can the server not handle so many messages published at such
low frequency?
Thanks
Ivy

-----Original Message-----
From: Thomas, Ivy [mailto:***@3eti.com]
Sent: Monday, July 28, 2003 3:24 PM
To: 'openjms-***@lists.sourceforge.net'
Subject: RE: [openjms-developer] OpenJMS crashing! Help!

I tried all kinds of combination: Here are the current configs that I am
working with. I have around 100 publishers publishing to the same topic at a
frequency of 8 secs. The subscribers may not be as many as publishers.

OPENJMS 0.7.5 - mode tcp - persistent

set JAVA_OPTS=-Xmx512M
destinationcachesize - 20000
maxthreads - 500
memorycheckinterval - 60
lowwaterthreshold - 35
garbagecollectionthreadpriority - 2
Still complains about the memory:(

Am running out of options to try and am considering changing the
destinationcachesize to 2000000.
Another note: Am creating the topic dynamically. Since I am having trouble
doing lookup on topic name, am assuming that on creating an existing topic,
it will return me a reference to the already created topic. Am I correct.

Appreciate your help!
Thanks
Ivy

-----Original Message-----
From: Thomas, Ivy [mailto:***@3eti.com]
Sent: Friday, July 25, 2003 4:13 PM
To: 'openjms-***@lists.sourceforge.net'
Subject: [openjms-developer] OpenJMS crashing! Help!

Hello
I am running the server in non persistent, tcp mode.

Here is what I see when I have around 50 publishers and subscribers to
same/multiple topics.
Can someone tell me if there is a configuration piece I missed and why this
is happenning? This is not like the server is running for days.. it
happenned in just an hour of all the publishers/subscribers coming in.

15:26:18.968 ERROR [Scheduler-Worker-2] - javax.jms.JMSException: Could not
get message for handle Handle : 4:1059159614031:3267
:ID:6202634392488269420
javax.jms.JMSException: Could not get message for handle Handle :
4:1059159614031:3267:ID:6202634392488269420
at org.exolab.jms.server.JmsServerSession.onMessage(Unknown Source)
at org.exolab.jms.messagemgr.TopicConsumerEndpoint.run(Unknown
Source)
at
org.exolab.core.threadPool.ThreadPoolWorker.runIt(ThreadPoolWorker.java:186)
at
org.exolab.core.threadPool.ThreadPoolWorker.runWork(ThreadPoolWorker.java:17
3)
at
org.exolab.core.threadPool.ThreadPoolWorker.access$000(ThreadPoolWorker.java
:67)
at
org.exolab.core.threadPool.ThreadPoolWorker$1.run(ThreadPoolWorker.java:117)
at java.lang.Thread.run(Thread.java:536)

after a period of time I start seeing this:

java.lang.OutOfMemoryError
java.lang.OutOfMemoryError
java.lang.OutOfMemoryError15:52:34.031 INFO [EventManager-Worker-3] -
Failed to verify that session 976118066399111786 is active.

Thanks
Ivy

-------------------------------------------------------
This SF.Net email sponsored by: Free pre-built ASP.NET sites including
Data Reports, E-commerce, Portals, and Forums are available now.
Download today and enter to win an XBOX or Visual Studio .NET.
http://aspnet.click-url.com/go/psa00100003ave/direct;at.aspnet_072303_01/01
_______________________________________________
openjms-developer mailing list
openjms-***@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/openjms-developer

-------------------------------------------------------
This SF.Net email sponsored by: Free pre-built ASP.NET sites including
Data Reports, E-commerce, Portals, and Forums are available now.
Download today and enter to win an XBOX or Visual Studio .NET.
http://aspnet.click-url.com/go/psa00100003ave/direct;at.aspnet_072303_01/01

Tim Anderson

2003-07-29 22:53:07 UTC

Permalink

1. How many messages per second are you sending?
2. How many producers?
3 How many consumers?
4. maxThreads is far too high. The server will create 1000
threads which will kill performance. The default value is 10.
5. The destinationCacheSize is the no. of messages per topic/queue.
Consider reducing this if you have a lot of destinations.

-----Original Message-----
Thomas, Ivy
Sent: Wednesday, 30 July 2003 4:35 AM
Subject: RE: [openjms-developer] OpenJMS crashing! Help!
I was initially using non persistent delivery mode and then I moved to
persistent. Now am back on non persistent delivery mode. Thanks for the
suggestions. I am not sure if the memory problem has gone away cause I am
having same old problems now .. And it lands up not delivering
messages and
fills the log file with this error message.. .This is the same
message I was
seeing initially.
14:22:56.281 ERROR [Scheduler-Worker-141] - javax.jms.JMSException: Could
not ge
t message for handle Handle : 4:1059498331515:16666:ID:2513998605325599726
4:105949833151
5:16666:ID:2513998605325599726
at
org.exolab.jms.server.JmsServerSession.onMessage(Unknown Source)
at org.exolab.jms.messagemgr.TopicConsumerEndpoint.run(Unknown
Source)
at
org.exolab.core.threadPool.ThreadPoolWorker.runIt(ThreadPoolWorker.ja
va:186)
at
org.exolab.core.threadPool.ThreadPoolWorker.runWork(ThreadPoolWorker.
java:173)
at
org.exolab.core.threadPool.ThreadPoolWorker.access$000(ThreadPoolWork
er.java:67)
at
org.exolab.core.threadPool.ThreadPoolWorker$1.run(ThreadPoolWorker.ja
va:117)
at java.lang.Thread.run(Thread.java:536)
Here is my current configuration
set JAVA_OPTS=-Xmx512M
destinationcachesize - 15000
maxthreads - 1000
memorycheckinterval - 25
lowwaterthreshold - 20
garbagecollectionthreadpriority - 2
Please help. Can the server not handle so many messages published at such
low frequency?
Thanks
Ivy
-----Original Message-----
Sent: Monday, July 28, 2003 3:24 PM
Subject: RE: [openjms-developer] OpenJMS crashing! Help!
I tried all kinds of combination: Here are the current configs that I am
working with. I have around 100 publishers publishing to the same
topic at a
frequency of 8 secs. The subscribers may not be as many as publishers.
OPENJMS 0.7.5 - mode tcp - persistent
set JAVA_OPTS=-Xmx512M
destinationcachesize - 20000
maxthreads - 500
memorycheckinterval - 60
lowwaterthreshold - 35
garbagecollectionthreadpriority - 2
Still complains about the memory:(
Am running out of options to try and am considering changing the
destinationcachesize to 2000000.
Another note: Am creating the topic dynamically. Since I am having trouble
doing lookup on topic name, am assuming that on creating an
existing topic,
it will return me a reference to the already created topic. Am I correct.
Appreciate your help!
Thanks
Ivy
-----Original Message-----
Sent: Friday, July 25, 2003 4:13 PM
Subject: [openjms-developer] OpenJMS crashing! Help!
Hello
I am running the server in non persistent, tcp mode.
Here is what I see when I have around 50 publishers and subscribers to
same/multiple topics.
Can someone tell me if there is a configuration piece I missed
and why this
is happenning? This is not like the server is running for days.. it
happenned in just an hour of all the publishers/subscribers coming in.
Could not
get message for handle Handle : 4:1059159614031:3267
:ID:6202634392488269420
4:1059159614031:3267:ID:6202634392488269420
at
org.exolab.jms.server.JmsServerSession.onMessage(Unknown Source)
at org.exolab.jms.messagemgr.TopicConsumerEndpoint.run(Unknown
Source)
at
org.exolab.core.threadPool.ThreadPoolWorker.runIt(ThreadPoolWorker
.java:186)
at
org.exolab.core.threadPool.ThreadPoolWorker.runWork(ThreadPoolWork
er.java:17
3)
at
org.exolab.core.threadPool.ThreadPoolWorker.access$000(ThreadPoolW
orker.java
:67)
at
org.exolab.core.threadPool.ThreadPoolWorker$1.run(ThreadPoolWorker
.java:117)
at java.lang.Thread.run(Thread.java:536)
java.lang.OutOfMemoryError
java.lang.OutOfMemoryError
java.lang.OutOfMemoryError15:52:34.031 INFO [EventManager-Worker-3] -
Failed to verify that session 976118066399111786 is active.
Thanks
Ivy
-------------------------------------------------------
This SF.Net email sponsored by: Free pre-built ASP.NET sites including
Data Reports, E-commerce, Portals, and Forums are available now.
Download today and enter to win an XBOX or Visual Studio .NET.
http://aspnet.click-url.com/go/psa00100003ave/direct;at.aspnet_072
303_01/01
_______________________________________________
openjms-developer mailing list
https://lists.sourceforge.net/lists/listinfo/openjms-developer
-------------------------------------------------------
This SF.Net email sponsored by: Free pre-built ASP.NET sites including
Data Reports, E-commerce, Portals, and Forums are available now.
Download today and enter to win an XBOX or Visual Studio .NET.
http://aspnet.click-url.com/go/psa00100003ave/direct;at.aspnet_072
303_01/01
_______________________________________________
openjms-developer mailing list
https://lists.sourceforge.net/lists/listinfo/openjms-developer
-------------------------------------------------------
This SF.Net email sponsored by: Free pre-built ASP.NET sites including
Data Reports, E-commerce, Portals, and Forums are available now.
Download today and enter to win an XBOX or Visual Studio .NET.
http://aspnet.click-url.com/go/psa00100003ave/direct;at.aspnet_072
303_01/01
_______________________________________________
openjms-developer mailing list
https://lists.sourceforge.net/lists/listinfo/openjms-developer