Memory issue in servicemix
|
View:
New views
13 Messages
—
Rating Filter:
Alert me
|
 |
Memory issue in servicemix
by sachin2008
::
Rate this Message:
Hi,
I am facing some problem with memory usage. we have developed our own eip. In this eip we are invkiong various other targets which returns large amount of data(Around 750 KB). After receiving data from the targets, it is being stored as string.And this string referrence is stored into some HashMap with some key. Before sending the response from eip we are removing the hashmap entry by using the corresponding key. So, what we assumed as after the end of the processing there will not be any referrences to the string. So it will be collected by the GC. When we perform load test on this example, we found that memory is growing up rapidly. It is coming down only when we invoke GC through Jconsole or the heap memory reaches to its specified size. Is there any difference in the GC process that will be done automatically and invoked explictly. Regards Gopi krishna Cheers
Praveen Oruganti "Think before you act and act on what you believe" |
|
|
Re: Memory issue in servicemix
by steff aka sid
::
Rate this Message:
Hi,
this is exactly what I've found out today, but I don't have any suggestion how to solve it :(. So I'am interested in this issue too. So let me know if you have an solution, I will do the same. Regards /Steffen
|
|
|
Re: Memory issue in servicemix
by tterm
::
Rate this Message:
If you explicit use System.gc() like you do it with jconsole it is a
major/full gc. But If I understand you correctly you have no leak or whatever? It seems also not really related to SMX, right? Cheers Thomas sachin2008 wrote: > Hi, > I am facing some problem with memory usage. we have developed our own eip. > In this eip we are invkiong various other targets which returns large amount > of data(Around 750 KB). > > After receiving data from the targets, it is being stored as string.And this > string referrence is stored into some HashMap with some key. > > Before sending the response from eip we are removing the hashmap entry by > using the corresponding key. > > So, what we assumed as after the end of the processing there will not be any > referrences to the string. So it will be collected by the GC. > > When we perform load test on this example, we found that memory is growing > up rapidly. It is coming down only when we invoke GC through Jconsole or the > heap memory reaches to its specified size. > > Is there any difference in the GC process that will be done automatically > and invoked explictly. > > Regards > Gopi krishna > > ----- > Cheers > Praveen Oruganti > "Think before you act and act on what you believe" -- Thomas Termin _______________________________ blue elephant systems GmbH Wollgrasweg 49 D-70599 Stuttgart Tel : (+49) 0711 - 45 10 17 676 Fax : (+49) 0711 - 45 10 17 573 WWW : http://www.blue-elephant-systems.com Email : Thomas.Termin@... blue elephant systems GmbH Firmensitz : Wollgrasweg 49, D-70599 Stuttgart Registergericht : Amtsgericht Stuttgart, HRB 24106 Geschäftsführer : Holger Dietrich, Thomas Gentsch, Joachim Hoernle |
|
|
Re: Memory issue in servicemix
by sachin2008
::
Rate this Message:
Yes, i think this is not an issue with smx. Its some thing to do with GC process.
Cheers
Praveen Oruganti "Think before you act and act on what you believe" |
|
|
Re: Memory issue in servicemix
by sachin2008
::
Rate this Message:
Hi,
I fhave find the reason for this. As we are holding the objets for some time, those are being moved to Tenure space treating them as long living objects. So , objects in Tenure space will be collected only by Markand Sweep contact GC process. Check out the following links for more information on this http://www.informit.com/guides/content.aspx?g=java&seqNum=249 http://docs.huihoo.com/java/se/jdk6/docs/guide/management/jconsole.html#gc
Cheers
Praveen Oruganti "Think before you act and act on what you believe" |
|
|
Re: Memory issue in servicemix
by steff aka sid
::
Rate this Message:
Hi,
in your first post you sayed something about "we have developed our own eip.". What do you mean? Do you have created youre own EIP-Component for servicemix or used the existing one? I've found out that in my case the memory leak is related to the servicemix-eip component or more in detail I think that its something with the StringSource (not completele shure but seems so). Regards /Steffen P.s. what tool you use for profiling? I found out that the profiler shipped with netbeans is really nice.
|
|
|
Re: Memory issue in servicemix
by dhoni2008
::
Rate this Message:
Hi,
I am sachin2008's friend and I only posted that. As i metnioed in my first post we cretaed a new eip called MulticastAggregator. This is a combination of splliter ans aggregator patterns. This eip pattern, after receiving the request,sends requests to one or more targtes asynchronously. After receving the responses for all these requests, it aggregates all the responses in to a sinfgle response and send back to the requestor. Why we are using asynchronous is to acheive parallelism. But in this new pattern, currently we are facing the memory related problem. This memory problem is not only with the eip paaterns, we can obseve the same behaviour with a simple loanbroker example. we made some changes to loanbroker example. In the loan broker example from a bank component, in adition to setting the properties, we have added 2 mb of data also as a messgae contents. In the Loanbroker component after receiving the responses from bank components, if we try to change the contents of NM and send as response from Loanbroker, we can see a lot of increase in memory usage. Regards Dhoni 2008.
|
|
|
Re: Memory issue in servicemix
by steff aka sid
::
Rate this Message:
Hi,
ok this must be the same problem I have. I faced out too that it does not rely on the EIP. When I create a bean what does the same like a static recipient list (a little bit easier) I got the same memory leak. Regards /Steffen dhoni2008 schrieb: > Hi, > I am sachin2008's friend and I only posted that. > > As i metnioed in my first post we cretaed a new eip called > MulticastAggregator. This is a combination of splliter ans aggregator > patterns. > > This eip pattern, after receiving the request,sends requests to one or more > targtes asynchronously. After receving the responses for all these requests, > it aggregates all the responses in to a sinfgle response and send back to > the requestor. > Why we are using asynchronous is to acheive parallelism. > > But in this new pattern, currently we are facing the memory related problem. > > This memory problem is not only with the eip paaterns, we can obseve the > same behaviour with a simple loanbroker example. > > we made some changes to loanbroker example. In the loan broker example from > a bank component, in adition to setting the properties, we have added 2 mb > of data also as a messgae contents. > In the Loanbroker component after receiving the responses from bank > components, if we try to change the contents of NM and send as response > from Loanbroker, we can see a lot of increase in memory usage. > > > Regards > Dhoni 2008. > > > > > steff aka sid wrote: > >> Hi, >> in your first post you sayed something about "we have developed our own >> eip.". What do you mean? Do you have created youre own EIP-Component for >> servicemix or used the existing one? I've found out that in my case the >> memory leak is related to the servicemix-eip component or more in detail I >> think that its something with the StringSource (not completele shure but >> seems so). >> >> Regards >> /Steffen >> >> P.s. what tool you use for profiling? I found out that the profiler >> shipped with netbeans is really nice. >> >> >> sachin2008 wrote: >> >>> Yes, i think this is not an issue with smx. Its some thing to do with GC >>> process. >>> >>> >>> tterm wrote: >>> >>>> If you explicit use System.gc() like you do it with jconsole it is a >>>> major/full gc. >>>> But If I understand you correctly you have no leak or whatever? It seems >>>> also not really related to SMX, right? >>>> >>>> Cheers >>>> Thomas >>>> >>>> sachin2008 wrote: >>>> >>>>> Hi, >>>>> I am facing some problem with memory usage. we have developed our own >>>>> eip. >>>>> In this eip we are invkiong various other targets which returns large >>>>> amount >>>>> of data(Around 750 KB). >>>>> >>>>> After receiving data from the targets, it is being stored as string.And >>>>> this >>>>> string referrence is stored into some HashMap with some key. >>>>> >>>>> Before sending the response from eip we are removing the hashmap entry >>>>> by >>>>> using the corresponding key. >>>>> >>>>> So, what we assumed as after the end of the processing there will not >>>>> be any >>>>> referrences to the string. So it will be collected by the GC. >>>>> >>>>> When we perform load test on this example, we found that memory is >>>>> growing >>>>> up rapidly. It is coming down only when we invoke GC through Jconsole >>>>> or the >>>>> heap memory reaches to its specified size. >>>>> >>>>> Is there any difference in the GC process that will be done >>>>> automatically >>>>> and invoked explictly. >>>>> >>>>> Regards >>>>> Gopi krishna >>>>> >>>>> ----- >>>>> Cheers >>>>> Praveen Oruganti >>>>> "Think before you act and act on what you believe" >>>>> >>>> -- >>>> Thomas Termin >>>> _______________________________ >>>> blue elephant systems GmbH >>>> Wollgrasweg 49 >>>> D-70599 Stuttgart >>>> >>>> Tel : (+49) 0711 - 45 10 17 676 >>>> Fax : (+49) 0711 - 45 10 17 573 >>>> WWW : http://www.blue-elephant-systems.com >>>> Email : Thomas.Termin@... >>>> >>>> blue elephant systems GmbH >>>> Firmensitz : Wollgrasweg 49, D-70599 Stuttgart >>>> Registergericht : Amtsgericht Stuttgart, HRB 24106 >>>> Geschäftsführer : Holger Dietrich, Thomas Gentsch, Joachim Hoernle >>>> >>>> >>>> >>>> >>> >> > > |
|
|
Re: Memory issue in servicemix
by gnodet
::
Rate this Message:
Did you make sure that all your components send back the DONE status ?
This would surely cause problems and memory leaks in all EIP patterns if one of the endpoint does not correctly handle the MEP. On Mon, Oct 13, 2008 at 3:21 PM, Steffen Rumpf <steff.aka.sid@...> wrote: > Hi, > ok this must be the same problem I have. I faced out too that it does > not rely on the EIP. When I create a bean what does the same like a > static recipient list (a little bit easier) I got the same memory leak. > > Regards > /Steffen > > dhoni2008 schrieb: >> Hi, >> I am sachin2008's friend and I only posted that. >> >> As i metnioed in my first post we cretaed a new eip called >> MulticastAggregator. This is a combination of splliter ans aggregator >> patterns. >> >> This eip pattern, after receiving the request,sends requests to one or more >> targtes asynchronously. After receving the responses for all these requests, >> it aggregates all the responses in to a sinfgle response and send back to >> the requestor. >> Why we are using asynchronous is to acheive parallelism. >> >> But in this new pattern, currently we are facing the memory related problem. >> >> This memory problem is not only with the eip paaterns, we can obseve the >> same behaviour with a simple loanbroker example. >> >> we made some changes to loanbroker example. In the loan broker example from >> a bank component, in adition to setting the properties, we have added 2 mb >> of data also as a messgae contents. >> In the Loanbroker component after receiving the responses from bank >> components, if we try to change the contents of NM and send as response >> from Loanbroker, we can see a lot of increase in memory usage. >> >> >> Regards >> Dhoni 2008. >> >> >> >> >> steff aka sid wrote: >> >>> Hi, >>> in your first post you sayed something about "we have developed our own >>> eip.". What do you mean? Do you have created youre own EIP-Component for >>> servicemix or used the existing one? I've found out that in my case the >>> memory leak is related to the servicemix-eip component or more in detail I >>> think that its something with the StringSource (not completele shure but >>> seems so). >>> >>> Regards >>> /Steffen >>> >>> P.s. what tool you use for profiling? I found out that the profiler >>> shipped with netbeans is really nice. >>> >>> >>> sachin2008 wrote: >>> >>>> Yes, i think this is not an issue with smx. Its some thing to do with GC >>>> process. >>>> >>>> >>>> tterm wrote: >>>> >>>>> If you explicit use System.gc() like you do it with jconsole it is a >>>>> major/full gc. >>>>> But If I understand you correctly you have no leak or whatever? It seems >>>>> also not really related to SMX, right? >>>>> >>>>> Cheers >>>>> Thomas >>>>> >>>>> sachin2008 wrote: >>>>> >>>>>> Hi, >>>>>> I am facing some problem with memory usage. we have developed our own >>>>>> eip. >>>>>> In this eip we are invkiong various other targets which returns large >>>>>> amount >>>>>> of data(Around 750 KB). >>>>>> >>>>>> After receiving data from the targets, it is being stored as string.And >>>>>> this >>>>>> string referrence is stored into some HashMap with some key. >>>>>> >>>>>> Before sending the response from eip we are removing the hashmap entry >>>>>> by >>>>>> using the corresponding key. >>>>>> >>>>>> So, what we assumed as after the end of the processing there will not >>>>>> be any >>>>>> referrences to the string. So it will be collected by the GC. >>>>>> >>>>>> When we perform load test on this example, we found that memory is >>>>>> growing >>>>>> up rapidly. It is coming down only when we invoke GC through Jconsole >>>>>> or the >>>>>> heap memory reaches to its specified size. >>>>>> >>>>>> Is there any difference in the GC process that will be done >>>>>> automatically >>>>>> and invoked explictly. >>>>>> >>>>>> Regards >>>>>> Gopi krishna >>>>>> >>>>>> ----- >>>>>> Cheers >>>>>> Praveen Oruganti >>>>>> "Think before you act and act on what you believe" >>>>>> >>>>> -- >>>>> Thomas Termin >>>>> _______________________________ >>>>> blue elephant systems GmbH >>>>> Wollgrasweg 49 >>>>> D-70599 Stuttgart >>>>> >>>>> Tel : (+49) 0711 - 45 10 17 676 >>>>> Fax : (+49) 0711 - 45 10 17 573 >>>>> WWW : http://www.blue-elephant-systems.com >>>>> Email : Thomas.Termin@... >>>>> >>>>> blue elephant systems GmbH >>>>> Firmensitz : Wollgrasweg 49, D-70599 Stuttgart >>>>> Registergericht : Amtsgericht Stuttgart, HRB 24106 >>>>> Geschäftsführer : Holger Dietrich, Thomas Gentsch, Joachim Hoernle >>>>> >>>>> >>>>> >>>>> >>>> >>> >> >> > > -- Cheers, Guillaume Nodet ------------------------ Blog: http://gnodet.blogspot.com/ ------------------------ Open Source SOA http://fusesource.com |
|
|
Re: Memory issue in servicemix
by steff aka sid
::
Rate this Message:
I've created a test only using servicemix-file components (no self
created bean or something like that) and got the same issue. Regards /Steffen Guillaume Nodet schrieb: > Did you make sure that all your components send back the DONE status ? > This would surely cause problems and memory leaks in all EIP patterns > if one of the endpoint does not correctly handle the MEP. > > On Mon, Oct 13, 2008 at 3:21 PM, Steffen Rumpf > <steff.aka.sid@...> wrote: > >> Hi, >> ok this must be the same problem I have. I faced out too that it does >> not rely on the EIP. When I create a bean what does the same like a >> static recipient list (a little bit easier) I got the same memory leak. >> >> Regards >> /Steffen >> >> dhoni2008 schrieb: >> >>> Hi, >>> I am sachin2008's friend and I only posted that. >>> >>> As i metnioed in my first post we cretaed a new eip called >>> MulticastAggregator. This is a combination of splliter ans aggregator >>> patterns. >>> >>> This eip pattern, after receiving the request,sends requests to one or more >>> targtes asynchronously. After receving the responses for all these requests, >>> it aggregates all the responses in to a sinfgle response and send back to >>> the requestor. >>> Why we are using asynchronous is to acheive parallelism. >>> >>> But in this new pattern, currently we are facing the memory related problem. >>> >>> This memory problem is not only with the eip paaterns, we can obseve the >>> same behaviour with a simple loanbroker example. >>> >>> we made some changes to loanbroker example. In the loan broker example from >>> a bank component, in adition to setting the properties, we have added 2 mb >>> of data also as a messgae contents. >>> In the Loanbroker component after receiving the responses from bank >>> components, if we try to change the contents of NM and send as response >>> from Loanbroker, we can see a lot of increase in memory usage. >>> >>> >>> Regards >>> Dhoni 2008. >>> >>> >>> >>> >>> steff aka sid wrote: >>> >>> >>>> Hi, >>>> in your first post you sayed something about "we have developed our own >>>> eip.". What do you mean? Do you have created youre own EIP-Component for >>>> servicemix or used the existing one? I've found out that in my case the >>>> memory leak is related to the servicemix-eip component or more in detail I >>>> think that its something with the StringSource (not completele shure but >>>> seems so). >>>> >>>> Regards >>>> /Steffen >>>> >>>> P.s. what tool you use for profiling? I found out that the profiler >>>> shipped with netbeans is really nice. >>>> >>>> >>>> sachin2008 wrote: >>>> >>>> >>>>> Yes, i think this is not an issue with smx. Its some thing to do with GC >>>>> process. >>>>> >>>>> >>>>> tterm wrote: >>>>> >>>>> >>>>>> If you explicit use System.gc() like you do it with jconsole it is a >>>>>> major/full gc. >>>>>> But If I understand you correctly you have no leak or whatever? It seems >>>>>> also not really related to SMX, right? >>>>>> >>>>>> Cheers >>>>>> Thomas >>>>>> >>>>>> sachin2008 wrote: >>>>>> >>>>>> >>>>>>> Hi, >>>>>>> I am facing some problem with memory usage. we have developed our own >>>>>>> eip. >>>>>>> In this eip we are invkiong various other targets which returns large >>>>>>> amount >>>>>>> of data(Around 750 KB). >>>>>>> >>>>>>> After receiving data from the targets, it is being stored as string.And >>>>>>> this >>>>>>> string referrence is stored into some HashMap with some key. >>>>>>> >>>>>>> Before sending the response from eip we are removing the hashmap entry >>>>>>> by >>>>>>> using the corresponding key. >>>>>>> >>>>>>> So, what we assumed as after the end of the processing there will not >>>>>>> be any >>>>>>> referrences to the string. So it will be collected by the GC. >>>>>>> >>>>>>> When we perform load test on this example, we found that memory is >>>>>>> growing >>>>>>> up rapidly. It is coming down only when we invoke GC through Jconsole >>>>>>> or the >>>>>>> heap memory reaches to its specified size. >>>>>>> >>>>>>> Is there any difference in the GC process that will be done >>>>>>> automatically >>>>>>> and invoked explictly. >>>>>>> >>>>>>> Regards >>>>>>> Gopi krishna >>>>>>> >>>>>>> ----- >>>>>>> Cheers >>>>>>> Praveen Oruganti >>>>>>> "Think before you act and act on what you believe" >>>>>>> >>>>>>> >>>>>> -- >>>>>> Thomas Termin >>>>>> _______________________________ >>>>>> blue elephant systems GmbH >>>>>> Wollgrasweg 49 >>>>>> D-70599 Stuttgart >>>>>> >>>>>> Tel : (+49) 0711 - 45 10 17 676 >>>>>> Fax : (+49) 0711 - 45 10 17 573 >>>>>> WWW : http://www.blue-elephant-systems.com >>>>>> Email : Thomas.Termin@... >>>>>> >>>>>> blue elephant systems GmbH >>>>>> Firmensitz : Wollgrasweg 49, D-70599 Stuttgart >>>>>> Registergericht : Amtsgericht Stuttgart, HRB 24106 >>>>>> Geschäftsführer : Holger Dietrich, Thomas Gentsch, Joachim Hoernle >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>> >> > > > > |
|
|
Re: Memory issue in servicemix
by gnodet
::
Rate this Message:
Could you raise a JIRA issue and attach your test case to it ?
On Mon, Oct 13, 2008 at 3:37 PM, Steffen Rumpf <steff.aka.sid@...> wrote: > I've created a test only using servicemix-file components (no self > created bean or something like that) and got the same issue. > > Regards > /Steffen > > Guillaume Nodet schrieb: >> Did you make sure that all your components send back the DONE status ? >> This would surely cause problems and memory leaks in all EIP patterns >> if one of the endpoint does not correctly handle the MEP. >> >> On Mon, Oct 13, 2008 at 3:21 PM, Steffen Rumpf >> <steff.aka.sid@...> wrote: >> >>> Hi, >>> ok this must be the same problem I have. I faced out too that it does >>> not rely on the EIP. When I create a bean what does the same like a >>> static recipient list (a little bit easier) I got the same memory leak. >>> >>> Regards >>> /Steffen >>> >>> dhoni2008 schrieb: >>> >>>> Hi, >>>> I am sachin2008's friend and I only posted that. >>>> >>>> As i metnioed in my first post we cretaed a new eip called >>>> MulticastAggregator. This is a combination of splliter ans aggregator >>>> patterns. >>>> >>>> This eip pattern, after receiving the request,sends requests to one or more >>>> targtes asynchronously. After receving the responses for all these requests, >>>> it aggregates all the responses in to a sinfgle response and send back to >>>> the requestor. >>>> Why we are using asynchronous is to acheive parallelism. >>>> >>>> But in this new pattern, currently we are facing the memory related problem. >>>> >>>> This memory problem is not only with the eip paaterns, we can obseve the >>>> same behaviour with a simple loanbroker example. >>>> >>>> we made some changes to loanbroker example. In the loan broker example from >>>> a bank component, in adition to setting the properties, we have added 2 mb >>>> of data also as a messgae contents. >>>> In the Loanbroker component after receiving the responses from bank >>>> components, if we try to change the contents of NM and send as response >>>> from Loanbroker, we can see a lot of increase in memory usage. >>>> >>>> >>>> Regards >>>> Dhoni 2008. >>>> >>>> >>>> >>>> >>>> steff aka sid wrote: >>>> >>>> >>>>> Hi, >>>>> in your first post you sayed something about "we have developed our own >>>>> eip.". What do you mean? Do you have created youre own EIP-Component for >>>>> servicemix or used the existing one? I've found out that in my case the >>>>> memory leak is related to the servicemix-eip component or more in detail I >>>>> think that its something with the StringSource (not completele shure but >>>>> seems so). >>>>> >>>>> Regards >>>>> /Steffen >>>>> >>>>> P.s. what tool you use for profiling? I found out that the profiler >>>>> shipped with netbeans is really nice. >>>>> >>>>> >>>>> sachin2008 wrote: >>>>> >>>>> >>>>>> Yes, i think this is not an issue with smx. Its some thing to do with GC >>>>>> process. >>>>>> >>>>>> >>>>>> tterm wrote: >>>>>> >>>>>> >>>>>>> If you explicit use System.gc() like you do it with jconsole it is a >>>>>>> major/full gc. >>>>>>> But If I understand you correctly you have no leak or whatever? It seems >>>>>>> also not really related to SMX, right? >>>>>>> >>>>>>> Cheers >>>>>>> Thomas >>>>>>> >>>>>>> sachin2008 wrote: >>>>>>> >>>>>>> >>>>>>>> Hi, >>>>>>>> I am facing some problem with memory usage. we have developed our own >>>>>>>> eip. >>>>>>>> In this eip we are invkiong various other targets which returns large >>>>>>>> amount >>>>>>>> of data(Around 750 KB). >>>>>>>> >>>>>>>> After receiving data from the targets, it is being stored as string.And >>>>>>>> this >>>>>>>> string referrence is stored into some HashMap with some key. >>>>>>>> >>>>>>>> Before sending the response from eip we are removing the hashmap entry >>>>>>>> by >>>>>>>> using the corresponding key. >>>>>>>> >>>>>>>> So, what we assumed as after the end of the processing there will not >>>>>>>> be any >>>>>>>> referrences to the string. So it will be collected by the GC. >>>>>>>> >>>>>>>> When we perform load test on this example, we found that memory is >>>>>>>> growing >>>>>>>> up rapidly. It is coming down only when we invoke GC through Jconsole >>>>>>>> or the >>>>>>>> heap memory reaches to its specified size. >>>>>>>> >>>>>>>> Is there any difference in the GC process that will be done >>>>>>>> automatically >>>>>>>> and invoked explictly. >>>>>>>> >>>>>>>> Regards >>>>>>>> Gopi krishna >>>>>>>> >>>>>>>> ----- >>>>>>>> Cheers >>>>>>>> Praveen Oruganti >>>>>>>> "Think before you act and act on what you believe" >>>>>>>> >>>>>>>> >>>>>>> -- >>>>>>> Thomas Termin >>>>>>> _______________________________ >>>>>>> blue elephant systems GmbH >>>>>>> Wollgrasweg 49 >>>>>>> D-70599 Stuttgart >>>>>>> >>>>>>> Tel : (+49) 0711 - 45 10 17 676 >>>>>>> Fax : (+49) 0711 - 45 10 17 573 >>>>>>> WWW : http://www.blue-elephant-systems.com >>>>>>> Email : Thomas.Termin@... >>>>>>> >>>>>>> blue elephant systems GmbH >>>>>>> Firmensitz : Wollgrasweg 49, D-70599 Stuttgart >>>>>>> Registergericht : Amtsgericht Stuttgart, HRB 24106 >>>>>>> Geschäftsführer : Holger Dietrich, Thomas Gentsch, Joachim Hoernle >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>> >>> >> >> >> >> > > -- Cheers, Guillaume Nodet ------------------------ Blog: http://gnodet.blogspot.com/ ------------------------ Open Source SOA http://fusesource.com |
|
|
Re: Memory issue in servicemix
by steff aka sid
::
Rate this Message:
Done https://issues.apache.org/activemq/browse/SM-1631 Guillaume Nodet schrieb: > Could you raise a JIRA issue and attach your test case to it ? > > On Mon, Oct 13, 2008 at 3:37 PM, Steffen Rumpf > <steff.aka.sid@...> wrote: > >> I've created a test only using servicemix-file components (no self >> created bean or something like that) and got the same issue. >> >> Regards >> /Steffen >> >> Guillaume Nodet schrieb: >> >>> Did you make sure that all your components send back the DONE status ? >>> This would surely cause problems and memory leaks in all EIP patterns >>> if one of the endpoint does not correctly handle the MEP. >>> >>> On Mon, Oct 13, 2008 at 3:21 PM, Steffen Rumpf >>> <steff.aka.sid@...> wrote: >>> >>> >>>> Hi, >>>> ok this must be the same problem I have. I faced out too that it does >>>> not rely on the EIP. When I create a bean what does the same like a >>>> static recipient list (a little bit easier) I got the same memory leak. >>>> >>>> Regards >>>> /Steffen >>>> >>>> dhoni2008 schrieb: >>>> >>>> >>>>> Hi, >>>>> I am sachin2008's friend and I only posted that. >>>>> >>>>> As i metnioed in my first post we cretaed a new eip called >>>>> MulticastAggregator. This is a combination of splliter ans aggregator >>>>> patterns. >>>>> >>>>> This eip pattern, after receiving the request,sends requests to one or more >>>>> targtes asynchronously. After receving the responses for all these requests, >>>>> it aggregates all the responses in to a sinfgle response and send back to >>>>> the requestor. >>>>> Why we are using asynchronous is to acheive parallelism. >>>>> >>>>> But in this new pattern, currently we are facing the memory related problem. >>>>> >>>>> This memory problem is not only with the eip paaterns, we can obseve the >>>>> same behaviour with a simple loanbroker example. >>>>> >>>>> we made some changes to loanbroker example. In the loan broker example from >>>>> a bank component, in adition to setting the properties, we have added 2 mb >>>>> of data also as a messgae contents. >>>>> In the Loanbroker component after receiving the responses from bank >>>>> components, if we try to change the contents of NM and send as response >>>>> from Loanbroker, we can see a lot of increase in memory usage. >>>>> >>>>> >>>>> Regards >>>>> Dhoni 2008. >>>>> >>>>> >>>>> >>>>> >>>>> steff aka sid wrote: >>>>> >>>>> >>>>> >>>>>> Hi, >>>>>> in your first post you sayed something about "we have developed our own >>>>>> eip.". What do you mean? Do you have created youre own EIP-Component for >>>>>> servicemix or used the existing one? I've found out that in my case the >>>>>> memory leak is related to the servicemix-eip component or more in detail I >>>>>> think that its something with the StringSource (not completele shure but >>>>>> seems so). >>>>>> >>>>>> Regards >>>>>> /Steffen >>>>>> >>>>>> P.s. what tool you use for profiling? I found out that the profiler >>>>>> shipped with netbeans is really nice. >>>>>> >>>>>> >>>>>> sachin2008 wrote: >>>>>> >>>>>> >>>>>> >>>>>>> Yes, i think this is not an issue with smx. Its some thing to do with GC >>>>>>> process. >>>>>>> >>>>>>> >>>>>>> tterm wrote: >>>>>>> >>>>>>> >>>>>>> >>>>>>>> If you explicit use System.gc() like you do it with jconsole it is a >>>>>>>> major/full gc. >>>>>>>> But If I understand you correctly you have no leak or whatever? It seems >>>>>>>> also not really related to SMX, right? >>>>>>>> >>>>>>>> Cheers >>>>>>>> Thomas >>>>>>>> >>>>>>>> sachin2008 wrote: >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>>> Hi, >>>>>>>>> I am facing some problem with memory usage. we have developed our own >>>>>>>>> eip. >>>>>>>>> In this eip we are invkiong various other targets which returns large >>>>>>>>> amount >>>>>>>>> of data(Around 750 KB). >>>>>>>>> >>>>>>>>> After receiving data from the targets, it is being stored as string.And >>>>>>>>> this >>>>>>>>> string referrence is stored into some HashMap with some key. >>>>>>>>> >>>>>>>>> Before sending the response from eip we are removing the hashmap entry >>>>>>>>> by >>>>>>>>> using the corresponding key. >>>>>>>>> >>>>>>>>> So, what we assumed as after the end of the processing there will not >>>>>>>>> be any >>>>>>>>> referrences to the string. So it will be collected by the GC. >>>>>>>>> >>>>>>>>> When we perform load test on this example, we found that memory is >>>>>>>>> growing >>>>>>>>> up rapidly. It is coming down only when we invoke GC through Jconsole >>>>>>>>> or the >>>>>>>>> heap memory reaches to its specified size. >>>>>>>>> >>>>>>>>> Is there any difference in the GC process that will be done >>>>>>>>> automatically >>>>>>>>> and invoked explictly. >>>>>>>>> >>>>>>>>> Regards >>>>>>>>> Gopi krishna >>>>>>>>> >>>>>>>>> ----- >>>>>>>>> Cheers >>>>>>>>> Praveen Oruganti >>>>>>>>> "Think before you act and act on what you believe" >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>> -- >>>>>>>> Thomas Termin >>>>>>>> _______________________________ >>>>>>>> blue elephant systems GmbH >>>>>>>> Wollgrasweg 49 >>>>>>>> D-70599 Stuttgart >>>>>>>> >>>>>>>> Tel : (+49) 0711 - 45 10 17 676 >>>>>>>> Fax : (+49) 0711 - 45 10 17 573 >>>>>>>> WWW : http://www.blue-elephant-systems.com >>>>>>>> Email : Thomas.Termin@... >>>>>>>> >>>>>>>> blue elephant systems GmbH >>>>>>>> Firmensitz : Wollgrasweg 49, D-70599 Stuttgart >>>>>>>> Registergericht : Amtsgericht Stuttgart, HRB 24106 >>>>>>>> Geschäftsführer : Holger Dietrich, Thomas Gentsch, Joachim Hoernle >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>> >>> >>> >> > > > > |
