Memmory_Issue_In_Server

[Saurabh Mishra]

Hi All ,

Getting memory alert for one of the SV server. Can please any one let me know which all files can be deleted from the server to free the memory.

Thanks In Advance !!

Regards
Saurabh Mishra

[Sankar Natarajan]

HI Saurabh

            Is it for Runtime memory or disk memory ?

--

regards

Sankar Natarajan

[Saurabh Mishra]

Hi Sankar ,

Its disk memory as we have been earlier asked to clear the cache memory so by that i am assuming that its disk memory.

Regards
Saurabh Mishra

[Sankar Natarajan]

Hi Saurabh

             You could clean up the following files.

1. Stop all Devtest services

2. Go to LISA_HOME/lisatmp_<x.x.x> folder

3. Delete all the files with .log and .log.x extensions

4. Go to LISA_HOME/ lisatmp_<x.x.x>/lads folder and delete all the contents

Hopefully this should help you recover some space. Let me know if you have any questions.

--

regards

Sankar Natarajan

[Saurabh Mishra]

Hi Sankar ,

While trying to deploy the service to one of my server we are getting this error .




============================================================================
| Exception:
============================================================================
| Message: Could not stage: Unable to load file: name=/u01/appl/lisa/DevTest10_3/data/lisatmp_10_3/lads/C04F6208352211EBA9DE005056BE2158/ConnectCloud/VirtualServices/ConnectCloud_Login_PE_SIT_V0.3.vsm path:[/u01/appl/lisa/DevTest10_3/data/lisatmp_10_3/lads/C04F6208352211EBA9DE005056BE2158/ConnectCloud/VirtualServices/ConnectCloud_Login_PE_SIT_V0.3.vsm] absolutePath:[/u01/appl/lisa/DevTest10_3/data/lisatmp_10_3/lads/C04F6208352211EBA9DE005056BE2158/ConnectCloud/VirtualServices/ConnectCloud_Login_PE_SIT_V0.3.vsm] canonicalPath:[/u01/appl/lisa/DevTest10_3/data/lisatmp_10_3/lads/C04F6208352211EBA9DE005056BE2158/ConnectCloud/VirtualServices/ConnectCloud_Login_PE_SIT_V0.3.vsm]
----------------------------------------------------------------------------
| Trapped Exception: Unable to load file: name=/u01/appl/lisa/DevTest10_3/data/lisatmp_10_3/lads/C04F6208352211EBA9DE005056BE2158/ConnectCloud/VirtualServices/ConnectCloud_Login_PE_SIT_V0.3.vsm path:[/u01/appl/lisa/DevTest10_3/data/lisatmp_10_3/lads/C04F6208352211EBA9DE005056BE2158/ConnectCloud/VirtualServices/ConnectCloud_Login_PE_SIT_V0.3.vsm] absolutePath:[/u01/appl/lisa/DevTest10_3/data/lisatmp_10_3/lads/C04F6208352211EBA9DE005056BE2158/ConnectCloud/VirtualServices/ConnectCloud_Login_PE_SIT_V0.3.vsm] canonicalPath:[/u01/appl/lisa/DevTest10_3/data/lisatmp_10_3/lads/C04F6208352211EBA9DE005056BE2158/ConnectCloud/VirtualServices/ConnectCloud_Login_PE_SIT_V0.3.vsm]
| Trapped Message: java.io.FileNotFoundException: Unable to load file: name=/u01/appl/lisa/DevTest10_3/data/lisatmp_10_3/lads/C04F6208352211EBA9DE005056BE2158/ConnectCloud/VirtualServices/ConnectCloud_Login_PE_SIT_V0.3.vsm path:[/u01/appl/lisa/DevTest10_3/data/lisatmp_10_3/lads/C04F6208352211EBA9DE005056BE2158/ConnectCloud/VirtualServices/ConnectCloud_Login_PE_SIT_V0.3.vsm] absolutePath:[/u01/appl/lisa/DevTest10_3/data/lisatmp_10_3/lads/C04F6208352211EBA9DE005056BE2158/ConnectCloud/VirtualServices/ConnectCloud_Login_PE_SIT_V0.3.vsm] canonicalPath:[/u01/appl/lisa/DevTest10_3/data/lisatmp_10_3/lads/C04F6208352211EBA9DE005056BE2158/ConnectCloud/VirtualServices/ConnectCloud_Login_PE_SIT_V0.3.vsm]
----------------------------------------------------------------------------
STACK TRACE
java.io.FileNotFoundException: Unable to load file: name=/u01/appl/lisa/DevTest10_3/data/lisatmp_10_3/lads/C04F6208352211EBA9DE005056BE2158/ConnectCloud/VirtualServices/ConnectCloud_Login_PE_SIT_V0.3.vsm path:[/u01/appl/lisa/DevTest10_3/data/lisatmp_10_3/lads/C04F6208352211EBA9DE005056BE2158/ConnectCloud/VirtualServices/ConnectCloud_Login_PE_SIT_V0.3.vsm] absolutePath:[/u01/appl/lisa/DevTest10_3/data/lisatmp_10_3/lads/C04F6208352211EBA9DE005056BE2158/ConnectCloud/VirtualServices/ConnectCloud_Login_PE_SIT_V0.3.vsm] canonicalPath:[/u01/appl/lisa/DevTest10_3/data/lisatmp_10_3/lads/C04F6208352211EBA9DE005056BE2158/ConnectCloud/VirtualServices/ConnectCloud_Login_PE_SIT_V0.3.vsm]
at com.itko.util.StreamHelp.fileOpenerWithInfo(StreamHelp.java:775)
at com.itko.util.StreamHelp.fileOpener(StreamHelp.java:670)
at com.itko.util.XMLUtils.openXMLDoc(XMLUtils.java:591)
at com.itko.lisa.LisaDocument.<init>(LisaDocument.java:56)
at com.itko.lisa.test.TestCaseDocument.<init>(TestCaseDocument.java:37)
at com.itko.lisa.test.TestCase.openTestCaseDoc(TestCase.java:1918)
at com.itko.lisa.coordinator.CoordinatorImpl.stageModelArchive(CoordinatorImpl.java:1210)
at com.itko.lisa.coordinator.VirtualServiceCoordinator.<init>(VirtualServiceCoordinator.java:152)
at com.itko.lisa.coordinator.VirtualServiceImpl.createVSCoordinator(VirtualServiceImpl.java:261)
at com.itko.lisa.coordinator.VirtualServiceImpl.<init>(VirtualServiceImpl.java:162)
at com.itko.lisa.coordinator.VirtualServiceEnvironmentImpl.addService(VirtualServiceEnvironmentImpl.java:1047)
at com.itko.lisa.coordinator.VirtualServiceEnvironmentImpl.addService(VirtualServiceEnvironmentImpl.java:1019)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.itko.lisa.net.RemoteMethodExec.execute(RemoteMethodExec.java:57)
at com.itko.lisa.net.ServerRequestHandler.processRMIMessage(ServerRequestHandler.java:533)
at com.itko.lisa.net.ServerRequestHandler.access$600(ServerRequestHandler.java:70)
at com.itko.lisa.net.ServerRequestHandler$5.run(ServerRequestHandler.java:451)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.FileNotFoundException: /u01/appl/lisa/DevTest10_3/data/lisatmp_10_3/lads/C04F6208352211EBA9DE005056BE2158/ConnectCloud/VirtualServices/ConnectCloud_Login_PE_SIT_V0.3.vsm (No such file or directory)
at java.io.FileInputStream.open0(Native Method)
at java.io.FileInputStream.open(FileInputStream.java:195)
at java.io.FileInputStream.<init>(FileInputStream.java:138)
at java.io.FileInputStream.<init>(FileInputStream.java:93)
at com.itko.util.StreamHelp.fileOpenerWithInfo(StreamHelp.java:761)
... 24 more
============================================================================


at com.itko.lisa.coordinator.CoordinatorImpl.stageModelArchive(CoordinatorImpl.java:1255)
at com.itko.lisa.coordinator.VirtualServiceCoordinator.<init>(VirtualServiceCoordinator.java:152)
at com.itko.lisa.coordinator.VirtualServiceImpl.createVSCoordinator(VirtualServiceImpl.java:261)
at com.itko.lisa.coordinator.VirtualServiceImpl.<init>(VirtualServiceImpl.java:162)
at com.itko.lisa.coordinator.VirtualServiceEnvironmentImpl.addService(VirtualServiceEnvironmentImpl.java:1047)
at com.itko.lisa.coordinator.VirtualServiceEnvironmentImpl.addService(VirtualServiceEnvironmentImpl.java:1019)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.itko.lisa.net.RemoteMethodExec.execute(RemoteMethodExec.java:57)
at com.itko.lisa.net.ServerRequestHandler.processRMIMessage(ServerRequestHandler.java:533)
at com.itko.lisa.net.ServerRequestHandler.access$600(ServerRequestHandler.java:70)
at com.itko.lisa.net.ServerRequestHandler$5.run(ServerRequestHandler.java:451)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)



Can you please let me know if this is due to Memory issue of server.


Regards
Saurabh

[Sankar Natarajan]

Hi Saurabh

             ITs likely that the lads folders has been cleared to save disk space. Please redeploy the virtual service and then try to start it.

--

regards

Sankar Natarajan

[Saurabh Mishra]

Hi Sankar ,

When I am trying to deploy the service its giving me below error. What shall i do .....Shall i clear the disk space then shall I try to redeploy it.

Regards
Saurabh Mishra

[Vaibhav Jain]

Hi Saurabh,

Stop all components of Devtest, clear logs for lisatmp folder and then restart the components. 
If any services are getting error, redeploy them. In case of existing mars sometimes you might have to recreate the mars and deploy them again.

Thanks

------------------------------
Regards,
Vaibhav Jain
Capgemini
------------------------------

[Sankar Natarajan]

HI Saurabh

          Please try the following steps:

1. Stop the VSE service

2. Clear the lads folder

3. Start VSE Service

4. Deploy Virtual Services

--

regards

Sankar Natarajan

[Saurabh Mishra]

Hi Sankar ,

While deleting the temp file from the server , we also deleted one data folder in which response pair was there and it was occuping 2GB of memory and after deleting that we freed almost 2GB memory.

But problem starts now for us as the VSE is going down every time we are restarting it.

Please find the VSE log.

Please find the screenshot for that , can you please suggest what to do now.

Regards
Saurabh

Attachment(s)

vse.log   5.14 MB 1 version

[Vaibhav Jain]

Hi Saurabh,

I can see lots of memory errors in logs, try once after allocating more memory.

ALso, you can try to reduce the number of virtual service running and then start deploying services gradually to identify the memory related problem.

Thanks

------------------------------
Regards,
Vaibhav Jain
Capgemini
------------------------------

[Saurabh Mishra]

Hi Sankar ,

Can you please guide as its a blocker issue now for us.

Regards
Saurabh Mishra

[Saurabh Mishra]

Hi Vaibhav ,

We have almost freed 2 GB memory and every time we are trying to restart the VSE after restarting its going down.  How much do we need to free more space as we have deleted all the junk file.

Only 4- 5 services are there and that also not coming up now .

Regards
Saurabh

[Vaibhav Jain]

Hi Saurabh,

Try renaming(or move it to another location) the VSE(name you can validate) folder under  $LISA_HOME/vseDeploy/ and restart the components once.

Thanks

------------------------------
Regards,
Vaibhav Jain
Capgemini
------------------------------

[Saurabh Mishra]

Hi Vaibhav ,

Thanks for your suggestion we cleared some more logs and the servers are up and running now.

Thanks
Saurabh Mishra

[Vaibhav Jain]

Good to know. Thanks for the update

------------------------------
Regards,
Vaibhav Jain
Capgemini
------------------------------