Service Virtualization

Expand all | Collapse all

Memmory_Issue_In_Server

  • 1.  Memmory_Issue_In_Server

    Posted 12-02-2020 08:57 AM
    Hi All ,

    Getting memory alert for one of the SV server. Can please any one let me know which all files can be deleted from the server to free the memory.

    Thanks In Advance !!

    Regards
    Saurabh Mishra


  • 2.  RE: Memmory_Issue_In_Server

    Broadcom Employee
    Posted 12-02-2020 09:00 AM
    HI Saurabh
                Is it for Runtime memory or disk memory ?

    --
    regards
    Sankar Natarajan





  • 3.  RE: Memmory_Issue_In_Server

    Posted 12-02-2020 11:09 PM
    Hi Sankar ,

    Its disk memory as we have been earlier asked to clear the cache memory so by that i am assuming that its disk memory.

    Regards
    Saurabh Mishra


  • 4.  RE: Memmory_Issue_In_Server

    Broadcom Employee
    Posted 12-02-2020 11:15 PM
    Hi Saurabh
                 You could clean up the following files.

    1. Stop all Devtest services
    2. Go to LISA_HOME/lisatmp_<x.x.x> folder
    3. Delete all the files with .log and .log.x extensions
    4. Go to LISA_HOME/ lisatmp_<x.x.x>/lads folder and delete all the contents

    Hopefully this should help you recover some space. Let me know if you have any questions.

    --
    regards
    Sankar Natarajan





  • 5.  RE: Memmory_Issue_In_Server

    Posted 12-02-2020 11:51 PM
    Hi Sankar ,

    While trying to deploy the service to one of my server we are getting this error .




    ============================================================================
    | Exception:
    ============================================================================
    | Message: Could not stage: Unable to load file: name=/u01/appl/lisa/DevTest10_3/data/lisatmp_10_3/lads/C04F6208352211EBA9DE005056BE2158/ConnectCloud/VirtualServices/ConnectCloud_Login_PE_SIT_V0.3.vsm path:[/u01/appl/lisa/DevTest10_3/data/lisatmp_10_3/lads/C04F6208352211EBA9DE005056BE2158/ConnectCloud/VirtualServices/ConnectCloud_Login_PE_SIT_V0.3.vsm] absolutePath:[/u01/appl/lisa/DevTest10_3/data/lisatmp_10_3/lads/C04F6208352211EBA9DE005056BE2158/ConnectCloud/VirtualServices/ConnectCloud_Login_PE_SIT_V0.3.vsm] canonicalPath:[/u01/appl/lisa/DevTest10_3/data/lisatmp_10_3/lads/C04F6208352211EBA9DE005056BE2158/ConnectCloud/VirtualServices/ConnectCloud_Login_PE_SIT_V0.3.vsm]
    ----------------------------------------------------------------------------
    | Trapped Exception: Unable to load file: name=/u01/appl/lisa/DevTest10_3/data/lisatmp_10_3/lads/C04F6208352211EBA9DE005056BE2158/ConnectCloud/VirtualServices/ConnectCloud_Login_PE_SIT_V0.3.vsm path:[/u01/appl/lisa/DevTest10_3/data/lisatmp_10_3/lads/C04F6208352211EBA9DE005056BE2158/ConnectCloud/VirtualServices/ConnectCloud_Login_PE_SIT_V0.3.vsm] absolutePath:[/u01/appl/lisa/DevTest10_3/data/lisatmp_10_3/lads/C04F6208352211EBA9DE005056BE2158/ConnectCloud/VirtualServices/ConnectCloud_Login_PE_SIT_V0.3.vsm] canonicalPath:[/u01/appl/lisa/DevTest10_3/data/lisatmp_10_3/lads/C04F6208352211EBA9DE005056BE2158/ConnectCloud/VirtualServices/ConnectCloud_Login_PE_SIT_V0.3.vsm]
    | Trapped Message: java.io.FileNotFoundException: Unable to load file: name=/u01/appl/lisa/DevTest10_3/data/lisatmp_10_3/lads/C04F6208352211EBA9DE005056BE2158/ConnectCloud/VirtualServices/ConnectCloud_Login_PE_SIT_V0.3.vsm path:[/u01/appl/lisa/DevTest10_3/data/lisatmp_10_3/lads/C04F6208352211EBA9DE005056BE2158/ConnectCloud/VirtualServices/ConnectCloud_Login_PE_SIT_V0.3.vsm] absolutePath:[/u01/appl/lisa/DevTest10_3/data/lisatmp_10_3/lads/C04F6208352211EBA9DE005056BE2158/ConnectCloud/VirtualServices/ConnectCloud_Login_PE_SIT_V0.3.vsm] canonicalPath:[/u01/appl/lisa/DevTest10_3/data/lisatmp_10_3/lads/C04F6208352211EBA9DE005056BE2158/ConnectCloud/VirtualServices/ConnectCloud_Login_PE_SIT_V0.3.vsm]
    ----------------------------------------------------------------------------
    STACK TRACE
    java.io.FileNotFoundException: Unable to load file: name=/u01/appl/lisa/DevTest10_3/data/lisatmp_10_3/lads/C04F6208352211EBA9DE005056BE2158/ConnectCloud/VirtualServices/ConnectCloud_Login_PE_SIT_V0.3.vsm path:[/u01/appl/lisa/DevTest10_3/data/lisatmp_10_3/lads/C04F6208352211EBA9DE005056BE2158/ConnectCloud/VirtualServices/ConnectCloud_Login_PE_SIT_V0.3.vsm] absolutePath:[/u01/appl/lisa/DevTest10_3/data/lisatmp_10_3/lads/C04F6208352211EBA9DE005056BE2158/ConnectCloud/VirtualServices/ConnectCloud_Login_PE_SIT_V0.3.vsm] canonicalPath:[/u01/appl/lisa/DevTest10_3/data/lisatmp_10_3/lads/C04F6208352211EBA9DE005056BE2158/ConnectCloud/VirtualServices/ConnectCloud_Login_PE_SIT_V0.3.vsm]
    at com.itko.util.StreamHelp.fileOpenerWithInfo(StreamHelp.java:775)
    at com.itko.util.StreamHelp.fileOpener(StreamHelp.java:670)
    at com.itko.util.XMLUtils.openXMLDoc(XMLUtils.java:591)
    at com.itko.lisa.LisaDocument.<init>(LisaDocument.java:56)
    at com.itko.lisa.test.TestCaseDocument.<init>(TestCaseDocument.java:37)
    at com.itko.lisa.test.TestCase.openTestCaseDoc(TestCase.java:1918)
    at com.itko.lisa.coordinator.CoordinatorImpl.stageModelArchive(CoordinatorImpl.java:1210)
    at com.itko.lisa.coordinator.VirtualServiceCoordinator.<init>(VirtualServiceCoordinator.java:152)
    at com.itko.lisa.coordinator.VirtualServiceImpl.createVSCoordinator(VirtualServiceImpl.java:261)
    at com.itko.lisa.coordinator.VirtualServiceImpl.<init>(VirtualServiceImpl.java:162)
    at com.itko.lisa.coordinator.VirtualServiceEnvironmentImpl.addService(VirtualServiceEnvironmentImpl.java:1047)
    at com.itko.lisa.coordinator.VirtualServiceEnvironmentImpl.addService(VirtualServiceEnvironmentImpl.java:1019)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:498)
    at com.itko.lisa.net.RemoteMethodExec.execute(RemoteMethodExec.java:57)
    at com.itko.lisa.net.ServerRequestHandler.processRMIMessage(ServerRequestHandler.java:533)
    at com.itko.lisa.net.ServerRequestHandler.access$600(ServerRequestHandler.java:70)
    at com.itko.lisa.net.ServerRequestHandler$5.run(ServerRequestHandler.java:451)
    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
    at java.util.concurrent.FutureTask.run(FutureTask.java:266)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
    at java.lang.Thread.run(Thread.java:745)
    Caused by: java.io.FileNotFoundException: /u01/appl/lisa/DevTest10_3/data/lisatmp_10_3/lads/C04F6208352211EBA9DE005056BE2158/ConnectCloud/VirtualServices/ConnectCloud_Login_PE_SIT_V0.3.vsm (No such file or directory)
    at java.io.FileInputStream.open0(Native Method)
    at java.io.FileInputStream.open(FileInputStream.java:195)
    at java.io.FileInputStream.<init>(FileInputStream.java:138)
    at java.io.FileInputStream.<init>(FileInputStream.java:93)
    at com.itko.util.StreamHelp.fileOpenerWithInfo(StreamHelp.java:761)
    ... 24 more
    ============================================================================


    at com.itko.lisa.coordinator.CoordinatorImpl.stageModelArchive(CoordinatorImpl.java:1255)
    at com.itko.lisa.coordinator.VirtualServiceCoordinator.<init>(VirtualServiceCoordinator.java:152)
    at com.itko.lisa.coordinator.VirtualServiceImpl.createVSCoordinator(VirtualServiceImpl.java:261)
    at com.itko.lisa.coordinator.VirtualServiceImpl.<init>(VirtualServiceImpl.java:162)
    at com.itko.lisa.coordinator.VirtualServiceEnvironmentImpl.addService(VirtualServiceEnvironmentImpl.java:1047)
    at com.itko.lisa.coordinator.VirtualServiceEnvironmentImpl.addService(VirtualServiceEnvironmentImpl.java:1019)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:498)
    at com.itko.lisa.net.RemoteMethodExec.execute(RemoteMethodExec.java:57)
    at com.itko.lisa.net.ServerRequestHandler.processRMIMessage(ServerRequestHandler.java:533)
    at com.itko.lisa.net.ServerRequestHandler.access$600(ServerRequestHandler.java:70)
    at com.itko.lisa.net.ServerRequestHandler$5.run(ServerRequestHandler.java:451)
    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
    at java.util.concurrent.FutureTask.run(FutureTask.java:266)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
    at java.lang.Thread.run(Thread.java:745)



    Can you please let me know if this is due to Memory issue of server.


    Regards
    Saurabh


  • 6.  RE: Memmory_Issue_In_Server

    Broadcom Employee
    Posted 12-03-2020 12:02 AM
    Hi Saurabh
                 ITs likely that the lads folders has been cleared to save disk space. Please redeploy the virtual service and then try to start it.

    --
    regards
    Sankar Natarajan





  • 7.  RE: Memmory_Issue_In_Server

    Posted 12-03-2020 12:09 AM
    Hi Sankar ,

    When I am trying to deploy the service its giving me below error. What shall i do .....Shall i clear the disk space then shall I try to redeploy it.

    Regards
    Saurabh Mishra


  • 8.  RE: Memmory_Issue_In_Server

    Posted 12-03-2020 01:17 AM
    Hi Saurabh,

    Stop all components of Devtest, clear logs for lisatmp folder and then restart the components.
    If any services are getting error, redeploy them. In case of existing mars sometimes you might have to recreate the mars and deploy them again.

    Thanks

    ------------------------------
    Regards,
    Vaibhav Jain
    Capgemini
    ------------------------------



  • 9.  RE: Memmory_Issue_In_Server

    Broadcom Employee
    Posted 12-03-2020 02:59 AM
    HI Saurabh
              Please try the following steps:

    1. Stop the VSE service
    2. Clear the lads folder
    3. Start VSE Service
    4. Deploy Virtual Services

    --
    regards
    Sankar Natarajan





  • 10.  RE: Memmory_Issue_In_Server

    Posted 12-04-2020 02:41 AM
    Hi Sankar ,

    While deleting the temp file from the server , we also deleted one data folder in which response pair was there and it was occuping 2GB of memory and after deleting that we freed almost 2GB memory.

    But problem starts now for us as the VSE is going down every time we are restarting it.

    Please find the VSE log.

    Please find the screenshot for that , can you please suggest what to do now.

    Regards
    Saurabh

    Attachment(s)

    log
    vse.log   5.14 MB 1 version


  • 11.  RE: Memmory_Issue_In_Server

    Posted 12-04-2020 03:07 AM
    Hi Saurabh,

    I can see lots of memory errors in logs, try once after allocating more memory.

    ALso, you can try to reduce the number of virtual service running and then start deploying services gradually to identify the memory related problem.

    Thanks

    ------------------------------
    Regards,
    Vaibhav Jain
    Capgemini
    ------------------------------



  • 12.  RE: Memmory_Issue_In_Server

    Posted 12-04-2020 03:06 AM
    Hi Sankar ,

    Can you please guide as its a blocker issue now for us.

    Regards
    Saurabh Mishra


  • 13.  RE: Memmory_Issue_In_Server

    Posted 12-04-2020 03:14 AM
    Hi Vaibhav ,

    We have almost freed 2 GB memory and every time we are trying to restart the VSE after restarting its going down.  How much do we need to free more space as we have deleted all the junk file.

    Only 4- 5 services are there and that also not coming up now .

    Regards
    Saurabh


  • 14.  RE: Memmory_Issue_In_Server

    Posted 12-04-2020 03:22 AM
    Hi Saurabh,

    Try renaming(or move it to another location) the VSE(name you can validate) folder under  $LISA_HOME/vseDeploy/ and restart the components once.

    Thanks


    ------------------------------
    Regards,
    Vaibhav Jain
    Capgemini
    ------------------------------



  • 15.  RE: Memmory_Issue_In_Server

    Posted 12-04-2020 06:25 AM
    Hi Vaibhav ,

    Thanks for your suggestion we cleared some more logs and the servers are up and running now.

    Thanks
    Saurabh Mishra


  • 16.  RE: Memmory_Issue_In_Server

    Posted 12-04-2020 06:59 AM
    Good to know. Thanks for the update

    ------------------------------
    Regards,
    Vaibhav Jain
    Capgemini
    ------------------------------