VMware vSphere

 View Only
Expand all | Collapse all

VCenter Appliance VPXD service does not Start with Error

  • 1.  VCenter Appliance VPXD service does not Start with Error

    Posted Jan 28, 2019 07:44 PM

    Hello. After rebooting, I could not connect to Vcentr every time I received a 503 error When I start vmware-vpxd manually, I get the following error. What is Stderr = Key not found: vpxd / secureSoapPort? How to fix  and what to do? Help me please! Thank!

    service-control --start vmware-vpxd

    INFO:root:Service: vmware-vpxd, Action: start

    Service: vmware-vpxd, Action: start

    2019-01-28T19:29:57.828Z   Running command: ['/sbin/chkconfig', u'vmware-vpxd']

    2019-01-28T19:29:57.958Z   Done running command

    2019-01-28T19:29:57.958Z   Running command: ['/sbin/service', u'vmware-vpxd', 'status']

    2019-01-28T19:29:58.532Z   Done running command

    2019-01-28T19:29:58.532Z   Running command: ['/sbin/chkconfig', '--force', u'vmware-vpxd', 'on']

    2019-01-28T19:29:58.595Z   Done running command

    2019-01-28T19:29:58.595Z   Running command: ['/sbin/service', u'vmware-vpxd', 'start']

    2019-01-28T19:30:01.535Z   Done running command

    2019-01-28T19:30:01.536Z   Invoked command: ['/sbin/service', u'vmware-vpxd', 'start']

    2019-01-28T19:30:01.536Z   RC = 1

    Stdout = Key not found: vpxd/secureSoapPort

    vmware-vpxd: VC SSL Certificate does not exist, it will be generated by vpxd

    Waiting for the embedded database to start up: success

    Executing pre-startup scripts...

    vmware-vpxd: Starting vpxd by administrative request.

    success

    vmware-vpxd: Waiting for vpxd to start listening for requests on

    Waiting for vpxd to initialize: Usage: wait_for_vpxd.py [options]

    wait_for_vpxd.py: error: -p option requires an argument

    failed

    failed

    vmware-vpxd: vpxd failed to initialize in time.

    vpxd is already starting up. Aborting the request.

    Stderr = Key not found: vpxd/secureSoapPort

    2019-01-28T19:30:01.536Z   {

        "resolution": null,

        "detail": [

            {

                "args": [

                    "Command: ['/sbin/service', u'vmware-vpxd', 'start']\nStderr: Key not found: vpxd/secureSoapPort\n"

                ],

                "id": "install.ciscommon.command.errinvoke",

                "localized": "An error occurred while invoking external command : 'Сommand: ['/sbin/service', u'vmware-vpxd', 'start']\nStderr: Key not found: vpxd/                                                                      secureSoapPort\n'",

                "translatable": "An error occurred while invoking external command :'%(0)s'"

            }

        ],

        "componentKey": null,

        "problemId": null

    }

    ERROR:root:Unable to start service vmware-vpxd, Exception: {

        "resolution": null,

        "detail": [

            {

                "args": [

                    "vmware-vpxd"

                ],

                "id": "install.ciscommon.service.failstart",

                "localized": "An error occurred while starting service 'vmware-vpxd'                                                                      ",

                "translatable": "An error occurred while starting service '%(0)s'"

            }

        ],

        "componentKey": null,

        "problemId": null

    }

    Unable to start service vmware-vpxd, Exception: {

        "resolution": null,

        "detail": [

            {

                "args": [

                    "vmware-vpxd"

                ],

                "id": "install.ciscommon.service.failstart",

                "localized": "An error occurred while starting service 'vmware-vpxd'                                                                      ",

                "translatable": "An error occurred while starting service '%(0)s'"

            }

        ],

        "componentKey": null,

        "problemId": null

    }



  • 2.  RE: VCenter Appliance VPXD service does not Start with Error

    Posted Jan 28, 2019 07:59 PM

    At the time of vpxd service crash what do you see in vpxd.log?

    Reproduce the issue and attach vpxd.log to this thread.

    Log location: /var/log/vmware/vpxd



  • 3.  RE: VCenter Appliance VPXD service does not Start with Error

    Posted Jan 28, 2019 08:10 PM

    Thanks for the response! writes nothing there. The last entry in the 25th, before the first reboot, after which Vcentr did not start

    2019-01-25T22:03:35.855Z info vpxd[7F6CB2D51700] [Originator@6876 sub=vpxLro opID=opId-2d30bba9-80b5-46ab-9e8b-c97898f10914-07-25] [VpxLRO] -- FINISH task-internal-2177093

    2019-01-25T22:03:36.125Z error vpxd[7F6CB33DE700] [Originator@6876 sub=SoapAdapter.HTTPService] Failed to read request; stream: <io_obj p:0x00007f6ccff0b880, h:-1, <TCP '0.0.0.0:0'>, <TCP '0.0.0.0:0'>>, error: N7Vmacore16TimeoutExceptionE(Operation timed out)

    2019-01-25T22:03:36.126Z error vpxd[7F6CB33DE700] [Originator@6876 sub=SoapAdapter.HTTPService] Failed to read request; stream: <io_obj p:0x00007f6cd16416a0, h:-1, <TCP '0.0.0.0:0'>, <TCP '0.0.0.0:0'>>, error: N7Vmacore16TimeoutExceptionE(Operation timed out)

    2019-01-25T22:03:36.126Z error vpxd[7F6CB33DE700] [Originator@6876 sub=HttpSvc.HTTPService] Failed to read request; stream: <io_obj p:0x00007f6cac4cbfc8, h:-1, <UNIX ''>, <UNIX ''>>, error: N7Vmacore16TimeoutExceptionE(Operation timed out)



  • 4.  RE: VCenter Appliance VPXD service does not Start with Error

    Posted Jan 28, 2019 08:16 PM

    # df -Th

    # service-control --status --all

    Please share output



  • 5.  RE: VCenter Appliance VPXD service does not Start with Error

    Posted Jan 28, 2019 08:23 PM

    A number of services except vmware-vpxd are not running, try to start everything one by one?



  • 6.  RE: VCenter Appliance VPXD service does not Start with Error

    Posted Jan 28, 2019 08:29 PM

    File-systems looks good...

    - Start vpxd service.

    - take a duplicate putty session to vcsa

    - tail -f vpxd.log and see if the log file is updated with latest entries.



  • 7.  RE: VCenter Appliance VPXD service does not Start with Error

    Posted Jan 28, 2019 08:34 PM

    Nothing .. writes nothing at all to the log



  • 8.  RE: VCenter Appliance VPXD service does not Start with Error

    Posted Jan 28, 2019 08:38 PM

    I wanted to verify if the config file is fine.

    Attach vpxd.cfg file from /etc/vmware-vpx location.



  • 9.  RE: VCenter Appliance VPXD service does not Start with Error

    Posted Jan 28, 2019 08:44 PM

    file contents  vpxd.cfg :

    kp-srv-vc:/etc/vmware-vpx # cat vpxd.cfg

    <?xml version="1.0" encoding="UTF-8" standalone="yes"?><healthStatus schemaVersion="1.0" xmlns="http://www.vmware.com/cis/cm/common/jaxb/healthstatus"><status>GREEN</status><message messageKey="cis.vpg.health.healthy" defaultMessage="VMware Postgres service is healthy."></message><expiration>2019-01-25T22:05:15.000Z</expiration></healthStatus>  <support>

          <scriptDirectory>/usr/lib/vmware-vpx/</scriptDirectory>

        </support>

        <vdb>

          <space>

            <alertMB>1000</alertMB>

            <warningMB>5000</warningMB>

          </space>

        </vdb>

        <vecs>

          <storeName>vpxd</storeName>

        </vecs>

        <vsan>

          <dynmgr>

            <enable>true</enable>

          </dynmgr>

        </vsan>

        <workflow>

          <methods id="PowerOnVM_Task">true</methods>

        </workflow>

      </vpxd>

      <workflow>

        <port>8088</port>

      </workflow>

    </config>



  • 10.  RE: VCenter Appliance VPXD service does not Start with Error

    Posted Jan 28, 2019 08:50 PM

    Okay..Usually vpxd.cfg file has approximately 130-150 lines.  We will have to figure out a way to fix the config file.

    I am checking in my lab if it is possible to fix vpxd.cfg.



  • 11.  RE: VCenter Appliance VPXD service does not Start with Error

    Posted Jan 28, 2019 08:54 PM

    Thank!

    I need a working vpxd.cfg? but it contains unique data for my system, isn't it? then how can I restore it? (



  • 12.  RE: VCenter Appliance VPXD service does not Start with Error

    Posted Jan 28, 2019 09:00 PM

    Yes it unique to your system. There are close to 10 lines where you will have to edit the file specific to your vsphere environment.

    How many hosts are being managed by this vc?

    Do you have a backup of this vc?



  • 13.  RE: VCenter Appliance VPXD service does not Start with Error

    Posted Jan 28, 2019 09:10 PM

    5 hosts. There is no backup. I found an article for Windows:

    VMware Knowledge Base 

    maybe there is something similar for Server Appliance?



  • 14.  RE: VCenter Appliance VPXD service does not Start with Error

    Posted Jan 28, 2019 09:25 PM

    I am not aware if there is any such config file in vcsa. There are 2 fields in vpxd.cfg file which I am not sure how to customize to your environment.

        <DB>

          <key_2>vc</key_2>

          <key_3>*p3i3Sdj/dxABy7IES3**************************pWm4HBX2c9BBCl</key_3>

        </DB>

        <key_EvaluationExpiryDate>AQD+ygg***********************************lYA/Rik29KAhMQ==</key_EvaluationExpiryDate>

      </registry>

      <task>

    One option is to

    - take a backup of DB

    - Deploy a new vcsa with the same build, DNS

    - Restore DB

    VMware Knowledge Base



  • 15.  RE: VCenter Appliance VPXD service does not Start with Error

    Posted Jan 28, 2019 09:26 PM

    Use winscp to copy files off of vcsa

    VMware Knowledge Base



  • 16.  RE: VCenter Appliance VPXD service does not Start with Error

    Posted Jan 28, 2019 09:43 PM

    It sounds interesting) Tomorrow I will try. Thank you very much for your help and for your time!



  • 17.  RE: VCenter Appliance VPXD service does not Start with Error

    Posted Feb 05, 2019 01:32 PM

    were you able to fix this?