Issues with SDDC Manager Server failed to start.

[danielmgrinnell]

I cant seem to get my SDDC manager to start properly. 

I am getting 

"Server failed to start.

Failed to init PSC and/or Postgres

Check the SDDC Manager UI Server logs for more details."

[Marek Zdrojewski]

Hi Daniel,

This error in combination with your expired vCenter password from your other post here, it looks a lot like this issue:

• SDDC Manager UI fails to load after reboot when vCenter root password has expired

This KB applies to VCF 4.x and I assume you are running VCF 5.x so take a snapshot of your SDDC Manager and affected vCenter Server and try the resolution provided in the KB.

If this still doesn't solve your issue, I suggest contacting Support.

Hope this helps.

[danielmgrinnell]

Hey Marek, 

I actually was working w/ that KB last night, good one! 

I updated my root PASSWD on both VCSA's and verified ssh access via root and ran the psql to get list the vc's and id's and then ran the password update command and am now rebooting to see if the SDDC comes up correctly and can connect to the vc correctly. 

Thanks 

[danielmgrinnell]

Same results unfortunelty after updating the new VC passwords. 

It says in the KB

On boot, the SDDC tries to establish an SSH connection to the Management Domain vCenter. If the root password on the Management Domain vCenter has expired this connection will fail.

Now when i run the following command 

psql -h localhost -U postgres -d platform -c "select vm_hostname,id,status from vcenter"

It shows me that my mangment domain vcenter status is active (the wl domain is ERROR, but shouldnt impact the SDDC boot up i would think. 

I am seeing this in the SDDC managment page "Failed to init PSC and/or Postgres". 

Does anyone know which LOGS i could check to dig into this? 

Thanks ! 

[danielmgrinnell]

I am getting the following in the 

/var/log/vmware/vcf/sddc-manager-ui-app/sddcManagerServer.log

2025-04-03T01:41:27.663+0000 WARN [d7a82d9d4a054ebc, 6207d3d311194cf6] [services/pscUtils.js, init-pscs, attemptPSCInitWithRetry:111]
100.109: VError: PSC Initilization attempt "5" failed: Failed to initiate PSC: Unable to initialize psc inventory data: Failed to fetch results from /inventory/pscs api: Request failed with status code 502
    at Object.initializationPscError (/opt/vmware/vcf/sddc-manager-ui-app/server/src/errors/VCFError.js:104:5)
    at attemptPSCInitWithRetry (/opt/vmware/vcf/sddc-manager-ui-app/server/src/services/pscUtils.js:104:46)
    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
Error Info: {"retryCount":5,"status":403,"errorModule":100,"errorCode":109,"code":"ERR_BAD_RESPONSE"}
caused by:
100.108: VError: Failed to initiate PSC: Unable to initialize psc inventory data: Failed to fetch results from /inventory/pscs api: Request failed with status code 502
    at Object.initiatePscError (/opt/vmware/vcf/sddc-manager-ui-app/server/src/errors/VCFError.js:104:5)
    at attemptPSCInit (/opt/vmware/vcf/sddc-manager-ui-app/server/src/services/pscUtils.js:72:26)
    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
    at async attemptPSCInitWithRetry (/opt/vmware/vcf/sddc-manager-ui-app/server/src/services/pscUtils.js:99:17)
Error Info: {"errorModule":100,"errorCode":108,"code":"ERR_BAD_RESPONSE"}
caused by:
100.106: VError: Unable to initialize psc inventory data: Failed to fetch results from /inventory/pscs api: Request failed with status code 502
    at Object.initializePscInventoryError (/opt/vmware/vcf/sddc-manager-ui-app/server/src/errors/VCFError.js:104:5)
    at retrieveIdpPscDetails (/opt/vmware/vcf/sddc-manager-ui-app/server/src/services/pscUtils.js:43:26)
    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
    at async attemptPSCInit (/opt/vmware/vcf/sddc-manager-ui-app/server/src/services/pscUtils.js:57:26)
    at async attemptPSCInitWithRetry (/opt/vmware/vcf/sddc-manager-ui-app/server/src/services/pscUtils.js:99:17)
Error Info: {"errorModule":100,"errorCode":106,"code":"ERR_BAD_RESPONSE"}
caused by:
100.146: VError: Failed to fetch results from /inventory/pscs api: Request failed with status code 502
    at Object.failedToFetchResultsFromInventoryError (/opt/vmware/vcf/sddc-manager-ui-app/server/src/errors/VCFError.js:104:5)
    at retrieveIDPPsc (/opt/vmware/vcf/sddc-manager-ui-app/server/src/services/credentialRetriever.js:61:26)
    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
    at async retrieveIdpPscDetails (/opt/vmware/vcf/sddc-manager-ui-app/server/src/services/pscUtils.js:29:26)
    at async attemptPSCInit (/opt/vmware/vcf/sddc-manager-ui-app/server/src/services/pscUtils.js:57:26)
    at async attemptPSCInitWithRetry (/opt/vmware/vcf/sddc-manager-ui-app/server/src/services/pscUtils.js:99:17)
Error Info: {"errorModule":100,"errorCode":146,"code":"ERR_BAD_RESPONSE"}
caused by:
AxiosError: Request failed with status code 502
All Errors Info:
 {"code":"ERR_BAD_RESPONSE","retryCount":5,"status":403}
2025-04-03T01:41:27.664+0000 VERBOSE [d7a82d9d4a054ebc, 6207d3d311194cf6] [services/pscUtils.js, init-pscs, attemptPSCInitWithRetry:116] Pausing to give time for PSC to startup.Waiting for 50 seconds {"retriesRemaining":true,"retryCount":5}
2025-04-03T01:41:30.345+0000 VERBOSE [d7a82d9d4a054ebc, 47f558dd0beb42f0] [servers/startupServer/index.js, init-startup-feedback-server, null:91] Incoming request for startup server {"url":"/ui/"}
2025-04-03T01:41:30.387+0000 VERBOSE [d7a82d9d4a054ebc, 47f558dd0beb42f0] [servers/startupServer/index.js, init-startup-feedback-server, null:91] Incoming request for startup server {"url":"/ui/"}
2025-04-03T01:41:41.344+0000 VERBOSE [d7a82d9d4a054ebc, 47f558dd0beb42f0] [servers/startupServer/index.js, init-startup-feedback-server, null:91] Incoming request for startup server {"url":"/ui/"}
2025-04-03T01:41:41.381+0000 VERBOSE [d7a82d9d4a054ebc, 47f558dd0beb42f0] [servers/startupServer/index.js, init-startup-feedback-server, null:91] Incoming request for startup server {"url":"/ui/"}
2025-04-03T01:41:52.345+0000 VERBOSE [d7a82d9d4a054ebc, 47f558dd0beb42f0] [servers/startupServer/index.js, init-startup-feedback-server, null:91] Incoming request for startup server {"url":"/ui/"}
2025-04-03T01:41:52.384+0000 VERBOSE [d7a82d9d4a054ebc, 47f558dd0beb42f0] [servers/startupServer/index.js, init-startup-feedback-server, null:91] Incoming request for startup server {"url":"/ui/"}

[Marek Zdrojewski]

Hi Daniel,

I checked the errors from your logs internally and if this is your production environment you should create a SR with Global Support.