Hello Abbed Sedkaoui,
Thank you very much for your response. Unfortunately, it is still not working. The issue is that the lab environment was functioning correctly until it suddenly stopped working. I have backups stored on the NFS, and I managed to recover them by deploying a new cell. This new cell is deployed as medium, not small with 8vcpu and 16Gb ram
However, I applied the following command:
sed -i s/10s/60s/ /opt/vmware/appliance/bin/appliance-sync.sh
since the storage is a V5000 and not very fast.
The data seems to restore correctly, but the cell never fully starts. It fails when it reaches the module "com.vmware.vcloud.backend-core", where it throws an exception and then restarts the process.
The first error in the log is:
Error in module: "HTML5 Cell Application"; Bean: vcdSecuredWebappConfiguration
I would really appreciate any guidance you could provide.
Thank you in advance.
Best regards,
Martín
efaultTopology=topology on Topology@2a5d498c[owner=ServerLocatorImpl [initialConnectors=[], discoveryGroupConfiguration=DiscoveryGroupConfiguration{name='vcd-discovery-group', refreshTimeout=10000, discoveryInitialWaitTimeout=1000}]]:
29076e42-85d4-416b-a4e4-d35af65e0800 => TopologyMember[id=29076e42-85d4-416b-a4e4-d35af65e0800, connector=Pair[a=TransportConfiguration(name=netty-connector, factory=org-apache-activemq-artemis-core-remoting-impl-netty-NettyConnectorFactory) ?port=61616&host=172-20-10-100, b=null], backupGroupName=null, scaleDownGroupName=null]
nodes=1 members=1,
-----------------------------------
vcd-cluster=topology on Topology@10e19861[owner=ClusterConnectionImpl@1793309107[nodeUUID=29076e42-85d4-416b-a4e4-d35af65e0800, connector=TransportConfiguration(name=netty-connector, factory=org-apache-activemq-artemis-core-remoting-impl-netty-NettyConnectorFactory) ?port=61616&host=172-20-10-100, address=, server=ActiveMQServerImpl::name=29076e42-85d4-416b-a4e4-d35af65e0800]]:
29076e42-85d4-416b-a4e4-d35af65e0800 => TopologyMember[id=29076e42-85d4-416b-a4e4-d35af65e0800, connector=Pair[a=TransportConfiguration(name=netty-connector, factory=org-apache-activemq-artemis-core-remoting-impl-netty-NettyConnectorFactory) ?port=61616&host=172-20-10-100, b=null], backupGroupName=null, scaleDownGroupName=null]
nodes=1 members=1 |
2025-04-15 23:24:12,919 | DEBUG | HeartBeat-1 | CellManagerImpl | No change in the active cell list wast detected: [b6c3d684-af69-4225-b43d-816786c94876, 29076e42-85d4-416b-a4e4-d35af65e0800] |
2025-04-15 23:24:25,158 | WARN | Module: HTML5 Cell Application | DirectlyConfigurableXmlApplicationContext | 300,084 milliseconds creating bean: filterUtils; SLOW BEAN |
2025-04-15 23:24:25,159 | WARN | Module: HTML5 Cell Application | DirectlyConfigurableXmlApplicationContext | 300,089 milliseconds creating bean: sessionFilter; SLOW BEAN |
2025-04-15 23:24:25,163 | WARN | Module: HTML5 Cell Application | DirectlyConfigurableXmlApplicationContext | 324,504 milliseconds creating bean: vcdSecuredWebappConfiguration; SLOW BEAN |
2025-04-15 23:24:25,164 | WARN | Module: HTML5 Cell Application | DirectlyConfigurableXmlApplicationContext | Exception encountered during context initialization - cancelling refresh attempt: org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'vcdSecuredWebappConfiguration': Unsatisfied dependency expressed through field 'sessionFilter'; nested exception is org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'sessionFilter': Unsatisfied dependency expressed through field 'filterUtils'; nested exception is org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'filterUtils': Unsatisfied dependency expressed through field 'securityService'; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'securityService': FactoryBean threw exception on object creation; nested exception is java.util.concurrent.TimeoutException: Timed out waiting for service: 'securityService', objectClasses='[interface com.vmware.vcloud.api.presentation.service.SecurityService]', filter='(objectClass=com.vmware.vcloud.api.presentation.service.SecurityService)' |
2025-04-15 23:24:25,171 | FATAL | Module: HTML5 Cell Application | ModuleRegistry | Error in module: "HTML5 Cell Application"; Bean: vcdSecuredWebappConfiguration, Message: Error creating bean with name 'vcdSecuredWebappConfiguration': Unsatisfied dependency expressed through field 'sessionFilter'; nested exception is org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'sessionFilter': Unsatisfied dependency expressed through field 'filterUtils'; nested exception is org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'filterUtils': Unsatisfied dependency expressed through field 'securityService'; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'securityService': FactoryBean threw exception on object creation; nested exception is java.util.concurrent.TimeoutException: Timed out waiting for service: 'securityService', objectClasses='[interface com.vmware.vcloud.api.presentation.service.SecurityService]', filter='(objectClass=com.vmware.vcloud.api.presentation.service.SecurityService)' |
org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'vcdSecuredWebappConfiguration': Unsatisfied dependency expressed through field 'sessionFilter'; nested exception is org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'sessionFilter': Unsatisfied dependency expressed through field 'filterUtils'; nested exception is org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'filterUtils': Unsatisfied dependency expressed through field 'securityService'; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'securityService': FactoryBean threw exception on object creation; nested exception is java.util.concurrent.TimeoutException: Timed out waiting for service: 'securityService', objectClasses='[interface com.vmware.vcloud.api.presentation.service.SecurityService]', filter='(objectClass=com.vmware.vcloud.api.presentation.service.SecurityService)'
at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor$AutowiredFieldElement.resolveFieldValue(AutowiredAnnotationBeanPostProcessor.java:660)
at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor$AutowiredFieldElement.inject(AutowiredAnnotationBeanPostProcessor.java:640)
at org.springframework.beans.factory.annotation.InjectionMetadata.inject(InjectionMetadata.java:119)
at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor.postProcessProperties(AutowiredAnnotationBeanPostProcessor.java:399)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.populateBean(AbstractAutowireCapableBeanFactory.java:1431)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:619)
at com.vmware.vcloud.common.main.bootstrap.DirectlyConfigurableXmlApplicationContext$LoggingBeanFactory.doCreateBean(DirectlyConfigurableXmlApplicationContext.java:54)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:542)
at org.springframework.beans.factory.support.AbstractBeanFactory.lambda$doGetBean$0(AbstractBeanFactory.java:335)
at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:234)
at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:333)
at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:208)
at org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:955)
at org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:920)
at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:583)
at com.vmware.vcloud.common.main.bootstrap.DirectlyConfigurableXmlApplicationContext.refresh(DirectlyConfigurableXmlApplicationContext.java:151)
at com.vmware.vcloud.common.main.ModuleRegistry$3.call(ModuleRegistry.java:90)
at com.vmware.vcloud.common.main.ModuleRegistry$3.call(ModuleRegistry.java:70)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:829)
Caused by: org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'sessionFilter': Unsatisfied dependency expressed through field 'filterUtils'; nested exception is org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'filterUtils': Unsatisfied dependency expressed through field 'securityService'; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'securityService': FactoryBean threw exception on object creation; nested exception is java.util.concurrent.TimeoutException: Timed out waiting for service: 'securityService', objectClasses='[interface com.vmware.vcloud.api.presentation.service.SecurityService]', filter='(objectClass=com.vmware.vcloud.api.presentation.service.SecurityService)'
at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor$AutowiredFieldElement.resolveFieldValue(AutowiredAnnotationBeanPostProcessor.java:660)
at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor$AutowiredFieldElement.inject(AutowiredAnnotationBeanPostProcessor.java:640)
at org.springframework.beans.factory.annotation.InjectionMetadata.inject(InjectionMetadata.java:119)
at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor.postProcessProperties(AutowiredAnnotationBeanPostProcessor.java:399)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.populateBean(AbstractAutowireCapableBeanFactory.java:1431)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:619)
at com.vmware.vcloud.common.main.bootstrap.DirectlyConfigurableXmlApplicationContext$LoggingBeanFactory.doCreateBean(DirectlyConfigurableXmlApplicationContext.java:54)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:542)
at org.springframework.beans.factory.support.AbstractBeanFactory.lambda$doGetBean$0(AbstractBeanFactory.java:335)
at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:234)
at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:333)
at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:208)
at org.springframework.beans.factory.config.DependencyDescriptor.resolveCandidate(DependencyDescriptor.java:276)
at org.springframework.beans.factory.support.DefaultListableBeanFactory.doResolveDependency(DefaultListableBeanFactory.java:1391)
at org.springframework.beans.factory.support.DefaultListableBeanFactory.resolveDependency(DefaultListableBeanFactory.java:1311)
at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor$AutowiredFieldElement.resolveFieldValue(AutowiredAnnotationBeanPostProcessor.java:657)
... 21 more
Caused by: org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'filterUtils': Unsatisfied dependency expressed through field 'securityService'; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'securityService': FactoryBean threw exception on object creation; nested exception is java.util.concurrent.TimeoutException: Timed out waiting for service: 'securityService', objectClasses='[interface com.vmware.vcloud.api.presentation.service.SecurityService]', filter='(objectClass=com.vmware.vcloud.api.presentation.service.SecurityService)'
at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor$AutowiredFieldElement.resolveFieldValue(AutowiredAnnotationBeanPostProcessor.java:660)
at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor$AutowiredFieldElement.inject(AutowiredAnnotationBeanPostProcessor.java:640)
at org.springframework.beans.factory.annotation.InjectionMetadata.inject(InjectionMetadata.java:119)
at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor.postProcessProperties(AutowiredAnnotationBeanPostProcessor.java:399)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.populateBean(AbstractAutowireCapableBeanFactory.java:1431)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:619)
at com.vmware.vcloud.common.main.bootstrap.DirectlyConfigurableXmlApplicationContext$LoggingBeanFactory.doCreateBean(DirectlyConfigurableXmlApplicationContext.java:54)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:542)
at org.springframework.beans.factory.support.AbstractBeanFactory.lambda$doGetBean$0(AbstractBeanFactory.java:335)
at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:234)
at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:333)
at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:208)
at org.springframework.beans.factory.config.DependencyDescriptor.resolveCandidate(DependencyDescriptor.java:276)
at org.springframework.beans.factory.support.DefaultListableBeanFactory.doResolveDependency(DefaultListableBeanFactory.java:1391)
at org.springframework.beans.factory.support.DefaultListableBeanFactory.resolveDependency(DefaultListableBeanFactory.java:1311)
at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor$AutowiredFieldElement.resolveFieldValue(AutowiredAnnotationBeanPostProcessor.java:657)
... 36 more
Caused by: org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'securityService': FactoryBean threw exception on object creation; nested exception is java.util.concurrent.TimeoutException: Timed out waiting for service: 'securityService', objectClasses='[interface com.vmware.vcloud.api.presentation.service.SecurityService]', filter='(objectClass=com.vmware.vcloud.api.presentation.service.SecurityService)'
at org.springframework.beans.factory.support.FactoryBeanRegistrySupport.doGetObjectFromFactoryBean(FactoryBeanRegistrySupport.java:176)
at org.springframework.beans.factory.support.FactoryBeanRegistrySupport.getObjectFromFactoryBean(FactoryBeanRegistrySupport.java:135)
at org.springframework.beans.factory.support.AbstractBeanFactory.getObjectForBeanInstance(AbstractBeanFactory.java:1898)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.getObjectForBeanInstance(AbstractAutowireCapableBeanFactory.java:1284)
at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:267)
at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:208)
at org.springframework.beans.factory.config.DependencyDescriptor.resolveCandidate(DependencyDescriptor.java:276)
at org.springframework.beans.factory.support.DefaultListableBeanFactory.addCandidateEntry(DefaultListableBeanFactory.java:1616)
at org.springframework.beans.factory.support.DefaultListableBeanFactory.findAutowireCandidates(DefaultListableBeanFactory.java:1573)
at org.springframework.beans.factory.support.DefaultListableBeanFactory.doResolveDependency(DefaultListableBeanFactory.java:1354)
at org.springframework.beans.factory.support.DefaultListableBeanFactory.resolveDependency(DefaultListableBeanFactory.java:1311)
at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor$AutowiredFieldElement.resolveFieldValue(AutowiredAnnotationBeanPostProcessor.java:657)
... 51 more
Caused by: java.util.concurrent.TimeoutException: Timed out waiting for service: 'securityService', objectClasses='[interface com.vmware.vcloud.api.presentation.service.SecurityService]', filter='(objectClass=com.vmware.vcloud.api.presentation.service.SecurityService)'
at com.vmware.vcloud.common.service.OsgiServiceReferenceFactoryBean.getObject(OsgiServiceReferenceFactoryBean.java:238)
at org.springframework.beans.factory.support.FactoryBeanRegistrySupport.doGetObjectFromFactoryBean(FactoryBeanRegistrySupport.java:169)
... 62 more
Original Message:
Sent: Apr 15, 2025 02:40 AM
From: AbbedSedkaoui
Subject: Configure-vcd script failed to complete
Hi, if VCD is deployed as small form factor, increasing the vCpus from 2 to 4 help the cell boot,
note the medium use 8 vCpus and that is the minimum for Production (i've seen it the 8 cores hardcoded on a file, but i don't remember where).
How to find out after setting 4 cores, SSH to VCD use "top" then "1" to show all cores
```
top -o +%CPU
```
the goal is validate 400% can be reached for the cell to boot
I guess the root cause maybe that message queueing is getting stuck at one point and then need extra CPU power cycles to empty the queues, this can take time..., certainly Engineering should know better the app, that just my guess.
Original Message:
Sent: Apr 12, 2025 12:36 PM
From: Martin Benitez
Subject: Configure-vcd script failed to complete
Hi , I have problems to start the cell. any idea? the cell was working find and them I Couldn't access any more.
2025-04-12 16:06:54,795 | DEBUG | HeartBeat-1 | CellManagerImpl | No change in the active cell list wast detected: [b6c3d684-af69-4225-b43d-816786c94876] |
2025-04-12 16:07:09,811 | DEBUG | HeartBeat-1 | CellManagerImpl | No change in the active cell list wast detected: [b6c3d684-af69-4225-b43d-816786c94876] |
2025-04-12 16:07:25,229 | DEBUG | HeartBeat-1 | CellManagerImpl | No change in the active cell list wast detected: [b6c3d684-af69-4225-b43d-816786c94876] |
2025-04-12 16:07:40,242 | DEBUG | HeartBeat-1 | CellManagerImpl | No change in the active cell list wast detected: [b6c3d684-af69-4225-b43d-816786c94876] |
2025-04-12 16:07:43,833 | DEBUG | Message Broker Topology Snapshotter | BrokerContext | Updated the last effective date of the latest topology state from 2022-12-15T17:14:53.467043Z |
2025-04-12 16:07:47,283 | DEBUG | Message Broker Topology Logger | BrokerContext |
defaultTopology=topology on Topology@6db41a7f[owner=ServerLocatorImpl [initialConnectors=[], discoveryGroupConfiguration=DiscoveryGroupConfiguration{name='vcd-discovery-group', refreshTimeout=10000, discoveryInitialWaitTimeout=1000}]]:
b6c3d684-af69-4225-b43d-816786c94876 => TopologyMember[id=b6c3d684-af69-4225-b43d-816786c94876, connector=Pair[a=TransportConfiguration(name=netty-connector, factory=org-apache-activemq-artemis-core-remoting-impl-netty-NettyConnectorFactory) ?port=61616&host=172-20-10-100, b=null], backupGroupName=null, scaleDownGroupName=null]
nodes=1 members=1,
-----------------------------------
vcd-cluster=topology on Topology@515fa565[owner=ClusterConnectionImpl@881116585[nodeUUID=b6c3d684-af69-4225-b43d-816786c94876, connector=TransportConfiguration(name=netty-connector, factory=org-apache-activemq-artemis-core-remoting-impl-netty-NettyConnectorFactory) ?port=61616&host=172-20-10-100, address=, server=ActiveMQServerImpl::name=b6c3d684-af69-4225-b43d-816786c94876]]:
b6c3d684-af69-4225-b43d-816786c94876 => TopologyMember[id=b6c3d684-af69-4225-b43d-816786c94876, connector=Pair[a=TransportConfiguration(name=netty-connector, factory=org-apache-activemq-artemis-core-remoting-impl-netty-NettyConnectorFactory) ?port=61616&host=172-20-10-100, b=null], backupGroupName=null, scaleDownGroupName=null]
nodes=1 members=1 |
2025-04-12 16:07:55,278 | DEBUG | HeartBeat-1 | CellManagerImpl | No change in the active cell list wast detected: [b6c3d684-af69-4225-b43d-816786c94876] |
2025-04-12 16:08:06,855 | WARN | Module: HTML5 Cell Application | DirectlyConfigurableXmlApplicationContext | 300,007 milliseconds creating bean: filterUtils; SLOW BEAN |
2025-04-12 16:08:06,856 | WARN | Module: HTML5 Cell Application | DirectlyConfigurableXmlApplicationContext | 300,012 milliseconds creating bean: sessionFilter; SLOW BEAN |
2025-04-12 16:08:06,856 | WARN | Module: HTML5 Cell Application | DirectlyConfigurableXmlApplicationContext | 326,437 milliseconds creating bean: vcdSecuredWebappConfiguration; SLOW BEAN |
2025-04-12 16:08:06,857 | WARN | Module: HTML5 Cell Application | DirectlyConfigurableXmlApplicationContext | Exception encountered during context initialization - cancelling refresh attempt: org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'vcdSecuredWebappConfiguration': Unsatisfied dependency expressed through field 'sessionFilter'; nested exception is org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'sessionFilter': Unsatisfied dependency expressed through field 'filterUtils'; nested exception is org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'filterUtils': Unsatisfied dependency expressed through field 'securityService'; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'securityService': FactoryBean threw exception on object creation; nested exception is java.util.concurrent.TimeoutException: Timed out waiting for service: 'securityService', objectClasses='[interface com.vmware.vcloud.api.presentation.service.SecurityService]', filter='(objectClass=com.vmware.vcloud.api.presentation.service.SecurityService)' |
2025-04-12 16:08:06,862 | FATAL | Module: HTML5 Cell Application | ModuleRegistry | Error in module: "HTML5 Cell Application"; Bean: vcdSecuredWebappConfiguration, Message: Error creating bean with name 'vcdSecuredWebappConfiguration': Unsatisfied dependency expressed through field 'sessionFilter'; nested exception is org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'sessionFilter': Unsatisfied dependency expressed through field 'filterUtils'; nested exception is org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'filterUtils': Unsatisfied dependency expressed through field 'securityService'; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'securityService': FactoryBean threw exception on object creation; nested exception is java.util.concurrent.TimeoutException: Timed out waiting for service: 'securityService', objectClasses='[interface com.vmware.vcloud.api.presentation.service.SecurityService]', filter='(objectClass=com.vmware.vcloud.api.presentation.service.SecurityService)' |
org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'vcdSecuredWebappConfiguration': Unsatisfied dependency expressed through field 'sessionFilter'; nested exception is org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'sessionFilter': Unsatisfied dependency expressed through field 'filterUtils'; nested exception is org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'filterUtils': Unsatisfied dependency expressed through field 'securityService'; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'securityService': FactoryBean threw exception on object creation; nested exception is java.util.concurrent.TimeoutException: Timed out waiting for service: 'securityService', objectClasses='[interface com.vmware.vcloud.api.presentation.service.SecurityService]', filter='(objectClass=com.vmware.vcloud.api.presentation.service.SecurityService)'
at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor$AutowiredFieldElement.resolveFieldValue(AutowiredAnnotationBeanPostProcessor.java:660)
at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor$AutowiredFieldElement.inject(AutowiredAnnotationBeanPostProcessor.java:640)
at org.springframework.beans.factory.annotation.InjectionMetadata.inject(InjectionMetadata.java:119)
at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor.postProcessProperties(AutowiredAnnotationBeanPostProcessor.java:399)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.populateBean(AbstractAutowireCapableBeanFactory.java:1431)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:619)
at com.vmware.vcloud.common.main.bootstrap.DirectlyConfigurableXmlApplicationContext$LoggingBeanFactory.doCreateBean(DirectlyConfigurableXmlApplicationContext.java:54)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:542)
at org.springframework.beans.factory.support.AbstractBeanFactory.lambda$doGetBean$0(AbstractBeanFactory.java:335)
at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:234)
at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:333)
at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:208)
at org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:955)
at org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:920)
at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:583)
at com.vmware.vcloud.common.main.bootstrap.DirectlyConfigurableXmlApplicationContext.refresh(DirectlyConfigurableXmlApplicationContext.java:151)
at com.vmware.vcloud.common.main.ModuleRegistry$3.call(ModuleRegistry.java:90)
at com.vmware.vcloud.common.main.ModuleRegistry$3.call(ModuleRegistry.java:70)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:829)
Caused by: org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'sessionFilter': Unsatisfied dependency expressed through field 'filterUtils'; nested exception is org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'filterUtils': Unsatisfied dependency expressed through field 'securityService'; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'securityService': FactoryBean threw exception on object creation; nested exception is java.util.concurrent.TimeoutException: Timed out waiting for service: 'securityService', objectClasses='[interface com.vmware.vcloud.api.presentation.service.SecurityService]', filter='(objectClass=com.vmware.vcloud.api.presentation.service.SecurityService)'
at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor$AutowiredFieldElement.resolveFieldValue(AutowiredAnnotationBeanPostProcessor.java:660)
at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor$AutowiredFieldElement.inject(AutowiredAnnotationBeanPostProcessor.java:640)
at org.springframework.beans.factory.annotation.InjectionMetadata.inject(InjectionMetadata.java:119)
at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor.postProcessProperties(AutowiredAnnotationBeanPostProcessor.java:399)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.populateBean(AbstractAutowireCapableBeanFactory.java:1431)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:619)
at com.vmware.vcloud.common.main.bootstrap.DirectlyConfigurableXmlApplicationContext$LoggingBeanFactory.doCreateBean(DirectlyConfigurableXmlApplicationContext.java:54)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:542)
at org.springframework.beans.factory.support.AbstractBeanFactory.lambda$doGetBean$0(AbstractBeanFactory.java:335)
at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:234)
at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:333)
at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:208)
at org.springframework.beans.factory.config.DependencyDescriptor.resolveCandidate(DependencyDescriptor.java:276)
at org.springframework.beans.factory.support.DefaultListableBeanFactory.doResolveDependency(DefaultListableBeanFactory.java:1391)
at org.springframework.beans.factory.support.DefaultListableBeanFactory.resolveDependency(DefaultListableBeanFactory.java:1311)
at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor$AutowiredFieldElement.resolveFieldValue(AutowiredAnnotationBeanPostProcessor.java:657)
... 21 more
Caused by: org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'filterUtils': Unsatisfied dependency expressed through field 'securityService'; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'securityService': FactoryBean threw exception on object creation; nested exception is java.util.concurrent.TimeoutException: Timed out waiting for service: 'securityService', objectClasses='[interface com.vmware.vcloud.api.presentation.service.SecurityService]', filter='(objectClass=com.vmware.vcloud.api.presentation.service.SecurityService)'
at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor$AutowiredFieldElement.resolveFieldValue(AutowiredAnnotationBeanPostProcessor.java:660)
at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor$AutowiredFieldElement.inject(AutowiredAnnotationBeanPostProcessor.java:640)
at org.springframework.beans.factory.annotation.InjectionMetadata.inject(InjectionMetadata.java:119)
at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor.postProcessProperties(AutowiredAnnotationBeanPostProcessor.java:399)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.populateBean(AbstractAutowireCapableBeanFactory.java:1431)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:619)
at com.vmware.vcloud.common.main.bootstrap.DirectlyConfigurableXmlApplicationContext$LoggingBeanFactory.doCreateBean(DirectlyConfigurableXmlApplicationContext.java:54)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:542)
at org.springframework.beans.factory.support.AbstractBeanFactory.lambda$doGetBean$0(AbstractBeanFactory.java:335)
at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:234)
at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:333)
at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:208)
at org.springframework.beans.factory.config.DependencyDescriptor.resolveCandidate(DependencyDescriptor.java:276)
at org.springframework.beans.factory.support.DefaultListableBeanFactory.doResolveDependency(DefaultListableBeanFactory.java:1391)
at org.springframework.beans.factory.support.DefaultListableBeanFactory.resolveDependency(DefaultListableBeanFactory.java:1311)
at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor$AutowiredFieldElement.resolveFieldValue(AutowiredAnnotationBeanPostProcessor.java:657)
... 36 more
Caused by: org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'securityService': FactoryBean threw exception on object creation; nested exception is java.util.concurrent.TimeoutException: Timed out waiting for service: 'securityService', objectClasses='[interface com.vmware.vcloud.api.presentation.service.SecurityService]', filter='(objectClass=com.vmware.vcloud.api.presentation.service.SecurityService)'
at org.springframework.beans.factory.support.FactoryBeanRegistrySupport.doGetObjectFromFactoryBean(FactoryBeanRegistrySupport.java:176)
at org.springframework.beans.factory.support.FactoryBeanRegistrySupport.getObjectFromFactoryBean(FactoryBeanRegistrySupport.java:135)
at org.springframework.beans.factory.support.AbstractBeanFactory.getObjectForBeanInstance(AbstractBeanFactory.java:1898)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.getObjectForBeanInstance(AbstractAutowireCapableBeanFactory.java:1284)
at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:267)
at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:208)
at org.springframework.beans.factory.config.DependencyDescriptor.resolveCandidate(DependencyDescriptor.java:276)
at org.springframework.beans.factory.support.DefaultListableBeanFactory.addCandidateEntry(DefaultListableBeanFactory.java:1616)
at org.springframework.beans.factory.support.DefaultListableBeanFactory.findAutowireCandidates(DefaultListableBeanFactory.java:1573)
at org.springframework.beans.factory.support.DefaultListableBeanFactory.doResolveDependency(DefaultListableBeanFactory.java:1354)
at org.springframework.beans.factory.support.DefaultListableBeanFactory.resolveDependency(DefaultListableBeanFactory.java:1311)
at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor$AutowiredFieldElement.resolveFieldValue(AutowiredAnnotationBeanPostProcessor.java:657)
... 51 more
Caused by: java.util.concurrent.TimeoutException: Timed out waiting for service: 'securityService', objectClasses='[interface com.vmware.vcloud.api.presentation.service.SecurityService]', filter='(objectClass=com.vmware.vcloud.api.presentation.service.SecurityService)'
at com.vmware.vcloud.common.service.OsgiServiceReferenceFactoryBean.getObject(OsgiServiceReferenceFactoryBean.java:238)
at org.springframework.beans.factory.support.FactoryBeanRegistrySupport.doGetObjectFromFactoryBean(FactoryBeanRegistrySupport.java:169)
... 62 more
Original Message:
Sent: Sep 25, 2022 05:19 PM
From: AbbedSedkaoui
Subject: Configure-vcd script failed to complete
Hi all,
we all have in the /opt/vmware/vcloud-director/logs/cell-management-tool.log the following error:
ERROR | main | ReconfigureDatabaseCommand | Invalid database configuration: SSL error: PKIX path buildi
ng failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target |
org.postgresql.util.PSQLException: SSL error: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid cer
tification path to requested target
Please confirm that you have "Timed out" in your appliance-sync.log when adding the certificate node
cat /opt/vmware/var/log/vcd/appliance-sync.log | grep Timed
Timed out adding certificate for node node-35184bba-f181-469d-be92-ebb45ff6727d, continuing to other nodes.
i found a way to complete the setup successfully with cluster HEALTHY and services running.
the trick was the import from my NFS share (windows) into vcd appliance may take longer than 10seconds, i gave it 60.
sed -i s/10s/60s/ /opt/vmware/appliance/bin/appliance-sync.sh
resulted line should be:
cat /opt/vmware/appliance/bin/appliance-sync.sh | grep force
/usr/bin/timeout 60s $VCLOUD_HOME/bin/cell-management-tool import-trusted-certificates --source $APPLIANCE_SHARE/$i/vcd_ova.crt --force
then try again completing the setup, while watching the log i confirmed that the operation took more than 10s , here nearly 30s in my environment.
tail -f /opt/vmware/var/log/vcd/configure-vcd.log
"
Reconfiguring vCD to use a secure database connection.
2022-09-25 18:36:29 | setupvcd.sh | Reconfiguring vCD to use a secure database connection.
Database configuration in properties files complete for local cell.
Database configuration was successfully refreshed in running Cell.
2022-09-25 18:36:57 | configure-vcd.sh | Invoking cellstartup script.
"
the setup complete successfully,
then revert back the original setting
sed -i s/60s/10s/ /opt/vmware/appliance/bin/appliance-sync.sh
systemctl restart appliance-sync.timer
Shutdown/Power on the VM, do not use Restart
Increase vCPUs from 2 to 4. (Updated)
wait few minutes for the vcd appliance to fully load before opening http://{VCD_IP}/provider
Let me know if this hasn't worked for you.
cheers
Abidi