DX Unified Infrastructure Management

 View Only
Expand all | Collapse all

UMP > USM Group Manipulation Errors out

  • 1.  UMP > USM Group Manipulation Errors out

    Posted Jul 20, 2020 11:51 AM
    Seems I cannot do anything in the UMP today for some reason. No matter what usm group I try to modify, create new, update existing it just keeps error-ing out.

    I already cycled the UMP box and get the same thing now.

    Getting:

    An unknown error has occurred.An unknown error has occurred.Refreshing your browser may resolve the issue.
    An unknown error has occurred.
    Refreshing your browser may resolve the issue.
    Details:
    com.firehunter.ump.exceptions.DataFactoryException : null
    Please check the log for more information.
    Stack Trace:
    java.lang.NullPointerException

    The wasp.log is just filled with java-exception entries.

    Any ideas?

    ------------------------------
    Daniel Blanco
    Enterprise Tools Team Architect
    DBlanco@alphaserveit.com
    ------------------------------


  • 2.  RE: UMP > USM Group Manipulation Errors out

    Posted Jul 20, 2020 11:58 AM
    deactivate 
    ump wasp
    primary hub wasp & ems 
    then activate in reverse order

    ------------------------------
    Support Engineer
    Broadcom
    ------------------------------



  • 3.  RE: UMP > USM Group Manipulation Errors out

    Posted Jul 20, 2020 12:00 PM
    Okay dug further and its only broken if I try to modify, create, update any USM Group that is part of an "Account"

    If I leave the "Account" field "No Account" it works but when I change it to a client account everything is now broken.


    ------------------------------
    Daniel Blanco
    Enterprise Tools Team Architect
    DBlanco@alphaserveit.com
    ------------------------------



  • 4.  RE: UMP > USM Group Manipulation Errors out

    Posted Jul 20, 2020 12:17 PM
    check the portal log in the ump wasp folder

    ------------------------------
    Support Engineer
    Broadcom
    ------------------------------



  • 5.  RE: UMP > USM Group Manipulation Errors out

    Posted Jul 20, 2020 12:23 PM
    Hi Dave,
    So I tried your cycle steps, cleared out logs then started it all up in reverse order. Still same issue.
    In portal.log I have:
    20 Jul 2020 12:20:09,051 ERROR [DataFactoryException:107] java.lang.NullPointerException__ at com.ca.service.elements.ElementService.isVisibleForAccount(ElementService.java:165)__ at com.ca.service.elements.ElementService.lambda$1(ElementService.java:152)__ at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:174)__ at java.util.HashMap$KeySpliterator.forEachRemaining(HashMap.java:1556)__ at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)__ at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)__ at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)__ at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)__ at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:499)__ at com.ca.service.elements.ElementService.filterElementsByAccountId_aroundBody10(ElementService.java:153)__ at com.ca.service.elements.ElementService$AjcClosure11.run(ElementService.java:1)__ at org.aspectj.runtime.reflect.JoinPointImpl.proceed(JoinPointImpl.java:149)__ at com.ca.service.util.aspect.DebuggerAspect.onDebugAnnotation(DebuggerAspect.java:79)__ at com.ca.service.elements.ElementService.filterElementsByAccountId(ElementService.java:148)__ at com.ca.grouping.service.LocalGroupService.getFilterElements(LocalGroupService.java:863)__ at com.ca.grouping.service.LocalGroupService.getSearchElements_aroundBody30(LocalGroupService.java:839)__ at com.ca.grouping.service.LocalGroupService$AjcClosure31.run(LocalGroupService.java:1)__ at org.aspectj.runtime.reflect.JoinPointImpl.proceed(JoinPointImpl.java:149)__ at com.ca.service.util.aspect.DebuggerAspect.onDebugAnnotation(DebuggerAspect.java:79)__ at com.ca.grouping.service.LocalGroupService.getSearchElements(LocalGroupService.java:837)__ at com.firehunter.usm.DataFactory.getPossibleSystemMembers(DataFactory.java:6069)__ at com.firehunter.usm.DataFactory.checkFilters(DataFactory.java:5449)__ at com.firehunter.usm.DataFactory.checkFilters(DataFactory.java:5397)__ at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)__ at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)__ at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)__ at java.lang.reflect.Method.invoke(Method.java:498)__ at flex.messaging.services.remoting.adapters.JavaAdapter.invoke(JavaAdapter.java:418)__ at flex.messaging.services.RemotingService.serviceMessage(RemotingService.java:183)__ at flex.messaging.MessageBroker.routeMessageToService(MessageBroker.java:1400)__ at flex.messaging.endpoints.AbstractEndpoint.serviceMessage(AbstractEndpoint.java:1005)__ at flex.messaging.endpoints.amf.MessageBrokerFilter.invoke(MessageBrokerFilter.java:103)__ at flex.messaging.endpoints.amf.LegacyFilter.invoke(LegacyFilter.java:158)__ at flex.messaging.endpoints.amf.SessionFilter.invoke(SessionFilter.java:44)__ at flex.messaging.endpoints.amf.BatchProcessFilter.invoke(BatchProcessFilter.java:67)__ at flex.messaging.endpoints.amf.SerializationFilter.invoke(SerializationFilter.java:166)__ at flex.messaging.endpoints.BaseHTTPEndpoint.service(BaseHTTPEndpoint.java:291)__ at flex.messaging.MessageBrokerServlet.service(MessageBrokerServlet.java:353)__ at javax.servlet.http.HttpServlet.service(HttpServlet.java:741)__ at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:231)__ at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)__ at com.liferay.portal.kernel.servlet.filters.invoker.ResponseHeaderFilter.doFilter(ResponseHeaderFilter.java:31)__ at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)__ at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)__ at com.firehunter.ump.auth.InvalidHttpSessionFilter.doFilter(InvalidHttpSessionFilter.java:29)__ at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)__ at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)__ at com.liferay.portal.kernel.servlet.filters.invoker.InvokerFilterChain.doFilter(InvokerFilterChain.java:73)__ at com.liferay.portal.kernel.servlet.filters.invoker.InvokerFilterChain.doFilter(InvokerFilterChain.java:117)__ at sun.reflect.GeneratedMethodAccessor593.invoke(Unknown Source)__ at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)__ at java.lang.reflect.Method.invoke(Method.java:498)__ at com.liferay.portal.kernel.bean.ClassLoaderBeanHandler.invoke(ClassLoaderBeanHandler.java:67)__ at com.sun.proxy.$Proxy1135.doFilter(Unknown Source)__ at com.liferay.portal.kernel.servlet.filters.invoker.InvokerFilterChain.doFilter(InvokerFilterChain.java:73)__ at com.liferay.portal.kernel.servlet.filters.invoker.InvokerFilterChain.processDirectCallFilter(InvokerFilterChain.java:168)__ at com.liferay.portal.kernel.servlet.filters.invoker.InvokerFilterChain.doFilter(InvokerFilterChain.java:96)__ at com.liferay.portal.kernel.servlet.PortalClassLoaderFilter.doFilter(PortalClassLoaderFilter.java:74)__ at com.liferay.portal.kernel.servlet.filters.invoker.InvokerFilterChain.processDoFilter(InvokerFilterChain.java:207)__ at com.liferay.portal.kernel.servlet.filters.invoker.InvokerFilterChain.doFilter(InvokerFilterChain.java:109)__ at com.liferay.portal.kernel.servlet.filters.invoker.InvokerFilter.doFilter(InvokerFilter.java:108)__ at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)__ at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)__ at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:200)__ at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:96)__ at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:490)__ at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:139)__ at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:92)__ at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:74)__ at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:343)__ at org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:408)__ at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:66)__ at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:834)__ at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1415)__ at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49)__ at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)__ at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)__ at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)__ at java.lang.Thread.run(Thread.java:748)__ [Sanitized]


    ------------------------------
    Daniel Blanco
    Enterprise Tools Team Architect
    DBlanco@alphaserveit.com
    ------------------------------



  • 6.  RE: UMP > USM Group Manipulation Errors out

    Posted Jul 20, 2020 12:56 PM
      |   view attached
    Portal.log file.

    ------------------------------
    Daniel Blanco
    Enterprise Tools Team Architect
    DBlanco@alphaserveit.com
    ------------------------------

    Attachment(s)

    log
    portal.log   577 KB 1 version


  • 7.  RE: UMP > USM Group Manipulation Errors out

    Posted Jul 20, 2020 01:23 PM
    yeah this is in the other direction so restart of ems wasn't going to help. 
    Also didn't find anything helpful so let's go after:

    deactivate wasp at the ump robot
    rename these folders:
    $\Nimsoft\probes\service\wasp\work
    $\Nimsoft\probes\service\wasp\webapps\ROOT
    C:\Windows\Temp\liferay OR the /tmp folder on unix
    activate wasp

    login to UMP
    at the upper right corner select Go To > Control Panel > Server > Server Administration

    click Execute for:
    Run the garbage collector to free up memory.
    Clear content cached by this VM.
    Clear the database cache.
    Reindex all search indexes.
    Clean Up Permissions

    ------------------------------
    Support Engineer
    Broadcom
    ------------------------------



  • 8.  RE: UMP > USM Group Manipulation Errors out

    Posted Jul 20, 2020 02:36 PM
    Just tried this and now my ump wasp doesn't start turns red.
    Jul 20 14:27:41:834 ERROR [Catalina-utility-1, org.apache.catalina.core.ContainerBase] startInternal() A child container failed during startJul 20 14:27:41:834 ERROR [Catalina-utility-1, org.apache.catalina.core.ContainerBase] startInternal() A child container failed during startJul 20 14:27:41:834 ERROR [Catalina-utility-1, org.apache.catalina.core.ContainerBase] java.util.concurrent.ExecutionException: org.apache.catalina.LifecycleException: Failed to start component [org.apache.catalina.webresources.StandardRoot@18f834c6] at java.util.concurrent.FutureTask.report(FutureTask.java:122) at java.util.concurrent.FutureTask.get(FutureTask.java:192) at org.apache.catalina.core.ContainerBase.startInternal(ContainerBase.java:909) at org.apache.catalina.core.StandardHost.startInternal(StandardHost.java:831) at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:183) at org.apache.catalina.core.ContainerBase$StartChild.call(ContainerBase.java:1377) at org.apache.catalina.core.ContainerBase$StartChild.call(ContainerBase.java:1367) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.lang.Thread.run(Thread.java:748)Caused by: org.apache.catalina.LifecycleException: Failed to start component [org.apache.catalina.webresources.StandardRoot@18f834c6] at org.apache.catalina.util.LifecycleBase.handleSubClassException(LifecycleBase.java:441) at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:198) at org.apache.catalina.core.StandardContext.resourcesStart(StandardContext.java:4783) at org.apache.catalina.core.StandardContext.startInternal(StandardContext.java:4918) at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:183) at org.apache.catalina.core.ContainerBase$StartChild.call(ContainerBase.java:1377) at org.apache.catalina.core.ContainerBase$StartChild.call(ContainerBase.java:1367) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.tomcat.util.threads.InlineExecutorService.execute(InlineExecutorService.java:75) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:134) at org.apache.catalina.core.ContainerBase.startInternal(ContainerBase.java:902) ... 11 moreCaused by: java.lang.IllegalArgumentException: The main resource set specified [C:\Program Files (x86)\Nimsoft\probes\service\wasp\webapps\ROOT] is not valid at org.apache.catalina.webresources.StandardRoot.createMainResourceSet(StandardRoot.java:749) at org.apache.catalina.webresources.StandardRoot.startInternal(StandardRoot.java:706) at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:183) ... 20 more


    ------------------------------
    Daniel Blanco
    Enterprise Tools Team Architect
    DBlanco@alphaserveit.com
    ------------------------------



  • 9.  RE: UMP > USM Group Manipulation Errors out

    Posted Jul 20, 2020 02:46 PM
    Okay stopped the robot service then renamed the 'webapps.DELETE' back to webapps folder and now it started up. Note to future self, DO NOT TOUCH THIS FOLDER.

    ------------------------------
    Daniel Blanco
    Enterprise Tools Team Architect
    DBlanco@alphaserveit.com
    ------------------------------



  • 10.  RE: UMP > USM Group Manipulation Errors out

    Posted Jul 20, 2020 03:03 PM
    it's just \webapps\ROOT



    ------------------------------
    Support Engineer
    Broadcom
    ------------------------------



  • 11.  RE: UMP > USM Group Manipulation Errors out

    Posted Jul 20, 2020 03:18 PM
    Anyway after doing all the steps above, the clean up it still doesn't work on "Account" related USM groups. If I leave it "no account" then it works but any folders under a Clients Container > USM Group its now broken. 

    Anyone else have this issue? 

    1. Go into the AccountAdmin portlet and create an Account. 
    2. Go into USM create a new Container Group and select for the "Account" you created step 1. 
    3. Then select that container and create a sub group. I did a Dynamic group and Bus Type is "Robot" 
    When I hit apply I am getting:

    But I can create a new group if Account is "no Account"




    ------------------------------
    Daniel Blanco
    Enterprise Tools Team Architect
    DBlanco@alphaserveit.com
    ------------------------------



  • 12.  RE: UMP > USM Group Manipulation Errors out

    Posted Jul 20, 2020 05:10 PM
    First FYI for worst case in regards to the webapps folder. 
    Use a zip tool to manually extract all the .war files. 

    Second tested this in my 9.0.2 lab and it worked fine. 

    Third could find no prior cases so don't have a history to work from. 

    Fourth seems most likely it is related to 'ElementService.isVisibleForAccount' 
    Just what isVisibleForAccount is telling us is uncertain. 
    Test it with a newly created account. 
    If that still fails, do some testing with the user account you are logged in under. 


    ------------------------------
    Support Engineer
    Broadcom
    ------------------------------



  • 13.  RE: UMP > USM Group Manipulation Errors out

    Posted Jul 21, 2020 12:05 PM
    Hi Dave,
    Thanks tried all that and everyone has this issue. I tried on a new Account I setup and have the same problem. I asked all members of team and they have the issue as well. 
    Any ideas left?

    ------------------------------
    Daniel Blanco
    Enterprise Tools Team Architect
    DBlanco@alphaserveit.com
    ------------------------------



  • 14.  RE: UMP > USM Group Manipulation Errors out

    Broadcom Employee
    Posted Jul 21, 2020 12:39 PM
    Hi Daniel,

    Not sure if you have tried or are avoiding a Primary hub robot restart. I have had odd UMP warnings like you are seeing be magically fixed, if you have not restarted PH. Set hub probe log to 5 and maybe higher on DE. A security and DE refresh connection may be just the thing...again unless you already tried. I know it wont get you root cause.


  • 15.  RE: UMP > USM Group Manipulation Errors out

    Posted Jul 21, 2020 12:56 PM
    Dan, sorry really backed up with cases and not sure if there will be any time available today.

    ------------------------------
    Support Engineer
    Broadcom
    ------------------------------



  • 16.  RE: UMP > USM Group Manipulation Errors out

    Posted Jul 22, 2020 01:21 PM
    Agree with Gregg restarting things, communication could just be broken someplace.

    ------------------------------
    Support Engineer
    Broadcom
    ------------------------------



  • 17.  RE: UMP > USM Group Manipulation Errors out

    Posted Jul 30, 2020 09:58 AM
    Okay finally got around to doing a full STOP, START on UIM boxes and issues still persists. Same exact issue. Open a case?

    ------------------------------
    Daniel Blanco
    Enterprise Tools Team Architect
    DBlanco@alphaserveit.com
    ------------------------------



  • 18.  RE: UMP > USM Group Manipulation Errors out

    Broadcom Employee
    Posted Jul 30, 2020 10:01 AM
    groups are controlled by the nis_server.
    check your loglevel 5 nis_server logs for errors or problems.

    ------------------------------
    Gene Howard
    Principal Support Engineer
    Broadcom
    ------------------------------



  • 19.  RE: UMP > USM Group Manipulation Errors out

    Posted Jul 30, 2020 01:13 PM
    Hi Gene,
    So did full stop, cleared log set to level 5 and restarted. 
    1st Error entry has this: 
    Jul 30 13:07:00:979 ERROR [pool-1-thread-1, com.ca.grouping.maintenance.dynamic.DynamicGroupHandler] Failed to update group: EZE App Boxes (602)Jul 30 13:07:00:979 ERROR [pool-1-thread-1, com.ca.grouping.maintenance.dynamic.DynamicGroupHandler] Failed to update group: EZE App Boxes (602)Jul 30 13:07:00:980 ERROR [pool-1-thread-1, com.ca.grouping.maintenance.dynamic.DynamicGroupHandler] java.lang.NullPointerException at com.ca.service.elements.ElementService.isVisibleForAccount(ElementService.java:165) at com.ca.service.elements.ElementService.lambda$1(ElementService.java:152) at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:174) at java.util.HashMap$KeySpliterator.forEachRemaining(HashMap.java:1556) at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482) at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472) at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708) at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:499) at com.ca.service.elements.ElementService.filterElementsByAccountId_aroundBody10(ElementService.java:153) at com.ca.service.elements.ElementService$AjcClosure11.run(ElementService.java:1) at org.aspectj.runtime.reflect.JoinPointImpl.proceed(JoinPointImpl.java:149) at com.ca.service.util.aspect.DebuggerAspect.onDebugAnnotation(DebuggerAspect.java:79) at com.ca.service.elements.ElementService.filterElementsByAccountId(ElementService.java:148) at com.ca.grouping.service.LocalGroupService.getFilterElements(LocalGroupService.java:863) at com.ca.grouping.service.LocalGroupService.evaluateGroupMembership(LocalGroupService.java:1434) at com.ca.grouping.maintenance.dynamic.DynamicGroupHandler.updateDynamicGroups(DynamicGroupHandler.java:62) at com.ca.grouping.maintenance.GroupMaintenanceHandler.maintainDynamicAndAutomaticGroups(GroupMaintenanceHandler.java:140) at com.ca.grouping.maintenance.GroupMaintenanceHandler.run(GroupMaintenanceHandler.java:98) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748)

    Next entry:
    Jul 30 13:07:00:996 ERROR [pool-1-thread-1, com.ca.grouping.maintenance.dynamic.DynamicGroupHandler] Failed to update group: Inventory (523)Jul 30 13:07:00:996 ERROR [pool-1-thread-1, com.ca.grouping.maintenance.dynamic.DynamicGroupHandler] Failed to update group: Inventory (523)Jul 30 13:07:00:997 ERROR [pool-1-thread-1, com.ca.grouping.maintenance.dynamic.DynamicGroupHandler] java.lang.NullPointerException at com.ca.service.elements.ElementService.isVisibleForAccount(ElementService.java:165) at com.ca.service.elements.ElementService.lambda$1(ElementService.java:152) at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:174) at java.util.HashMap$KeySpliterator.forEachRemaining(HashMap.java:1556)



    All of them have this:
    at com.ca.service.elements.ElementService.isVisibleForAccount(ElementService.java:165) at com.ca.service.elements.ElementService.isVisibleForAccount(ElementService.java:165)

    What ever that means...



    ------------------------------
    Daniel Blanco
    Enterprise Tools Team Architect
    DBlanco@alphaserveit.com
    ------------------------------



  • 20.  RE: UMP > USM Group Manipulation Errors out

    Broadcom Employee
    Posted Jul 30, 2020 02:13 PM
    this looks like a data issue.
    I would go look at the cm_group table.
    check the last couple of entries.
    There is probably a problem with one of them.
    Support would usually suggest trying to delete the last couple of lines from the group's tables to see if it makes a difference.
    Make sure you still have a root entry.



    ------------------------------
    Gene Howard
    Principal Support Engineer
    Broadcom
    ------------------------------



  • 21.  RE: UMP > USM Group Manipulation Errors out

    Posted Jul 31, 2020 10:58 AM
    Hi Gene, so I'm looking at the entire CM_GROUP table and it 'looks' fine. I can't attach the CM_GROUP here as it contains all client names so sending via email. If you see anything please let me know but I think might need a support case here.


    ------------------------------
    Daniel Blanco
    Enterprise Tools Team Architect
    DBlanco@alphaserveit.com
    ------------------------------



  • 22.  RE: UMP > USM Group Manipulation Errors out

    Posted Jul 31, 2020 11:19 AM
    expand to cm_group_account and cm_account. 
    also the usm groups is flash so the ctrl + / for debug does work.

    ------------------------------
    Support Engineer
    Broadcom
    ------------------------------



  • 23.  RE: UMP > USM Group Manipulation Errors out

    Posted Jul 31, 2020 12:04 PM
    Hi Dave,
    resent sql tables.. with more tables included.
    Also I think I enabled debug in the flash component and now when error happens I have this:
    An unknown error has occurred.
    Refreshing your browser may resolve the issue.
    Details:
    com.firehunter.ump.exceptions.DataFactoryException : null
    Info:
    Method: checkFilters(Boolean: false, Integer: 1501, String: {"subCriteria":[{"attribute":"user_tag_1","value":["SOC"],"filterOperator":"CONTAINS","isCsFilter":true,"negated":false}],"isCsFilter":true,"criteriaOperator":"AND"}, String: , Integer: 151)
    Method: getMembers(Integer: 1501, Integer: 151)
    Method: getOriginsForGroupId(Integer: 1501)
    Query NJxV
    SELECT cao.origin FROM cm_account_ownership cao, cm_account_group cag
    WHERE cao.account_id = cag.account_id
    AND cag.grp_id = '1501'


    Query NJxV took: 0.002s
    Method: getShellCreds()
    Method: getCreds(String: select shell_id, description, description_token from CM_SHELL_AUTHENTICATION, String: shell_id)
    Query GCqO
    select shell_id, description, description_token from CM_SHELL_AUTHENTICATION

    Query GCqO took: 0.002s
    Method: getWmiCreds()
    Method: getCreds(String: select wmi_id, description, description_token from CM_WMI_AUTHENTICATION, String: wmi_id)
    Query cYMk
    select wmi_id, description, description_token from CM_WMI_AUTHENTICATION

    Query cYMk took: 0.0s
    --> LocalGroupService.getElementsForGroup:230(String: 1501, String: 151)
    --> LocalGroupService.getGroupElements:164(String: 1501, String: 151)
    --> LocalGroupService.getGroupInfo:508(String: 1501, String: 151)
    Query BxlJ
    SELECT g.grp_id,
    g.pgrp_id,
    g.name,
    g.description,
    g.grp_type,
    ag.account_id,
    g.criteria,
    g.master_element_group,
    g.name_token,
    g.description_token,
    g.last_update,
    g.active,
    g.priority,
    gpc.id AS configId,
    gpc.version AS configVersion,
    gpc.name AS configName,
    gpc.description AS configDescription,
    ap.auto_parent
    FROM cm_group g
    LEFT JOIN
    cm_account_group ag ON ag.grp_id = g.grp_id
    LEFT JOIN
    cm_group_preconfigured gpc ON gpc.grp_id = g.grp_id
    LEFT JOIN
    ( SELECT DISTINCT g.pgrp_id AS auto_parent
    FROM cm_group_automatic_result gar
    LEFT JOIN
    cm_group g ON g.grp_id = gar.grp_id ) ap ON ap.auto_parent = g.grp_id
    WHERE ( g.grp_id IN ( 1501 ) )
    AND ag.account_id = '151'


    Query BxlJ took: 0.0s
    <- LocalGroupService.getGroupInfo:508 took 0.00s
    --> LocalGroupService.getGroupElements:179(Group: Group{name='SOC Boxes', description='', type=DYNAMIC}, String: 151)
    Query xthF
    SELECT gme.grp_id,
    gme.cs_id AS member_id
    FROM cm_group_member gme
    JOIN cm_account_group ag ON ag.grp_id = gme.grp_id AND ag.account_id = '151'
    WHERE gme.grp_id = '1501'


    Query xthF took: 0.0s
    <- LocalGroupService.getGroupElements:179 took 0.00s
    <- LocalGroupService.getGroupElements:164 took 0.01s
    <- LocalGroupService.getElementsForGroup:230 took 0.01s
    Method: getPossibleSystemMembers(Integer: 1501, Criteria: (cs.user_tag_1 CONTAINS 'SOC'), Integer: 151)
    Method: getShellCreds()
    Method: getCreds(String: select shell_id, description, description_token from CM_SHELL_AUTHENTICATION, String: shell_id)
    Query miWu
    select shell_id, description, description_token from CM_SHELL_AUTHENTICATION

    Query miWu took: 0.004s
    Method: getWmiCreds()
    Method: getCreds(String: select wmi_id, description, description_token from CM_WMI_AUTHENTICATION, String: wmi_id)
    Query cYMk
    select wmi_id, description, description_token from CM_WMI_AUTHENTICATION

    Query cYMk took: 0.001s
    Method: checkFilters(Boolean: false, Integer: 1501, String: {"subCriteria":[{"attribute":"user_tag_1","value":["SOC"],"filterOperator":"CONTAINS","isCsFilter":true,"negated":false}],"isCsFilter":true,"criteriaOperator":"AND"}, String: , Integer: 151)
    Method: getMembers(Integer: 1501, Integer: 151)
    Method: getOriginsForGroupId(Integer: 1501)
    Query NJxV
    SELECT cao.origin FROM cm_account_ownership cao, cm_account_group cag
    WHERE cao.account_id = cag.account_id
    AND cag.grp_id = '1501'


    Query NJxV took: 0.002s
    Method: getShellCreds()
    Method: getCreds(String: select shell_id, description, description_token from CM_SHELL_AUTHENTICATION, String: shell_id)
    Query GCqO
    select shell_id, description, description_token from CM_SHELL_AUTHENTICATION

    Query GCqO took: 0.002s
    Method: getWmiCreds()
    Method: getCreds(String: select wmi_id, description, description_token from CM_WMI_AUTHENTICATION, String: wmi_id)
    Query cYMk
    select wmi_id, description, description_token from CM_WMI_AUTHENTICATION

    Query cYMk took: 0.0s
    --> LocalGroupService.getElementsForGroup:230(String: 1501, String: 151)
    --> LocalGroupService.getGroupElements:164(String: 1501, String: 151)
    --> LocalGroupService.getGroupInfo:508(String: 1501, String: 151)
    Query BxlJ
    SELECT g.grp_id,
    g.pgrp_id,
    g.name,
    g.description,
    g.grp_type,
    ag.account_id,
    g.criteria,
    g.master_element_group,
    g.name_token,
    g.description_token,
    g.last_update,
    g.active,
    g.priority,
    gpc.id AS configId,
    gpc.version AS configVersion,
    gpc.name AS configName,
    gpc.description AS configDescription,
    ap.auto_parent
    FROM cm_group g
    LEFT JOIN
    cm_account_group ag ON ag.grp_id = g.grp_id
    LEFT JOIN
    cm_group_preconfigured gpc ON gpc.grp_id = g.grp_id
    LEFT JOIN
    ( SELECT DISTINCT g.pgrp_id AS auto_parent
    FROM cm_group_automatic_result gar
    LEFT JOIN
    cm_group g ON g.grp_id = gar.grp_id ) ap ON ap.auto_parent = g.grp_id
    WHERE ( g.grp_id IN ( 1501 ) )
    AND ag.account_id = '151'


    Query BxlJ took: 0.0s
    <- LocalGroupService.getGroupInfo:508 took 0.00s
    --> LocalGroupService.getGroupElements:179(Group: Group{name='SOC Boxes', description='', type=DYNAMIC}, String: 151)
    Query xthF
    SELECT gme.grp_id,
    gme.cs_id AS member_id
    FROM cm_group_member gme
    JOIN cm_account_group ag ON ag.grp_id = gme.grp_id AND ag.account_id = '151'
    WHERE gme.grp_id = '1501'


    Query xthF took: 0.0s
    <- LocalGroupService.getGroupElements:179 took 0.00s
    <- LocalGroupService.getGroupElements:164 took 0.01s
    <- LocalGroupService.getElementsForGroup:230 took 0.01s
    Method: getPossibleSystemMembers(Integer: 1501, Criteria: (cs.user_tag_1 CONTAINS 'SOC'), Integer: 151)
    Method: getShellCreds()
    Method: getCreds(String: select shell_id, description, description_token from CM_SHELL_AUTHENTICATION, String: shell_id)
    Query miWu
    select shell_id, description, description_token from CM_SHELL_AUTHENTICATION

    Query miWu took: 0.004s
    Method: getWmiCreds()
    Method: getCreds(String: select wmi_id, description, description_token from CM_WMI_AUTHENTICATION, String: wmi_id)
    Query cYMk
    select wmi_id, description, description_token from CM_WMI_AUTHENTICATION

    Query cYMk took: 0.001s
    Method: getPossibleSystemMembers took 0.03s

    Stack Trace:
    java.lang.NullPointerException


    ------------------------------
    Daniel Blanco
    Enterprise Tools Team Architect
    DBlanco@alphaserveit.com
    ------------------------------



  • 24.  RE: UMP > USM Group Manipulation Errors out

    Posted Jul 31, 2020 12:13 PM
    OK so you got the queries, copy from SELECT down to the empty space indicating the end of that query and run them in MS SQL Studio. 
    Hopefully one will provide something helpful in tracking down the root cause. 


    ------------------------------
    Support Engineer
    Broadcom
    ------------------------------



  • 25.  RE: UMP > USM Group Manipulation Errors out

    Posted Jul 31, 2020 12:39 PM
    Hi Dave, so I copied out every single select query and they all worked just fine:

    And yet in browser still get the same error pop up.

    ------------------------------
    Daniel Blanco
    Enterprise Tools Team Architect
    DBlanco@alphaserveit.com
    ------------------------------



  • 26.  RE: UMP > USM Group Manipulation Errors out

    Posted Jul 31, 2020 12:49 PM
    For now out of ideas, but will think about this. 
    for whatever it's worth, did verify in my lab that description_token = NULL is fine.

    ------------------------------
    Support Engineer
    Broadcom
    ------------------------------



  • 27.  RE: UMP > USM Group Manipulation Errors out

    Broadcom Employee
    Posted Jul 31, 2020 01:02 PM
    Strickly a troubleshooting tactic.

    I would get the SQL Server logs and review to see if you see any anomalies from the DB Side. If so it will give you a lead if not you could almost rule DB out.


  • 28.  RE: UMP > USM Group Manipulation Errors out

    Posted Aug 10, 2020 08:55 AM
    Last time I saw something similar, a restart of the discovery_server probe did the trick.
    I'd give that a shot.


  • 29.  RE: UMP > USM Group Manipulation Errors out

    Posted Aug 10, 2020 11:38 AM
    Edited by Daniel Blanco Aug 10, 2020 11:40 AM
    Sorry getting back to this as I've been w/o power since last Tuesday. 

    Anyway this is still and issue and even after a full UIM stop/start it still doesn't work. 
    Nothing weird in the DB was observed.

    I also noticed that the CABI auto login isn't working. Usually, when it worked when we clicked on the "Unified Dashboards > CA Business Intelligence Dashboards :  "Go to CABI Server Home" link, it would usually bring me into the CABI page and display the options to run the dashboard. 
    Not it just brings me to the CABI login page.
    Not sure if this is related.

    What page shows how to configure the auto login from UMP into CABI?

    ------------------------------
    Daniel Blanco
    Enterprise Tools Team Architect
    DBlanco@alphaserveit.com
    ------------------------------



  • 30.  RE: UMP > USM Group Manipulation Errors out

    Posted Aug 10, 2020 12:40 PM
    Are you using a self signed cert? Firefox and Chrome just instituted a policy/option of not trusting self signed certs and that gets in the way. Essentially anything that might pop up a warning/do you want to continue window in interactive usage of the web pages will break the portlet access too. You can add the self signed cert to the rot trusted certs and manually access the cabi page to get past the popup but it will reset itself some time in the future and break again.

    I am personally also seeing that if cabi runs longer than 3 days or so, it need to be restarted. Something in it gets hung up and it stops being able to respond correctly.


  • 31.  RE: UMP > USM Group Manipulation Errors out
    Best Answer

    Posted Sep 01, 2020 11:15 AM
    Just as a follow up on this thread, one of our esx hosts purple screened and after the reboot of our SQL DB USM Group functionality started working again.
    I also found an old KB regarding the CABI Single sign on failing w/in Chrome after a Version upgrade which I fixed and the SSO started working again.


    If any of you have to use CABI you will have to do this now if the version is up to date:

    https://knowledge.broadcom.com/external/article?articleId=186993

    To Fix:

    Basically go here in chrome:  chrome://flags/

    Then set the "SameSite by default cookies" to DISABLED then relaunch Chrome.


    So things are now back to normal.   :-)



    ------------------------------
    Daniel Blanco
    Enterprise Tools Team Architect
    DBlanco@alphaserveit.com
    ------------------------------