Automic Workload Automation

Expand all | Collapse all

Hadoop HDFS Job Error

  • 1.  Hadoop HDFS Job Error

    Posted 09-07-2017 08:35 AM
    Hi,
    I am trying to create a hdfs job but I get an error down below.
    Does anyone knows what does it mean?


    Stack Trace
    ava.lang.RuntimeException: com.uc4.be.gui.remote.CITGuiException:  java.lang.IllegalArgumentException: Schema specific part is opaque

         at com.uc4.ra.gui.BaseAgentConnection.createRuntimeException(BaseAgentConnection.java:145)
         at com.uc4.ra.gui.BaseAgentConnection.listDirectoriesAndFiles(BaseAgentConnection.java:88)
         at com.uc4.ra.gui.BaseAgentConnection.listDirectoriesAndFiles(BaseAgentConnection.java:106)
         at com.automic.ra.hadoop.gui.filebrowsing.AgentFileView.getAgentFiles(AgentFileView.java:680)
         at com.automic.ra.hadoop.gui.filebrowsing.AgentFileView.<init>(AgentFileView.java:292)
         at com.automic.ra.hadoop.gui.filebrowsing.AgentFileView.<init>(AgentFileView.java:171)
         at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
         at sun.reflect.NativeConstructorAccessorImpl.newInstance(Unknown Source)
         at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(Unknown Source)
         at java.lang.reflect.Constructor.newInstance(Unknown Source)
         at org.codehaus.groovy.reflection.CachedConstructor.invoke(CachedConstructor.java:83)
         at org.codehaus.groovy.runtime.callsite.ConstructorSite$ConstructorSiteNoUnwrapNoCoerce.callConstructor(ConstructorSite.java:105)
         at com.automic.ra.hadoop.gui.CommonInit$_setupHdfsBrowse_closure4.doCall(CommonInit.groovy:226)
         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
         at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
         at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
         at java.lang.reflect.Method.invoke(Unknown Source)
         at org.codehaus.groovy.reflection.CachedMethod.invoke(CachedMethod.java:93)
         at groovy.lang.MetaMethod.doMethodInvoke(MetaMethod.java:325)
         at org.codehaus.groovy.runtime.metaclass.ClosureMetaClass.invokeMethod(ClosureMetaClass.java:294)
         at groovy.lang.MetaClassImpl.invokeMethod(MetaClassImpl.java:1024)
         at groovy.lang.Closure.call(Closure.java:414)
         at org.codehaus.groovy.runtime.ConvertedClosure.invokeCustom(ConvertedClosure.java:54)
         at org.codehaus.groovy.runtime.ConversionHandler.invoke(ConversionHandler.java:124)
         at com.sun.proxy.$Proxy0.actionPerformed(Unknown Source)
         at javax.swing.AbstractButton.fireActionPerformed(Unknown Source)
         at javax.swing.AbstractButton$Handler.actionPerformed(Unknown Source)
         at javax.swing.DefaultButtonModel.fireActionPerformed(Unknown Source)
         at javax.swing.DefaultButtonModel.setPressed(Unknown Source)
         at javax.swing.plaf.basic.BasicButtonListener.mouseReleased(Unknown Source)
         at java.awt.AWTEventMulticaster.mouseReleased(Unknown Source)
         at java.awt.Component.processMouseEvent(Unknown Source)
         at javax.swing.JComponent.processMouseEvent(Unknown Source)
         at java.awt.Component.processEvent(Unknown Source)
         at java.awt.Container.processEvent(Unknown Source)
         at java.awt.Component.dispatchEventImpl(Unknown Source)
         at java.awt.Container.dispatchEventImpl(Unknown Source)
         at java.awt.Component.dispatchEvent(Unknown Source)
         at java.awt.LightweightDispatcher.retargetMouseEvent(Unknown Source)
         at java.awt.LightweightDispatcher.processMouseEvent(Unknown Source)
         at java.awt.LightweightDispatcher.dispatchEvent(Unknown Source)
         at java.awt.Container.dispatchEventImpl(Unknown Source)
         at java.awt.Window.dispatchEventImpl(Unknown Source)
         at java.awt.Component.dispatchEvent(Unknown Source)
         at java.awt.EventQueue.dispatchEventImpl(Unknown Source)
         at java.awt.EventQueue.access$200(Unknown Source)
         at java.awt.EventQueue$3.run(Unknown Source)
         at java.awt.EventQueue$3.run(Unknown Source)
         at java.security.AccessController.doPrivileged(Native Method)
         at java.security.ProtectionDomain$1.doIntersectionPrivilege(Unknown Source)
         at java.security.ProtectionDomain$1.doIntersectionPrivilege(Unknown Source)
         at java.awt.EventQueue$4.run(Unknown Source)
         at java.awt.EventQueue$4.run(Unknown Source)
         at java.security.AccessController.doPrivileged(Native Method)
         at java.security.ProtectionDomain$1.doIntersectionPrivilege(Unknown Source)
         at java.awt.EventQueue.dispatchEvent(Unknown Source)
         at java.awt.EventDispatchThread.pumpOneEventForFilters(Unknown Source)
         at java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source)
         at java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source)
         at java.awt.EventDispatchThread.pumpEvents(Unknown Source)
         at java.awt.EventDispatchThread.pumpEvents(Unknown Source)
         at java.awt.EventDispatchThread.run(Unknown Source)



  • 2.  Hadoop HDFS Job Error

    Posted 09-26-2017 03:38 AM
    Hi,
    I was not able to find this error message in support database. No other customer reported this exception to us.

    However it seemed to like a permission error of your WebHDFS setup. The Hadoop user you are using for the HDFS access does not have the necessary permissions.
    The Hadoop Agent expects the WebHDFS URL in following format.
    http://{host}:50070/webhdfs/v1

    Are you using this format?