RestMon multiple issues / questions

[Felipe Mattos]

greetings.

I'm trying to setup RestMon to ingest Splunk data and I'm facing several challenges with that.

1, the Splunk profile seems to be funky to setup, the way the documentation explains it doesnt help much. For the monitoring groups it only examplifies:

{
        "Search" : "yes",
        "Search_Inventory" : "no"
      }

so how do I get data from a specific dashboard? or entities/queries within a dashboard? how can I narrow down to the data that I actually want?

2, I see Splunk data collecting happening 'fine' on RestMon logs (in theory), no distinctive errors. but it returns null, although it has a huge JSON payload returned when I GET it from a browser or Postman, for ex.

2022-07-20 15:08:37,733 [ProfileHandler|splunk~~splunk] DEBUG DataStore:117 - Skipping, as the response for the API https://******/services/search/jobs?output_mode=json is null

at same time, I see nothing on DOI. On my monitored inventory I can see an entity named:

SuperDomain|oiservices|opendataconnector|masterdefault

but source is empty and nothing else is intelligible from there. and logs show me:
DEBUG DoiPublisher:63 - DOI connection details for Metrics are not configured. Skipping publish Metrics to DOI.

DOI conn details for metrics is configured under oiconnectmetricsnassdetails - more details on 3# below.

3, finally, some comm ERROR messages on RestMon logs caught my attention:

2022-07-20 14:47:46,547 [reactor-http-epoll-3] WARN HttpClientConnect:295 - [e612db29, L:/****:41646 ! R:****.broadcom.com/****:443] The connection observed an error

at io.netty.handler.ssl.SslHandler.channelInactive(SslHandler.java:1064)

at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:262)

at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:248)

at io.netty.channel.AbstractChannelHandlerContext.fireChannelInactive(AbstractChannelHandlerContext.java:241)

at io.netty.channel.DefaultChannelPipeline$HeadContext.channelInactive(DefaultChannelPipeline.java:1405)

at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:262)

at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:248)

at io.netty.channel.DefaultChannelPipeline.fireChannelInactive(DefaultChannelPipeline.java:901)

at io.netty.channel.AbstractChannel$AbstractUnsafe$7.run(AbstractChannel.java:813)

at io.netty.util.concurrent.AbstractEventExecutor.safeExecute(AbstractEventExecutor.java:164)

at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:469)

at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:384)

at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:986)

at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)

at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)

at java.base/java.lang.Thread.run(Thread.java:829)

2022-07-20 14:47:46,948 [reactor-http-epoll-3] WARN ReactiveApiProviderBuilder:126 - Retrying WEBSOCKET://****.broadcom.com:443 attempt #1 (1 in a row), last failure={java.nio.channels.ClosedChannelException}

the only OI setting I dont have configured on my restmon.json file is oiconnectinventorydetails. 

unfortunately the official documentation about RestMon and the troubleshooting of it lacks a lot of information and while I'm trying to engage Broadcom's engineering thru company's liaison I hope some has any experience with with all. thanks. 
​