riskminder - quova data auto download

[Tony Fu]

Hi all

Quova data is used to support the IP based risk evaluation in riskminder.
The data is renewed on a monthly basis nowadays.
I believe to consume the data, it would be better to have some channel to make the data feed downloaded automatically and then get it integrated with some pipeline.
Can someone share any idea on this ?
Is there any known good practice to consume the data ?

Thanks

[Namish Tiwari]

Hi Tony,

This is very valid question and we have provided the data on FTP site to customer to automate the process of download and upload.
There is a Quova data download tool available and i need to check if the URL works fine after all this integration and if you could open a case that will be better in this particular case.
If you have any questions please let me know.

[Tony Fu]

Hi Tiwari
Thanks for your reply. I had a open case 31865094. 

If you would like a new one, let me know

[Tony Fu]

Hi Tiwari, may I know if there is any other options available apart from FTP site, like any HTTP site available for this?

[Namish Tiwari]

The current solution i was talking to is related to make the data available over HTTP requests. We will look into this and update you.

[Tony Fu]

​Hi Tiwari

Now I am awaiting for this solution to proceed my solution proposal .

So may I know how soon it will take to get the update on this?
Thanks

[Tony Fu]

Hi Tiwari

Any luck on this?​

[Namish Tiwari]

Hi Tony,

I know the information is shared with you through a case which has the tool information to automate the Quova file download, what exactly you are waiting for now?

-Namish

[Tony Fu]

​Sorry, Tiwari
I didn't get any information regarding the auto download.

what I got from case 31865094 were the quova data only, I didn't get any instruction to implement the auto download.
Can you help verify the case or I can open a new case on the same?

[Namish Tiwari]

I have updated the ticket and you should be able to get the data from that same case, please download it as soon as possible.

[Tony Fu]

hi Tiwari
Thanks for the update.  I have got the tool from case.
However, still failed to get it running.
May I know if any instruction for setting up proxy ?

We are connecting behind firewall, so need to specify proxy accordingly.
I have tried to setup like below:

java -Dhttps.proxyHost=<proxy_host> -Dhttps.proxyPort=<proxy_port> -jar QuovaTool.jar

However, it failed with errors:
Exception in thread "main" java.lang.RuntimeException: org.apache.http.conn.HttpHostConnectException: Connect to supportservices.ca.com:443 [supportservices.ca.com/141.202.248.7] failed: Connection timed out (Connection timed out)
 at com.ca.quova.SpringBootConsoleApplication.run(SpringBootConsoleApplication.java:99)
 at com.ca.quova.SpringBootConsoleApplication.main(SpringBootConsoleApplication.java:42)
Caused by: org.apache.http.conn.HttpHostConnectException: Connect to supportservices.ca.com:443 [supportservices.ca.com/141.202.248.7] failed: Connection timed out (Connection timed out)
 at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:156)
 at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:374)
 at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393)
 at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236)
 at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186)
 at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
 at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110)
 at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
 at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
 at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:108)
 at com.ca.quova.utils.QuovaUtils.accessApp(QuovaUtils.java:86)
 at com.ca.quova.SpringBootConsoleApplication.run(SpringBootConsoleApplication.java:92)
 ... 1 more
Caused by: java.net.ConnectException: Connection timed out (Connection timed out)
 at java.net.PlainSocketImpl.socketConnect(Native Method)
 at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350)
 at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206)
 at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188)
 at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
 at java.net.Socket.connect(Socket.java:589)
 at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:368)
 at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)

[Tony Fu]

Hi Tiwari
Could you please help suggest how we access the data via SFTP or FTP as well?

Let me know if I need to open a case on the same.