Integration AWS PaaS and AutoSys

[Jose Lopez]

Hi,

I may need to integrate some AWs PaaS as storege account with Autosys.

I was told I can use REST APIs calles, HTTP jobs and even AWS CLI commands but I cannot find documentation about this.

Do you know where I can find more documentation about AutoSys and AWS integration?

thanks
José

[Michael Woods]

Hi Jose,

Can you give some detail on what you are trying to accomplish?  There are a couple of approaches that can be taken, but your use case will help guide us to the best solution.

Regards,
Mike

[Jose Lopez]

Hi Michael,

thanks for your answer.

At first I am mainly interested in checking the documentation to have an understanding of integration AutoSys and AWS. but from a tech point of view most likely we will have to move files from/to on premise servers to AWS S3 storage accounts. So I would like to know the various possibilities to get this done.

thanks
José

[Michael Woods]

What I would do is to use the aws command line interface to do this.  It would be a **** command job to AutoSys.
You would need to have an AutoSys agent and the aws cli on the same machine and the command would be something like "aws s3 cp onprem_file aws_bucket" as an esample of a **** upload.  reverse the file names to download.  There are a lot of other parameters that can be passed as well, but the format is pretty much the same.  

Other techniques would be to use an SDK and code up a program taking parms.  Using Web Services is possible, but you will need to create the AWS signature first and pass it on the header for it to pass AWS security.  The CLI and SDK do all that additional work for you, even though it invokes a web service as well.

For some other services, like Step Functions, you would want to make the request to start the flow, which the CLI can do as well.  The issue with that is that you only know the request was made and not the result.  In cases like this, you would want to check the output for the process ID and then start looping to check for a termination state and set the return code appropriately in a script using the  or SDK program.  

There is an upcoming webcast on Jan 13 that is one the main page of the Community that has the information for joining.  The topic is on some of the integrations that we have done for cloud and PaaS, SaaS type products.  Things like Airflow that we are building integrations for.

Regards,
Mike

[Jose Lopez]

Hi Michael,

Sorry, I read your answer but missed to thank you.

I will be testing the aws s3 command to check how it works.

thanks
José