**************************************************** Replacing the env variables **************************************************** Generating pv yaml files Generating PV Yaml files for use in OpenShift Origin Project:doiproject /nfsfolderpath/acn-correlation-logs /nfsfolderpath/adminui-logs /nfsfolderpath/adminui-data /nfsfolderpath/adminui-tomee-logs /nfsfolderpath/amq /nfsfolderpath/analyticsjobs-config /nfsfolderpath/axa-data/dxc-log /nfsfolderpath/axa-data/transformer-log /nfsfolderpath/couch-data /nfsfolderpath/cpa-logs /nfsfolderpath/cpa-security /nfsfolderpath/doi-readserver-logs /nfsfolderpath/doireadserver-tomee-logs /nfsfolderpath/dspintegrator-logs /nfsfolderpath/dsp-logs /nfsfolderpath/dsp-maturation-data /nfsfolderpath/dsp-model-data /nfsfolderpath/dxplatelemetry /nfsfolderpath/elastalert-config /nfsfolderpath/elastalert-rules /nfsfolderpath/elasticsearch-data-1 /nfsfolderpath/filebeat-config /nfsfolderpath/filebeat-data /nfsfolderpath/ /nfsfolderpath/genericapiconnector/data /nfsfolderpath/genericapiconnector/logs /nfsfolderpath/hadoop-data1 /nfsfolderpath/hadoop-data2 /nfsfolderpath/incidentmanager-logs /nfsfolderpath/integrationgateway-logs /nfsfolderpath/jarvis/apis-logs /nfsfolderpath/jarvis/elasticsearch-logs/elasticsearch /nfsfolderpath/jarvis/elasticsearch-logs/elasticsearch-2 /nfsfolderpath/jarvis/elasticsearch-logs/elasticsearch-3 /nfsfolderpath/jarvis/elasticsearch-logs /nfsfolderpath/jarvis/indexer-logs /nfsfolderpath/jarvis/kafka-logs/kafka /nfsfolderpath/jarvis/kafka-logs/kafka-2 /nfsfolderpath/jarvis/kafka-logs/kafka-3 /nfsfolderpath/jarvis/kafka-logs /nfsfolderpath/jarvis/kron-logs /nfsfolderpath/jarvis/utils-logs /nfsfolderpath/jarvis/verifier-logs /nfsfolderpath/jarvis/zookeeper-logs/zookeeper /nfsfolderpath/jarvis/zookeeper-logs/zookeeper-2 /nfsfolderpath/jarvis/zookeeper-logs/zookeeper-3 /nfsfolderpath/jarvis/zookeeper-logs/ /nfsfolderpath/jarvis/ldds-web-logs /nfsfolderpath/logcollector-logs /nfsfolderpath/logcollector-data /nfsfolderpath/logparser-logs /nfsfolderpath/logparser-data /nfsfolderpath/metricbeat-modules /nfsfolderpath/ngtas-backup /nfsfolderpath/ngtas-data /nfsfolderpath/normalized-alarm-logs /nfsfolderpath/pg-data /nfsfolderpath/axa-data/readserver-logs /nfsfolderpath/axa-data/readserver-tomee-logs /nfsfolderpath/servicealarm-logs /nfsfolderpath/servicemanagement-data /nfsfolderpath/soa-logs/servicemanagement-log /nfsfolderpath/servicetemplate-logs /nfsfolderpath/soacorrelationengine-data /nfsfolderpath/soa-logs/soacorrelationengine-log In Small deployment only one hadoop related PVs is required and ngtas-backup not required In Small deployment only one hadoop related PVs is required and ngtas-backup not required **************************************************** Generating ngtas secret files read EC key writing EC key # Loading private key from: /doi/CA/docs/ngtas/systemprivate.pem # Loading public key from: /doi/CA/docs/ngtas/systempublic.pem # Genereate tokens ## {'tid': 1, 'int': True, 'jti': 'c5870098-4bbc-4b35-99bd-f26f58a23c14'} apm.security.supportabilityToken=eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJ0aWQiOjEsImludCI6dHJ1ZSwianRpIjoiYzU4NzAwOTgtNGJiYy00YjM1LTk5YmQtZjI2ZjU4YTIzYzE0In0.ESU1vDsoqyJxgG547qB5xUEw8Bx-Uj7dYTHm1IFyH1Ime-LDmnDlYiRXgWrIIpSCNMvTEaAfpBdRaSxPlCdWPw ## {'int': True, 'jti': 'c78b3f43-fde1-4711-8c04-6d517b0820c9'} apm.security.internalToken=eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJpbnQiOnRydWUsImp0aSI6ImM3OGIzZjQzLWZkZTEtNDcxMS04YzA0LTZkNTE3YjA4MjBjOSJ9.n1LLv_c6zrvOALXj0rvL2sa1ChhhDV3Ee8k7SynfBN4Qj0Y6NoStjVIOnXUmRrMfWa4K9bmXaX_82aJOtZRXSg ## {'int': True, 'jti': 'bfcac7f9-b563-4aae-b545-70ff96705226', 'role': ['manageTenant']} apm.security.tenantServiceMasterToken=eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJpbnQiOnRydWUsImp0aSI6ImJmY2FjN2Y5LWI1NjMtNGFhZS1iNTQ1LTcwZmY5NjcwNTIyNiIsInJvbGUiOlsibWFuYWdlVGVuYW50Il19.MmlGgYSLI_PUcXWEGmRCPq_ne0_VC0QKhIyntIacw2ZDKE8UiQ0aUPSZIkCvlhiOzWwa0km9IqmxVHovA_ZPMw # Genereate secrets ## Private secret with keys: /doi/CA/docs/ngtas/secret-apm-private-keys.yml ## Private secret without keys: /doi/CA/docs/ngtas/secret-apm-private.yml ## Private secret for ACC: /doi/CA/docs/ngtas/secret-acc.yml ## Public secret: /doi/CA/docs/ngtas/secret-apm-public.yml ## Supportability secret: /doi/CA/docs/ngtas/secret-apm-supp.yml # Done secret-acc.yml secret-apm-private-keys.yml secret-apm-private.yml secret-apm-public.yml secret-apm-supp.yml secrets-util.py systemprivate_ec.pem systemprivate.pem systempublic.pem keysCreated: secret-apm-private-keys.yml keys created mastertoken eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJpbnQiOnRydWUsImp0aSI6ImJmY2FjN2Y5LWI1NjMtNGFhZS1iNTQ1LTcwZmY5NjcwNTIyNiIsInJvbGUiOlsibWFuYWdlVGVuYW50Il19.MmlGgYSLI_PUcXWEGmRCPq_ne0_VC0QKhIyntIacw2ZDKE8UiQ0aUPSZIkCvlhiOzWwa0km9IqmxVHovA_ZPMw master token replaced keysCreated: secret-apm-public.yml keys created APM Internal Token eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJpbnQiOnRydWUsImp0aSI6ImM3OGIzZjQzLWZkZTEtNDcxMS04YzA0LTZkNTE3YjA4MjBjOSJ9.n1LLv_c6zrvOALXj0rvL2sa1ChhhDV3Ee8k7SynfBN4Qj0Y6NoStjVIOnXUmRrMfWa4K9bmXaX_82aJOtZRXSg APM Internal token replaced 9 **************************************************** oc login to the OSE Login successful. You have access to the following projects and can switch between them with 'oc project ': * default doiproject kube-public kube-service-catalog kube-system logging management-infra openshift openshift-ansible-service-broker openshift-infra openshift-node openshift-template-service-broker openshift-web-console Using project "default". Successfully logged in to https://10.182.100.71:8443 with username=doiuser **************************************************** oc changing project Now using project "doiproject" on server "https://10.182.100.71:8443". Successfully changed project to doiproject **************************************************** Backup existing templates **************************************************** Creating secrets for password fields secret "gaadmin" created secret "taadmin" created secret "masteradmin" created secret "aoppass" created secret "postgrepass" created Creating secrets for ngtas Updating bootstrap.properties to bootstrap-moi-properties in secret-apm-private-keys.yml for small install Updated bootstrap-moi-properties in secret-apm-private-keys.yml secret "apmservices-private-keys" created **************************************************** oc creating template Generating ca-digital-oi-template for deployment type small successful. **************************************************** oc creating components using ca-digital-oi-pvc-template.yaml template "ca-digital-oi-pvc-template" created oc create template for ca-digital-oi-pvc-template successful **************************************************** oc creating components using ./oc create -f ca-digital-oi-postgres-template.yaml template "ca-digital-oi-postgresql-template" created oc create template ca-digital-oi-postgres-template successful **************************************************** oc creating components using ./oc create -f docs/ca-digital-oi-template-upd.yaml template "ca-digital-oi-template" created Creating template ca-digital-oi-template successful **************************************************** oc creating components using ./oc create -f docs/ca-digital-oi-is-template.yaml template "ca-digital-oi-image-template" created Creating template using ca-digital-oi-is template successful **************************************************** Run OC get template templates/ca-digital-oi-image-template templates/ca-digital-oi-postgresql-template templates/ca-digital-oi-pvc-template templates/ca-digital-oi-template Login Succeeded **************************************************** Run oc secrets external repo DOI templates can now download images from our external docker repo https://doi.packages.ca.com/1.3.2/ **************************************************** Run OC secrets secret/ca-bintray-pull-secret OC secrets command executed **************************************************** Run OC secrets link OC secrets link command executed successfully **************************************************** Running post install script Login successful. You have access to the following projects and can switch between them with 'oc project ': default * doiproject kube-public kube-service-catalog kube-system logging management-infra openshift openshift-ansible-service-broker openshift-infra openshift-node openshift-template-service-broker openshift-web-console Using project "doiproject". Login successful. You have access to the following projects and can switch between them with 'oc project ': default * doiproject kube-public kube-service-catalog kube-system logging management-infra openshift openshift-ansible-service-broker openshift-infra openshift-node openshift-template-service-broker openshift-web-console Using project "doiproject". creating storage class doi-usage storageclass "doi-usage" created Start create pv in cluster admin mv: cannot stat ‘../doiproject/pv-docs/hadoop-data-1-pv.yaml’: No such file or directory mv: cannot stat ‘../doiproject/pv-docs/ngtas-backup-pv.yaml’: No such file or directory persistentvolume "doiproject-acn-correlation-logs-pv" created persistentvolume "doiproject-adminui-logs-pv" created persistentvolume "doiproject-adminui-pv" created persistentvolume "doiproject-adminui-tomee-logs-pv" created persistentvolume "doiproject-amq-pv" created persistentvolume "doiproject-analyticsjobs-config-pv" created persistentvolume "doiproject-axa-dxc-logs-pv" created persistentvolume "doiproject-axa-transformer-logs-pv" created persistentvolume "doiproject-couch-data-pv" created persistentvolume "doiproject-cpa-logs-pv" created persistentvolume "doiproject-cpa-security-pv" created persistentvolume "doiproject-doireadserver-logs-pv" created persistentvolume "doiproject-doireadserver-tomee-logs-pv" created persistentvolume "doiproject-dspintegrator-logs-pv" created persistentvolume "doiproject-dsp-logs-pv" created persistentvolume "doiproject-dsp-maturation-data-pv" created persistentvolume "doiproject-dsp-model-data-pv" created persistentvolume "doiproject-dxplatelemetry-pv" created persistentvolume "doiproject-elastalert-config-pv" created persistentvolume "doiproject-elastalert-rules-pv" created persistentvolume "doiproject-elasticsearch-data-1-pv" created persistentvolume "doiproject-filebeat-config-pv" created persistentvolume "doiproject-filebeat-data-pv" created persistentvolume "doiproject-filebeat-logs-pv" created persistentvolume "doiproject-genericapiconnector-data-pv" created persistentvolume "doiproject-genericapiconnector-logs-pv" created persistentvolume "doiproject-hadoop-data-0-pv" created persistentvolume "doiproject-incidentmanagement-logs-pv" created persistentvolume "doiproject-integrationgateway-logs-pv" created persistentvolume "doiproject-jarvis-api-logs-pv" created persistentvolume "doiproject-jarvis-elasticsearch-logs-pv" created persistentvolume "doiproject-jarvis-indexer-logs-pv" created persistentvolume "doiproject-jarvis-kafka-logs-pv" created persistentvolume "doiproject-jarvis-kron-logs-pv" created persistentvolume "doiproject-jarvis-utils-logs-pv" created persistentvolume "doiproject-jarvis-verifier-logs-pv" created persistentvolume "doiproject-jarvis-zookeeper-logs-pv" created persistentvolume "doiproject-ldds-web-logs-pv" created persistentvolume "doiproject-log-collector-logs-pv" created persistentvolume "doiproject-logcollector-pv" created persistentvolume "doiproject-log-parser-logs-pv" created persistentvolume "doiproject-logparser-pv" created persistentvolume "doiproject-metricbeat-modules-pv" created persistentvolume "doiproject-ngtas-data-pv" created persistentvolume "doiproject-normalized-alarm-logs-pv" created persistentvolume "doiproject-pg-data-pv" created persistentvolume "doiproject-readserver-logs-pv" created persistentvolume "doiproject-readserver-tomee-logs-pv" created persistentvolume "doiproject-servicealarm-logs-pv" created persistentvolume "doiproject-servicemanagement-data-pv" created persistentvolume "doiproject-servicemanagement-logs-pv" created persistentvolume "doiproject-servicetemplate-logs-pv" created persistentvolume "doiproject-soacorrelationengine-data-pv" created persistentvolume "doiproject-soacorrelationengine-logs-pv" created ******************************************************************************************** execute kubestatemetrics pre-install Admin username password supplied Login successful. You have access to the following projects and can switch between them with 'oc project ': default * doiproject kube-public kube-service-catalog kube-system logging management-infra openshift openshift-ansible-service-broker openshift-infra openshift-node openshift-template-service-broker openshift-web-console Using project "doiproject". clusterrolebinding "kube-state-metrics" created clusterrole "kube-state-metrics" created rolebinding "kube-state-metrics" created role "kube-state-metrics-resizer" created serviceaccount "kube-state-metrics" created serviceaccount "metricbeat" created cluster role "cluster-reader" added: "doiuser:serviceaccount:doiproject:kube-state-metrics" cluster role "cluster-reader" added: "doiuser:serviceaccount:doiproject:metricbeat" role "edit" added: "doiuser:serviceaccount:doiproject:metricbeat" role "edit" added: "doiuser:serviceaccount:doiproject:kube-state-metrics" scc "privileged" added to: ["system:serviceaccount:doiproject:metricbeat"] scc "privileged" added to: ["system:serviceaccount:doiproject:kube-state-metrics"] **************************************************** oc creating new app components using ca-digital-oi-pvc-template.yaml Login successful. You have access to the following projects and can switch between them with 'oc project ': default * doiproject kube-public kube-service-catalog kube-system logging management-infra openshift openshift-ansible-service-broker openshift-infra openshift-node openshift-template-service-broker openshift-web-console Using project "doiproject". --> Deploying template "doiproject/ca-digital-oi-pvc-template" for "docs/ca-digital-oi-pvc-template.yaml" to project doiproject CA Digital Operational Intelligence 1.3.2 - PVC Template [STEP 1] --------- Template to create project specific PVCs for use by CA Digital Operational Intelligence 1.3.2 Deployment Configurations. DOI installer already process this template The following service(s) have been created in your project. * With parameters: * PROJECT_NAME=doiproject --> Creating resources ... persistentvolumeclaim "amq-claim0" created persistentvolumeclaim "elasticsearch-claim1" created persistentvolumeclaim "pg-data-claim0" created persistentvolumeclaim "couch-data" created persistentvolumeclaim "dspcasa-dsp-logs-claim" created persistentvolumeclaim "dspcasa-maturation-data-claim" created persistentvolumeclaim "dspcasa-model-data-claim" created persistentvolumeclaim "cpa-logs-claim" created persistentvolumeclaim "cpa-security-claim" created persistentvolumeclaim "adminui-claim" created persistentvolumeclaim "logparser-claim" created persistentvolumeclaim "logcollector-claim" created persistentvolumeclaim "incidentmanager-logs-claim" created persistentvolumeclaim "integrationgateway-logs-claim" created persistentvolumeclaim "genericapiconnector-data-claim" created persistentvolumeclaim "genericapiconnector-logs-claim" created persistentvolumeclaim "normalized-alarm-logs-claim" created persistentvolumeclaim "metricbeat-modules-claim" created persistentvolumeclaim "filebeat-logs-claim" created persistentvolumeclaim "filebeat-data-claim" created persistentvolumeclaim "filebeat-config-claim" created persistentvolumeclaim "elastalert-rules-claim" created persistentvolumeclaim "elastalert-config-claim" created persistentvolumeclaim "soacorrelationengine-data-claim" created persistentvolumeclaim "servicemanagement-data-claim" created persistentvolumeclaim "adminui-logs-claim" created persistentvolumeclaim "doireadserver-logs-claim" created persistentvolumeclaim "axa-dxc-logs-claim" created persistentvolumeclaim "axa-transformer-logs-claim" created persistentvolumeclaim "jarvis-api-logs-claim" created persistentvolumeclaim "jarvis-elasticsearch-logs-claim" created persistentvolumeclaim "jarvis-indexer-logs-claim" created persistentvolumeclaim "jarvis-kron-logs-claim" created persistentvolumeclaim "jarvis-utils-logs-claim" created persistentvolumeclaim "jarvis-verifier-logs-claim" created persistentvolumeclaim "jarvis-kafka-logs-claim" created persistentvolumeclaim "jarvis-zookeeper-logs-claim" created persistentvolumeclaim "ldds-web-logs-claim" created persistentvolumeclaim "readserver-logs-claim" created persistentvolumeclaim "servicemanagement-logs-claim" created persistentvolumeclaim "analyticsjobs-config-claim" created persistentvolumeclaim "servicealarm-logs-claim" created persistentvolumeclaim "servicetemplate-logs-claim" created persistentvolumeclaim "acn-correlation-logs-claim" created persistentvolumeclaim "soacorrelationengine-logs-claim" created persistentvolumeclaim "log-collector-logs-claim" created persistentvolumeclaim "log-parser-logs-claim" created persistentvolumeclaim "readserver-tomee-logs-claim" created persistentvolumeclaim "adminui-tomee-logs-claim" created persistentvolumeclaim "doireadserver-tomee-logs-claim" created persistentvolumeclaim "dxplatelemetry-pvc" created persistentvolumeclaim "ngtas-data-claim" created persistentvolumeclaim "dspintegrator-logs-claim" created --> Success Run 'oc status' to view your app. Deploying template ca-digital-oi-pvc-template.yaml successful template "ca-digital-oi-pvc-template" deleted **************************************************** oc creating new app components using ca-digital-oi-is-template.yaml --> Deploying template "doiproject/ca-digital-oi-image-template" for "docs/ca-digital-oi-is-template.yaml" to project doiproject ca-digital-oi-image-template --------- Template to create ImageStreams that deploy CA Digital Operational Intelligence 1.3.2. * With parameters: * DOI_DOCKER_REGISTRY=doi.packages.ca.com/1.3.2 --> Creating resources ... imagestream "doi-postgres" created imagestream "readserver-doionprem" created imagestream "adminui-onprem" created imagestream "amq" created imagestream "jarvis_api" created imagestream "transformer" created imagestream "cxc" created imagestream "jarvis_es_utils" created imagestream "jarvis_indexer" created imagestream "jarvis_kron" created imagestream "logcollector" created imagestream "logparser" created imagestream "readserver-onprem" created imagestream "correlationengine" created imagestream "jarvis_verifier" created imagestream "jarvis_couchdb" created imagestream "servicemanagement" created imagestream "analyticsjobs" created imagestream "servicealarm" created imagestream "dspcasa" created imagestream "jarvis_ldds" created imagestream "cpa-onprem" created imagestream "hadoop-base-2.7.3" created imagestream "jarvis_jobmanager" created imagestream "jarvis_hadoopconnector" created imagestream "elasticsearch-6.2.2" created imagestream "zookeeper" created imagestream "kafka" created imagestream "normalized-alarm" created imagestream "tenantmanagement" created imagestream "servicetemplate" created imagestream "nim" created imagestream "notify-filter" created imagestream "incidentmanagement" created imagestream "integrationgateway" created imagestream "genericapiconnector" created imagestream "filebeat" created imagestream "logstash" created imagestream "elastalert" created imagestream "doi_kibana" created imagestream "acn_correlation" created imagestream "dspintegrator" created --> Success Run 'oc status' to view your app. Deploying template ca-digital-oi-is-template.yaml successful template "ca-digital-oi-image-template" deleted **************************************************** oc creating new app components using ca-digital-oi-postgres-template.yaml --> Deploying template "doiproject/ca-digital-oi-postgresql-template" for "docs/ca-digital-oi-postgres-template.yaml" to project doiproject CA Digital Operational Intelligence 1.3.2 - postgres [STEP 2] --------- Template to create objects that deploy the postgres container used as DB Server by CA Digital Operational Intelligence 1.3.2. IMPORTANT! Please review the Digital OI pre-requisites for Openshift Cluster. Change the value of servicesNodePortRange to 80-32767 in /etc/origin/master-config.yml and restarted origin-master service. DOI installer already process this template The following service(s) have been created in your project. * With parameters: * PROJECT_NAME=doiproject * OC_ROUTER_HOST=10.182.100.71 * POSTGRES_SERVICE=postgresql * POSTGRES_PORT=5432 * POSTGRES_PASSWORD=MTIz * AOP_DB_SID=aoplatform * AOP_DB_USER=aopuser * AOP_DB_PASSWORD={AOP_DB_PASSWORD} --> Creating resources ... service "postgresql" created deploymentconfig "doi-postgres" created --> Success Run 'oc status' to view your app. Deploying template new-app ca-digital-oi-postgres-template.yaml successful template "ca-digital-oi-postgresql-template" deleted **************************************************** Please find createNFSDirsForPV.sh under /doi/CA/bin folder