Infoworks Installation on Existing HDI with ADLS

Prerequisites

Following are the prerequisites to add Infoworks Edgenode to HDInsight cluster:

• Ensure the following details are noted when creating the HDInsight cluster: Cluster Name, Cluster Ambari Login User Name, Cluster Ambari Login Password.

Installation

Following is the Infoworks installation procedure:

Adding Edge node

• Login to portal.azure.com in a web browser and enter the following url: https://portal.azure.com/#create/Microsoft.Template/uri/https%3A%2F%2Fraw.githubusercontent.com%2FInfoworks%2Fdeployments%2Fmaster%2Fazure%2Fhdinsight%2Fexistinghdinsight%2FmainTemplate.json
• The following interface will be displayed:

• Select the Resource group where the HDInsight cluster is located and provide the Cluster Name.
• Edgenode Vm Size must be populated in advance with Standard_D13_v2. Contact Infoworks support team to verify if the value must be modified, for example, Standard_D14_v2. This value depends on the usage of the system and possible workloads on the edge node.
• Once the values are entered, click Purchase and wait for the deployment to complete.

Configuring Spark 2 using Script Actions

• Login to https://portal.azure.com.
• Click the Resource Groups menu, select the resource group where the HDInsight cluster is located and select the respective HDInsight cluster.
• Select the Script Actions menu and click Submit New to install Spark 2 on all the nodes.

Enter the following values:

• Script type: Select the type as Custom.
• Name: Enter a name, for example, spark-installation.
• Bash Script URI: Enter the following URI https://raw.githubusercontent.com/Infoworks/deployments/master/azure/hdinsight/existinghdinsight/spark-install.sh
• Node Types: Select All the nodes - Head, Region, Zookeeper and Edge. This option allows to run script actions on selected nodes.
• Parameters: Enter the following space separated parameters - CLUSTER_NAME CLUSER_AMBARI_LOGINUSERNAME
• Check the the box to persist the script action to rerun the script action whenever a new node is added to the cluster.
• Click Create and wait for the deployment to finish.

Installing Infoworks on Edge Node using Script Actions

• Login to https://portal.azure.com.
• Click the Resource Groups menu, select the resource group where the HDInsight cluster is located and select the respective HDInsight Cluster.
• Select the Script Actions menu and click Submit New to install Infoworks on the edge node.

Enter the following:

• Script type: Select the value as Custom.
• Name: Enter a name, for example, iwx.
• Bash Script URI: Enter the following URI: https://raw.githubusercontent.com/Infoworks/deployments/master/azure/hdinsight/existinghdinsight/edgenode-init.sh
• Node Types: Select Edge node.
• Parameters: Enter the following space separated parameters: CLUSTER_NAME CLUSER_AMBARI_LOGINUSERNAME CLUSTER_AMBARI_LOGINPASSWORD
• Check the the box to persist the script action to rerun the script action whenever a new node is added to the cluster.
• Click Create and wait for the deployment to finish.