Installation Procedure

Follow these steps to install the Infoworks ADE:

• Download and extract the tarball to the dedicated folder, for example, /opt.
• Untar the tarball using the following command: sudo tar -xvf <tar file> -C /opt. This creates a folder named infoworks inside the opt folder.
• Create a dedicated system user, Infoworks_user.

NOTE: The Infoworks_user must belong to a group that is present in hadoop.proxyuser.hive.groups. This will allow Hive to perform actions on behalf of Infoworks_user.

• Ensure that the Infoworks folder is owned by Infoworks_user and start all Infoworks components by running the following start.sh script in infoworks/bin folder as Infoworks_user with the argument all:

sudo chown -R <Infoworks_user>:<Infoworks_user> /opt/infoworks

cd /opt/infoworks/bin

sudo -u <Infoworks_user> ./start.sh all

./upgrade-orchestration-engine.sh 1.10.1

NOTE: When the Infoworks ADE is run for the first time, it will check all the dependencies and configure the product. This will check for the Hadoop, Hive, and Hbase clients and configurations. If the clients are not present in the system path, the user will be prompted to enter the location of the client. The script will also prompt for the NameNode hostname, HiveServer2 hostname and the Hive user and password that will be used by Infoworks. The hostnames must match the interfaces on which the NameNode and HiveServer2 are listening. The hosts file must contain the entries for these host names.

Ensure that the iw_hive_schema_crawl_classpath is added in the conf.properties file for Hive crawl.

Ignite Installation

Prerequisites

• Ensure that Ignite installation directory is created on all ignite hosts and the Infoworks user has write access to the directory.
• For SSL enabled cluster, ensure that a pre-generated Key Tab (keystore and truststore) is available.
• Ensure JAVA_HOME is set.

Procedure

• After installing the Infoworks ADE, navigate to the $IW_HOME/utils/infoworks-ansible folder.
• Create a host file with the list of host IPs (one IP in each line).

NOTE: Ensure that the file name is not hosts.

• Run the following command: cd ${IW_HOME}/resources/infoworks-ansible; ./setup-ignite.sh
• When prompted, provide the required details like the base directory created as a prerequisite, host file created, Ignite memory limits, etc. For SSL, provide keystore and truststore paths when prompted.
• To start or stop Ignite on all nodes, use the following commands respectively:

./ignite-start.sh ignite

./ignite-stop.sh ignite

• To start and stop Ignite on specific nodes, use the following commands respectively:

./ignite-start.sh <comma separated IPs> 

./ignite-stop.sh <comma separated IPs>

Verifying Ignite Installation

• To verify the cluster status, navigate to the $IW_HOME/utils/infoworks-ansible folder.
• Run the following command: ignite-status.sh

The installation will be verified.

To verify manually, login to the Ignite node and perform the following:

• Navigate to the bin folder using the following command: cd {ignite_installation_dir}/infoworks-ignite/bin
• To open the Ignitevisor shell use the following command: ./ignitevisorcmd.sh
• Run the open command and select the example-ignite.xml configuration file to establish the connection.
• Run the top command to identify the existing topology.
• Navigate to the bin folder using the following command: cd {ignite_installation_dir}/infoworks-ignite/bin
• Run the following commands to check if the cluster is activated:

./control.sh  –user ignite –password ignite –state

./control.sh  –user ignite –password ignite –baseline

To join a machine to cluster, perform the following:

• Navigate to the bin folder using the following command: cd {ignite_installation_dir}/infoworks-ignite/bin
• Run the following command on any cluster node and obtain the consistent ID of the node: ./control.sh –user ignite –password ignite –baseline
• Run the following command to join the node to the cluster: ./control.sh –user ignite –password ignite –baseline add <consistent id>

In the $IW_HOME/conf directory check for the examples-default.xml file. If the file is not available, copy the file from {ignite_installation_dir}/infoworks-ignite/examples/config/example-default.xml in any node where Ignite is running and place it in the $IW_HOME/conf directory.