Enabling HA for Infoworks Edge Node

Infoworks DataFoundry HA requires three edge nodes due to the required quorum of Mongo DB as the metadata store.

Following is the procedure to launch the secondary and tertiary nodes for HA:

NOTE The node created in Deploying Infoworks for EMR Using Infoworks AMI is the primary Edge node.

  • Log in to the AWS Console.
  • Search for EC2 in the Find Services in the AWS Console dashboard.

Choose AMI

  • Select the launch instance from the EC2 dashboard.
  • Select the image from the My AMI Section.

NOTE The AMI ID for secured edge node is ami-0a867d67c3d1f9f2e.

If the AMIs are not available, following is an alternate option to launch the AMI:

  • Open the EC2 dashboard.
  • Navigate to AMIs > Private Images.
  • Select Infoworks EMR AMI.
  • Click the Actions button and select Launch.

Choose Instance Type

  • Select the machine type for the Infoworks Edge node; minimum and recommended is m4.xlarge.

Configure Instance

  • Set the Number of instances as 2.
  • Select the VPC and Subnet ID, similar to the EMR Cluster.

Add Storage

  • Add Root volume storage in GB. For example, 300 GB.

Add Tags

  • Add naming convention or environment tags for the resource.

Configure Security Group

  • Create a new security group and allow IW Ports and SSH.

Review

  • Review the configurations, select an existing key pair or create a new key pair and proceed with creation of Instance.

The following is an example of the launched instances:

Perform the following steps on the HA servers:

  • SSH into the servers.
  • Switch to the root user.
  • Download the copied Keytabs (see Post Installation) using the following commands:

wget https://bucket_name.s3.amazonaws.com/keytabs/hdfs.keytab -O /etc/hdfs.keytab

wget https://bucket_name.s3.amazonaws.com/keytabs/infoworks-user.keytab -O /etc/infoworks-user.keytab

  • Download the installation script using the following command:

wget https://infoworks-setup.s3.amazonaws.com/emr-configurations/emr-5.28.1/ha-emr-bootstrap.sh

  • Add the execution permission using the following command:

chmod +x ha-emr-bootstrap.sh

  • Run the installation script, entering your corresponding information using the following command:

./ha-emr-bootstrap.sh

For details on setting up Infoworks service recovery, see Service Recovery Set Up Procedure.

Type to search, ESC to discard
Type to search, ESC to discard
Type to search, ESC to discard
Next to read:
Introduction

For more details, refer to our Knowledge Base and Best Practices!

For help, contact our support team!

(C) 2015-2022 Infoworks.io, Inc. and Confidential

On This Page
Enabling HA for Infoworks Edge Node