How to Configure Wait Time to Query Infoworks MR Job Status during Merge Job

Issue

Configuring wait time for querying Infoworks MR job status during the merge job.

Cause

In some cases, merge job occasionally used to hang for secondary partitions because the RPC calls for job completion status did not return for a single thread, which in turn blocked other threads.

Solution

To resolve this issue, it was recommended that instead of waiting indefinitely, the Infoworks ADE must wait for a configurable amount of time and retry again. The number of retries are configurable and these configurations are now available to be set at the Admin level.

You can configure the wait time and number of retries for querying Infoworks MR job status using the following configurations:

• IW_JOB_STATUS_TIMEOUT_SECONDS: The number of seconds to wait for a response from the job completion status query. The default value is 20.
• IW_JOB_STATUS_RETRIES: The number of times the job completion status query will be retried before failing. After retrying the specified number of times, the secondary partition merge for that particular job fails. The default value is 3.