Release Notes 2.7.1

Date: 17 MAY 2019

New Features and Enhancements

Component: Data Ingestion and Synchronization

IPD-7243 - MongoDB Ingestion: Infoworks now supports, MongoDB, one of the NoSQL database, as a source.
IPD-7314 - Multi-character Delimiter Support: When performing DFI ingestion, user can now provide multi-character string as delimiter.
IPD-7288 - Data Export to Azure SQL Data Warehouse: Support to export data to Azure SQL Data Warehouse has been added.
IPD-7177 - Salesforce Ingestion using REST API: Salesforce Ingestion now supports fetching data using REST API.
IPD-7293 - Precision and Scale Handing for Teradata and File Based Sources: The issue caused in ingestion (TPT) and export (JDBC) due to scale and precision being equal at source has been fixed. For RDBMS, delimited and CSV files, in the Edit Schema page, user cannot enter scale values greater than the precision values.

Component: Data Transformation

IPD-7157 - Broadcast Join: Infoworks now supports Broadcast Join for Spark execution engines. Broadcast join can be very efficient for joins between a large table (fact) with relatively small tables (dimensions) that could then be used to perform a star-schema join.
IPD-7160 - Spark Cutpoint Optimization: A configuration, df_cutpoint_optimization_enabled, has been added to enable or disable caching when the value is set to true or false respectively. The default value is false .

Component: Orchestration

IPD-7211 - Orchestrator Integration with Notification Service: The Send Notification task in workflow has now been integrated with the new notification service. The legacy notification service has been deprecated. Existing workflows that use the Send Notification task works seamlessly and no manual changes are required.

Component: Platform

IPD-7220 - Monitoring Service: Support has been added to monitor the resource utilization of the system and application in the Infoworks edge node. The service collects different metrics like CPU usage, memory usage, disk usage and application status and displays graphs on the dashboard.
IPD-7224 - Mongo Archival Policy: Infoworks now supports archival/deletion of metadata which is not in use for a specific period.

Bug Fixes

IPD-7491 - Issue in Edit Schema for Oracle Ingestion: An error occurred when ingesting an Oracle table (post upgrade to 2.7.0 version) in which the datatype of the first column was modified from Decimal to any other datatype using the Edit Schema functionality. This issue has now been fixed.
IPD-7442 - Issue with Null Values in SCD2 Merge Pipeline: When building a pipeline with columns having null values, updates were captured as inserts and null value were overwritten with previous values in SCD2 merge pipelines. This issue has now been fixed.
IPD-7518 - Issue with Exporting Boolean Datatype to SQL Server: When exporting a data lake table which includes a column with boolean datatype, an exception occurred since boolean is not supported in SQL server. This issue has now been fixed by mapping boolean datatype to varchar(10).
IPD-6587 - Issue with Metadata crawl: Metadata crawl failed for SQL server when schema name included special characters and space. This issue has now been fixed.
IPD-7354 - Pipeline Export Error: When importing an exported configuration from another pipeline, an error, File content is not in valid JSON format, was displayed. This issue has now been fixed.

Installation

Refer Installation to install Infoworks ADE 2.7.1.

Upgrading to This Release

To upgrade your current Infoworks ADE version, execute the following commands on the edge node:

NOTE: Before starting the upgrade, ensure that all Infoworks services are running and no Infoworks jobs are running.

Run the following command: source $IW_HOME/bin/env.sh
Navigate to the scripts directory using the following command: cd $IW_HOME/scripts; where, $IW_HOME is the directory where the Infoworks ADE is installed. If scripts folder is not available (2.4.x, 2.5.x, 2.6.x base versions), create scripts folder in $IW_HOME.
Download the update script using the following command: wget <link-to-download>; reach out to your Infoworks support representative to get the link to download and replace with the link.
Upgrade the Infoworks ADE version using the following commands:

tar -xf update_2.7.1.tar.gz

cd iw-installer

./upgrade.sh -v 2.7.1

If the base version is below version 2.6, the upgrade procedure upgrades Metadata DB (Mongo) from 3.2 to 3.6 version. The upgrade of metadata DB includes the following:

updates the metadata DB binaries
sets up feature compatibility version

Release Notes 2.7.1.1

Date: 03 JUN 2019

Bug Fix

Component: Orchestration

IPD-7656 - Workflow Migration Issue: An error message was displayed when migrating workflows with multiple pipelines, each having different active version. This issue has now been fixed.

Last updated on