How to Update jSQL Parser Jar to Handle Special Characters during Ingestion

Issue

Updating jSQL parser jar in Infoworks to handle special characters during ingestion.

This article helps to update the jsqlparser jars from present version (0.* version) to the latest version (1.1 version) to handle special characters in data during ingestion.

Solution

Assumptions:

User following this article has

  • fair knowledge on classpath of $IW_HOME.
  • good understanding of Infoworks installation path and directories associated with it.

Following are the steps to upgrade the jsqlparser:

  • Run the following commands:

wget <link-to-download>

rm $IW_HOME/lib/jsqlparser/jsqlparser-0.8.0.jar

cd $IW_HOME/conf/

cat conf.properties | grep “iw_hdfs_temp_home

  • Copy the result of the previous command (output of cat conf.properties | grep “iw_hdfs_temp_home”).
  • Run the following command:

echo $IW_HOME

hadoop fs -ls /path_from_step_5/iwjobs/libjars/path_from_step_6/lib/jsqlparser/

  • If that folder exists, jsqlparser-0.8.0.jar will be present. Delete the folder:

hadoop fs -rm -r /path_from_step_5/iwjobs/libjars/path_from_step_6/lib/jsqlparser mv downloaded jsqlparser-1.1.jar to $IW_HOME/lib/jsqlparser/

Other Details

Type to search, ESC to discard
Type to search, ESC to discard
Type to search, ESC to discard