Knowledge Base
Knowledge Base
Title
Message
Create new category
What is the title of your new category?
Edit page index title
What is the title of the page index?
Edit category
What is the new title of your category?
Edit link
What is the new title and URL of your link?
Troubleshooting ORC Tables
Copy Markdown
Open in ChatGPT
Open in Claude
Issue
Spark pipeline does not display data for ORC source tables even when data exists in the table.
Cause
Vectorized reader is used when the spark.sql.hive.convertMetastoreOrc configuration in the /opt/infoworks/conf/df_spark_defaults.conf file is set to true.
Solution
This issue occurs in Spark 2.3 and higher versions.
Set the spark.sql.hive.convertMetastoreOrc configuration in the /opt/infoworks/conf/df_spark_defaults.conf file to false.
Last updated on
Next to read:
ExceptionsFor more details, refer to our Knowledge Base and Best Practices!
For help, contact our support team!
(C) 2015-2022 Infoworks.io, Inc. and Confidential
Discard Changes
Do you want to discard your current changes and overwrite with the template?
Archive Synced Block
Message
Create new Template
What is this template's title?
Delete Template
Message