Frequently Asked Questions
FAQ
Data Transformation
How can we view the code/query submitted for Spark pipelines running on the cluster?
In Spark, the query cannot be printed since data frame is used to submit the job. The plan is printed in the logs for all the transformations. Also, you can view the logical plan in SQL Tab in the Spark UI.
Last updated on
For more details, refer to our Knowledge Base and Best Practices!
For help, contact our support team!
(C) 2015-2022 Infoworks.io, Inc. and Confidential
General
Data Ingestion
Data Transformation
License Management