79101759

Date: 2024-10-18 11:00:21
Score: 1
Natty:
Report link

The answer to your question is yes like others have pointed out.

If you are inclined to use both together, which is what some people do depending on their comfort level, you can do the below -

lets say you read data into pyspark dataframe, then use createOrReplaceTempView or the globaltempview. Write SQL on top of it and execute your transformation.

then push the dataframe back to the destination either in lakehouse or datawarehouse.

Reasons:
  • No code block (0.5):
  • Low reputation (0.5):
Posted by: Bharath R S