79474632

Date: 2025-02-28 06:03:38
Score: 3.5
Natty:
Report link

In Spark dataframes,

sort() is alias for orderBy()

https://spark.apache.org/docs/latest/api/python/reference/pyspark.sql/api/pyspark.sql.DataFrame.sort.html

But in Spark SQL

sort By sorts data at each partition level and order By sorts data at the entire level

sortby: https://spark.apache.org/docs/latest/sql-ref-syntax-qry-select-sortby.html

orderby: https://spark.apache.org/docs/latest/sql-ref-syntax-qry-select-orderby.html

Reasons:
  • Probably link only (1):
  • Low length (1):
  • No code block (0.5):
  • Low reputation (1):
Posted by: Natraj Puligilla