v24.02.0

Packages

• Maven Release: https://repo1.maven.org/maven2/com/nvidia/rapids-4-spark-tools_2.12/24.02.0/
• PyPI Package: https://pypi.org/project/spark-rapids-user-tools/24.02.0/

Changes

User Tools

• Fix missing config file for Dataproc GKE (#778)
• [FEA] Qualification user_tools runs AutoTuner by default (#771)
• [BUG] Fix databricks-aws user profiling tool error with --gpu_cluster argument (#707)

Core

• [FEA] Qualification tool should mark WriteIntoDeltaCommand as supported (#801)
• Qualification tool should mark SubqueryExec as IgnoreNoPerf (#798)
• Generate cluster information from event logs in Qualification tool (#789)
• Sync up supported ops for 24.02 plugin release (#796)
• Qualification should mark empty2null as supported (#791)
• Incorrect parsing of aggregates in DB queries (#790)
• Qualification should mark WriteFiles as supported (#784)
• Introduce GpuDevice abstraction and refactor AutoTuner (#740)
• Consolidate unsupportedOperators into a single view (#766)
• Speedup generator script fails after adding runtime_properties (#776)
• Tools fail on DB10.4 clusters with IllegalArgException (#768)
• Fix SparkPlanGraphCluster constructor for DB Platforms (#765)
• Amendment to PR-763 (#764)
• Fix SQLPLanMetric constructor for DB Platforms (#763)
• Fix node constructor for DB platforms (#761)
• Add penalty for stages with UDF's (#757)
• Add support to appendDataExecV1 and overwriteByExprExecV1 (#756)
• Qualification fails to detect sortMergeJoin with arguments (#754)
• Fix Qualification crash during aggregation of stats (#753)
• [FEA] Extend the list of operators to be ignored in Qualification (#745)
• Remove ReusedSubquery from SparkPlanGraph construction (#741)
• Update unsupported operator csv file's app duration column (#748)
• [FEA] Qualification tool triggers the AutoTuner module (#739)
• Disable support of GetJsonObject in Qualification tool (#737)
• [FEA] AutoTuner warns that non-utf8 may not support some GPU expressions (#736)
• [FEA] AutoTuner should not skip non-gpu eventlogs (#728)

Miscellaneous

• Add auto-copyright for precommits (#732)