You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
In Profiler tool, when aggregating SQL/Task metrics results in function aggregateSparkMetricsBySql, execCpuTime is defined and used twice in SQLTaskAggMetricsProfileResult:
Yes, I noticed that too when I was doing the optimizations in #1461
There should be only execCpuTimeSum because SQL does not have execCpuTime. It has to be aggregated on the tasks.
In Profiler tool, when aggregating SQL/Task metrics results in function aggregateSparkMetricsBySql, execCpuTime is defined and used twice in
SQLTaskAggMetricsProfileResult
:spark-rapids-tools/core/src/main/scala/com/nvidia/spark/rapids/tool/analysis/AppSparkMetricsAnalyzer.scala
Line 212 in 9564d0b
spark-rapids-tools/core/src/main/scala/com/nvidia/spark/rapids/tool/analysis/AppSparkMetricsAnalyzer.scala
Line 220 in 9564d0b
We should remove this duplicated metric result.
The text was updated successfully, but these errors were encountered: