You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Is your feature request related to a problem? Please describe.
When running the user profiling tool with --worker_info argument for autotuner results, if the file is missing softwareProperties like:
23/10/04 15:02:50 ERROR Profiler: Exception thrown while writing
| java.lang.NullPointerException
| at com.nvidia.spark.rapids.tool.profiling.AutoTuner.getPropertyValue(AutoTuner.scala:360)
| at com.nvidia.spark.rapids.tool.profiling.AutoTuner.$anonfun$initRecommendations$1(AutoTuner.scala:368)
| at com.nvidia.spark.rapids.tool.profiling.AutoTuner.$anonfun$initRecommendations$1$adapted(AutoTuner.scala:366)
| at scala.collection.immutable.List.foreach(List.scala:431)
| at com.nvidia.spark.rapids.tool.profiling.AutoTuner.initRecommendations(AutoTuner.scala:366)
| at com.nvidia.spark.rapids.tool.profiling.AutoTuner.getRecommendedProperties(AutoTuner.scala:909)
| at com.nvidia.spark.rapids.tool.profiling.Profiler.$anonfun$writeOutput$50(Profiler.scala:506)
| at com.nvidia.spark.rapids.tool.profiling.Profiler.$anonfun$writeOutput$50$adapted(Profiler.scala:453)
| at scala.collection.immutable.List.foreach(List.scala:431)
| at com.nvidia.spark.rapids.tool.profiling.Profiler.writeOutput(Profiler.scala:453)
| at com.nvidia.spark.rapids.tool.profiling.Profiler.com$nvidia$spark$rapids$tool$profiling$Profiler$$writeSafelyToOutput(Profiler.scala:522)
| at com.nvidia.spark.rapids.tool.profiling.Profiler$ProfileProcessThread$1.run(Profiler.scala:251)
| at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
| at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
| at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
| at java.base/java.util.concurrent.ThreadPoolExecutor$W
This error message is confusing.
Describe the solution you'd like
The error message can mention "corrupted worker_info file, missing softwareProperties", so the users can debug this issue better.
The text was updated successfully, but these errors were encountered:
Is your feature request related to a problem? Please describe.
When running the user profiling tool with
--worker_info
argument for autotuner results, if the file is missingsoftwareProperties
like:the profiler throws a null pointer exception:
This error message is confusing.
Describe the solution you'd like
The error message can mention "corrupted worker_info file, missing softwareProperties", so the users can debug this issue better.
The text was updated successfully, but these errors were encountered: