You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
.
There is a problem with this, SparkPlan without logicalLink does not show correct fallback reason on UI.
Some additional nodes may be generated in gluten's rules, such as project generated by PushDownInputFileExpression.
Spark version
None
Spark configurations
No response
System information
No response
Relevant logs
The text was updated successfully, but these errors were encountered:
@ulysses-you AQE will also trigger the gluten rule again and retag for new physical plan. Is it necessary to set the fallback reason to logical plan, if so, can you explain the reason in detail, thank you?
cc @wForget I remember you asked similar quetion before. do you have any update ?
FelixYBW
changed the title
SparkPlan without logicalLink does not show correct fallback reason on UI
[VL] SparkPlan without logicalLink does not show correct fallback reason on UI
Jan 23, 2025
zml1206
changed the title
[VL] SparkPlan without logicalLink does not show correct fallback reason on UI
[CORE] SparkPlan without logicalLink does not show correct fallback reason on UI
Jan 24, 2025
Bug description
Currently, set the fallback reason to logical plan
incubator-gluten/gluten-substrait/src/main/scala/org/apache/spark/sql/execution/GlutenFallbackReporter.scala
Lines 54 to 69 in 0f4489a
There is a problem with this, SparkPlan without logicalLink does not show correct fallback reason on UI.
Some additional nodes may be generated in gluten's rules, such as project generated by PushDownInputFileExpression.
Spark version
None
Spark configurations
No response
System information
No response
Relevant logs
The text was updated successfully, but these errors were encountered: