Skip to content

Commit a9ca651

Browse files
committed
feat: support concat for strings
1 parent 73d2a01 commit a9ca651

File tree

24 files changed

+3422
-3854
lines changed

24 files changed

+3422
-3854
lines changed

spark/src/test/resources/tpcds-plan-stability/approved-plans-v1_4-spark4_0/q84.native_iceberg_compat/explain.txt

Lines changed: 10 additions & 10 deletions
Original file line numberDiff line numberDiff line change
@@ -1,7 +1,7 @@
11
== Physical Plan ==
2-
TakeOrderedAndProject (33)
3-
+- * Project (32)
4-
+- * CometColumnarToRow (31)
2+
* CometColumnarToRow (33)
3+
+- CometTakeOrderedAndProject (32)
4+
+- CometProject (31)
55
+- CometBroadcastHashJoin (30)
66
:- CometBroadcastExchange (26)
77
: +- CometProject (25)
@@ -177,14 +177,14 @@ Left output [4]: [c_customer_id#7, c_first_name#8, c_last_name#9, cd_demo_sk#12]
177177
Right output [1]: [sr_cdemo_sk#18]
178178
Arguments: [cd_demo_sk#12], [sr_cdemo_sk#18], Inner, BuildLeft
179179

180-
(31) CometColumnarToRow [codegen id : 1]
180+
(31) CometProject
181181
Input [5]: [c_customer_id#7, c_first_name#8, c_last_name#9, cd_demo_sk#12, sr_cdemo_sk#18]
182+
Arguments: [customer_id#20, customername#21, c_customer_id#7], [c_customer_id#7 AS customer_id#20, concat(c_last_name#9, , , c_first_name#8) AS customername#21, c_customer_id#7]
182183

183-
(32) Project [codegen id : 1]
184-
Output [3]: [c_customer_id#7 AS customer_id#20, concat(c_last_name#9, , , c_first_name#8) AS customername#21, c_customer_id#7]
185-
Input [5]: [c_customer_id#7, c_first_name#8, c_last_name#9, cd_demo_sk#12, sr_cdemo_sk#18]
186-
187-
(33) TakeOrderedAndProject
184+
(32) CometTakeOrderedAndProject
188185
Input [3]: [customer_id#20, customername#21, c_customer_id#7]
189-
Arguments: 100, [c_customer_id#7 ASC NULLS FIRST], [customer_id#20, customername#21]
186+
Arguments: TakeOrderedAndProject(limit=100, orderBy=[c_customer_id#7 ASC NULLS FIRST], output=[customer_id#20,customername#21]), [customer_id#20, customername#21], 100, 0, [c_customer_id#7 ASC NULLS FIRST], [customer_id#20, customername#21]
187+
188+
(33) CometColumnarToRow [codegen id : 1]
189+
Input [2]: [customer_id#20, customername#21]
190190

spark/src/test/resources/tpcds-plan-stability/approved-plans-v1_4-spark4_0/q84.native_iceberg_compat/simplified.txt

Lines changed: 5 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -1,8 +1,8 @@
1-
TakeOrderedAndProject [c_customer_id,customer_id,customername]
2-
WholeStageCodegen (1)
3-
Project [c_customer_id,c_last_name,c_first_name]
4-
CometColumnarToRow
5-
InputAdapter
1+
WholeStageCodegen (1)
2+
CometColumnarToRow
3+
InputAdapter
4+
CometTakeOrderedAndProject [customer_id,customername,c_customer_id]
5+
CometProject [c_last_name,c_first_name] [customer_id,customername,c_customer_id]
66
CometBroadcastHashJoin [c_customer_id,c_first_name,c_last_name,cd_demo_sk,sr_cdemo_sk]
77
CometBroadcastExchange [c_customer_id,c_first_name,c_last_name,cd_demo_sk] #1
88
CometProject [c_customer_id,c_first_name,c_last_name,cd_demo_sk]

spark/src/test/resources/tpcds-plan-stability/approved-plans-v1_4-spark4_0/q84/explain.txt

Lines changed: 10 additions & 10 deletions
Original file line numberDiff line numberDiff line change
@@ -1,7 +1,7 @@
11
== Physical Plan ==
2-
TakeOrderedAndProject (33)
3-
+- * Project (32)
4-
+- * CometColumnarToRow (31)
2+
* CometColumnarToRow (33)
3+
+- CometTakeOrderedAndProject (32)
4+
+- CometProject (31)
55
+- CometBroadcastHashJoin (30)
66
:- CometBroadcastExchange (26)
77
: +- CometProject (25)
@@ -177,14 +177,14 @@ Left output [4]: [c_customer_id#7, c_first_name#8, c_last_name#9, cd_demo_sk#12]
177177
Right output [1]: [sr_cdemo_sk#18]
178178
Arguments: [cd_demo_sk#12], [sr_cdemo_sk#18], Inner, BuildLeft
179179

180-
(31) CometColumnarToRow [codegen id : 1]
180+
(31) CometProject
181181
Input [5]: [c_customer_id#7, c_first_name#8, c_last_name#9, cd_demo_sk#12, sr_cdemo_sk#18]
182+
Arguments: [customer_id#20, customername#21, c_customer_id#7], [c_customer_id#7 AS customer_id#20, concat(c_last_name#9, , , c_first_name#8) AS customername#21, c_customer_id#7]
182183

183-
(32) Project [codegen id : 1]
184-
Output [3]: [c_customer_id#7 AS customer_id#20, concat(c_last_name#9, , , c_first_name#8) AS customername#21, c_customer_id#7]
185-
Input [5]: [c_customer_id#7, c_first_name#8, c_last_name#9, cd_demo_sk#12, sr_cdemo_sk#18]
186-
187-
(33) TakeOrderedAndProject
184+
(32) CometTakeOrderedAndProject
188185
Input [3]: [customer_id#20, customername#21, c_customer_id#7]
189-
Arguments: 100, [c_customer_id#7 ASC NULLS FIRST], [customer_id#20, customername#21]
186+
Arguments: TakeOrderedAndProject(limit=100, orderBy=[c_customer_id#7 ASC NULLS FIRST], output=[customer_id#20,customername#21]), [customer_id#20, customername#21], 100, 0, [c_customer_id#7 ASC NULLS FIRST], [customer_id#20, customername#21]
187+
188+
(33) CometColumnarToRow [codegen id : 1]
189+
Input [2]: [customer_id#20, customername#21]
190190

spark/src/test/resources/tpcds-plan-stability/approved-plans-v1_4-spark4_0/q84/simplified.txt

Lines changed: 5 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -1,8 +1,8 @@
1-
TakeOrderedAndProject [c_customer_id,customer_id,customername]
2-
WholeStageCodegen (1)
3-
Project [c_customer_id,c_last_name,c_first_name]
4-
CometColumnarToRow
5-
InputAdapter
1+
WholeStageCodegen (1)
2+
CometColumnarToRow
3+
InputAdapter
4+
CometTakeOrderedAndProject [customer_id,customername,c_customer_id]
5+
CometProject [c_last_name,c_first_name] [customer_id,customername,c_customer_id]
66
CometBroadcastHashJoin [c_customer_id,c_first_name,c_last_name,cd_demo_sk,sr_cdemo_sk]
77
CometBroadcastExchange [c_customer_id,c_first_name,c_last_name,cd_demo_sk] #1
88
CometProject [c_customer_id,c_first_name,c_last_name,cd_demo_sk]

0 commit comments

Comments
 (0)