cloud-fan
Follow
Popular repositories
1,510 contributions in the last year
Less
More
Activity overview
Contribution activity
May 2021
Created 5 commits in 2 repositories
Created a pull request in apache/spark that received 44 comments
[SPARK-35400][SQL] Simplify getOuterReferences and improve error message for correlated subquery
What changes were proposed in this pull request? Spark doesn't support aggregate functions with mixed outer and local references. This PR applies …
+29
−32
•
44
comments
Opened 6 other pull requests in 2 repositories
apache/spark
3
open
2
closed
- [SPARK-35447][SQL] Optimize skew join before coalescing shuffle partitions
- [WIP] Simplify ResolveAggregateFunctions
- [WIP] simplify correlated subquery resolution
- [SPARK-35333][SQL] Skip object null check in Invoke if possible
- [SPARK-26164][SQL][FOLLOWUP] WriteTaskStatsTracker should know which file the row is written to
apache/spark-website
1
merged
Reviewed 65 pull requests in 2 repositories
apache/spark 64 pull requests
- [SPARK-35439][SQL] Children subexpr should come first than parent subexpr
- [SPARK-35447][SQL] Optimize skew join before coalescing shuffle partitions
- [SPARK-34775][SQL] Push down limit through window when partitionSpec is not empty
- [SPARK-35106][Core][SQL] Avoid failing rename caused by destination directory not exist
- [SPARK-35316][SQL] UnwrapCastInBinaryComparison support In predicate
- [SPARK-35421][SS] Remove redundant ProjectExec from streaming queries with V2Relation
- [SPARK-35093] [SQL] AQE now uses newQueryStage plan as key for looking up cached exchanges for re-use
- [SPARK-35290][SQL] Use StructType merging for unionByName with null filling
- [SPARK-34952][SQL] Aggregate (Min/Max/Count) push down for Parquet
- [SPARK-35411][SQL] Add essential information while serializing TreeNode to json
- [SPARK-35422][SQL] Fix plan-printing issues to pass the TPCDS plan stability tests in Scala v2.13
- [SPARK-35389][SQL] V2 ScalarFunction should support magic method with null arguments
-
[SPARK-35427][SQL][TESTS] Check the
EXCEPTIONrebase mode for Avro/Parquet - [SPARK-33314][SQL] Avoid dropping rows in Avro reader
- [SPARK-28551][SQL] CTAS with LOCATION should not allow to a non-empty directory.
- [SPARK-35351][SQL] Add code-gen for left anti sort merge join
- [SPARK-35378][SQL] Eagerly execute Command so that query command with CTE
- [SPARK-35410][SQL] SubExpr elimination should not include redundant children exprs in conditional expression
- [SPARK-35282][SQL] Support AQE side shuffled hash join formula using rule
- [SPARK-35400][SQL] Simplify getOuterReferences and improve error message for correlated subquery
- [SPARK-35363][SQL][FOLLOWUP] Use fresh name for findNextJoinRows instead of hardcoding it
- [SPARK-35206][TESTS][SQL] Extract common used get project path into a function in SparkFunctionSuite
- [SPARK-35359][SQL] Insert data with char/varchar datatype will fail when data length exceed length limitation
- [SPARK-35207][SQL] Normalize hash function behavior with negative zero (floating point types)
- [SPARK-35363][SQL] Refactor sort merge join code-gen be agnostic to join type
- Some pull request reviews not shown.
